-- Logs begin at Thu 2022-06-16 16:28:06 UTC, end at Thu 2022-06-16 17:46:06 UTC. -- Jun 16 17:05:29.644222 dv-cinder-837356-2-smb systemd[1]: Starting Devstack devstack@keystone.service... Jun 16 17:05:29.652183 dv-cinder-837356-2-smb devstack@keystone.service[80859]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jun 16 17:05:29.655230 dv-cinder-837356-2-smb devstack@keystone.service[80859]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jun 16 17:05:29 2022] *** Jun 16 17:05:29.655230 dv-cinder-837356-2-smb devstack@keystone.service[80859]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 16 17:05:29.655230 dv-cinder-837356-2-smb devstack@keystone.service[80859]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 16 17:05:29.655230 dv-cinder-837356-2-smb devstack@keystone.service[80859]: nodename: dv-cinder-837356-2-smb Jun 16 17:05:29.655230 dv-cinder-837356-2-smb devstack@keystone.service[80859]: machine: x86_64 Jun 16 17:05:29.655230 dv-cinder-837356-2-smb devstack@keystone.service[80859]: clock source: unix Jun 16 17:05:29.655230 dv-cinder-837356-2-smb devstack@keystone.service[80859]: pcre jit disabled Jun 16 17:05:29.655230 dv-cinder-837356-2-smb devstack@keystone.service[80859]: detected number of CPU cores: 4 Jun 16 17:05:29.655230 dv-cinder-837356-2-smb devstack@keystone.service[80859]: current working directory: / Jun 16 17:05:29.655230 dv-cinder-837356-2-smb devstack@keystone.service[80859]: detected binary path: /usr/bin/uwsgi-core Jun 16 17:05:29.655804 dv-cinder-837356-2-smb devstack@keystone.service[80859]: your processes number limit is 47680 Jun 16 17:05:29.655804 dv-cinder-837356-2-smb devstack@keystone.service[80859]: your memory page size is 4096 bytes Jun 16 17:05:29.655804 dv-cinder-837356-2-smb devstack@keystone.service[80859]: detected max file descriptor number: 2048 Jun 16 17:05:29.655804 dv-cinder-837356-2-smb devstack@keystone.service[80859]: lock engine: pthread robust mutexes Jun 16 17:05:29.655804 dv-cinder-837356-2-smb devstack@keystone.service[80859]: thunder lock: enabled Jun 16 17:05:29.655804 dv-cinder-837356-2-smb devstack@keystone.service[80859]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jun 16 17:05:29.655804 dv-cinder-837356-2-smb devstack@keystone.service[80859]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 16 17:05:29.699364 dv-cinder-837356-2-smb devstack@keystone.service[80859]: Python main interpreter initialized at 0x5623ad94a9c0 Jun 16 17:05:29.699364 dv-cinder-837356-2-smb devstack@keystone.service[80859]: python threads support enabled Jun 16 17:05:29.699364 dv-cinder-837356-2-smb devstack@keystone.service[80859]: your server socket listen backlog is limited to 100 connections Jun 16 17:05:29.699364 dv-cinder-837356-2-smb devstack@keystone.service[80859]: your mercy for graceful operations on workers is 90 seconds Jun 16 17:05:29.699761 dv-cinder-837356-2-smb devstack@keystone.service[80859]: mapped 403077 bytes (393 KB) for 2 cores Jun 16 17:05:29.699839 dv-cinder-837356-2-smb devstack@keystone.service[80859]: *** Operational MODE: preforking *** Jun 16 17:05:29.700064 dv-cinder-837356-2-smb devstack@keystone.service[80859]: *** uWSGI is running in multiple interpreter mode *** Jun 16 17:05:29.700064 dv-cinder-837356-2-smb devstack@keystone.service[80859]: spawned uWSGI master process (pid: 80859) Jun 16 17:05:29.700274 dv-cinder-837356-2-smb systemd[1]: Started Devstack devstack@keystone.service. Jun 16 17:05:29.700856 dv-cinder-837356-2-smb devstack@keystone.service[80859]: spawned uWSGI worker 1 (pid: 80873, cores: 1) Jun 16 17:05:29.701794 dv-cinder-837356-2-smb devstack@keystone.service[80859]: spawned uWSGI worker 2 (pid: 80874, cores: 1) Jun 16 17:05:29.701794 dv-cinder-837356-2-smb devstack@keystone.service[80859]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 16 17:05:35.290941 dv-cinder-837356-2-smb devstack@keystone.service[80874]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 17:05:35.290941 dv-cinder-837356-2-smb devstack@keystone.service[80874]: from cryptography.utils import int_from_bytes Jun 16 17:05:35.291748 dv-cinder-837356-2-smb devstack@keystone.service[80874]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 17:05:35.291748 dv-cinder-837356-2-smb devstack@keystone.service[80874]: from cryptography.utils import int_from_bytes Jun 16 17:05:35.291864 dv-cinder-837356-2-smb devstack@keystone.service[80873]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 17:05:35.291864 dv-cinder-837356-2-smb devstack@keystone.service[80873]: from cryptography.utils import int_from_bytes Jun 16 17:05:35.292273 dv-cinder-837356-2-smb devstack@keystone.service[80873]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 17:05:35.292273 dv-cinder-837356-2-smb devstack@keystone.service[80873]: from cryptography.utils import int_from_bytes Jun 16 17:05:35.341300 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 16 17:05:35.341535 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 16 17:05:35.341701 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] command line args: [] {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 16 17:05:35.342020 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 16 17:05:35.342207 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] ================================================================================ {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 16 17:05:35.342475 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] admin_token = **** {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:05:35.342733 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] config_dir = [] {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:05:35.342923 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:05:35.343110 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] config_source = [] {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:05:35.343294 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] debug = True {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:05:35.343496 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:05:35.343866 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:05:35.344047 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:05:35.344305 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:05:35.344560 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:05:35.344795 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] list_limit = None {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:05:35.344980 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] log_config_append = None {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:05:35.345162 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:05:35.345345 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] log_dir = None {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:05:35.345526 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] log_file = None {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:05:35.345785 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:05:35.346045 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:05:35.346297 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:05:35.346684 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:05:35.346871 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:05:35.347055 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:05:35.347324 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:05:35.347564 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:05:35.347804 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:05:35.348043 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:05:35.348280 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:05:35.348368 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 16 17:05:35.348509 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:05:35.348643 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 16 17:05:35.348721 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] command line args: [] {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 16 17:05:35.348844 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:05:35.348997 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 16 17:05:35.349138 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:05:35.349220 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] ================================================================================ {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 16 17:05:35.349350 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:05:35.349428 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] admin_token = **** {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:05:35.349661 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] config_dir = [] {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:05:35.349747 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.39/identity {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:05:35.349884 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:05:35.349977 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] publish_errors = False {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:05:35.350057 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] config_source = [] {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:05:35.350185 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:05:35.350292 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] debug = True {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:05:35.350405 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:05:35.350491 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:05:35.350595 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:05:35.350722 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:05:35.350827 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:05:35.350911 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:05:35.351066 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:05:35.351154 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:05:35.351312 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] standard_threads = False {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:05:35.351394 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:05:35.351547 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:05:35.351634 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] list_limit = None {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:05:35.351736 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] log_config_append = None {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:05:35.351814 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:05:35.351916 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:05:35.351994 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:05:35.352096 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] log_dir = None {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:05:35.352202 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] use_journal = False {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:05:35.352276 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] log_file = None {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:05:35.352346 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] use_json = False {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:05:35.352458 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] use_stderr = False {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:05:35.352537 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:05:35.352637 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] use_syslog = False {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:05:35.352785 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:05:35.352866 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:05:35.352978 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:05:35.353119 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.353227 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:05:35.353364 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.353451 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:05:35.353572 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:05:35.353651 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.353845 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:05:35.353950 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.354356 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:05:35.354480 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.354601 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:05:35.354686 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.354837 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:05:35.354927 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.355071 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:05:35.355150 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.355306 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:05:35.355384 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.355554 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:05:35.355640 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.355801 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:05:35.355881 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.356040 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.356117 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:05:35.356293 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.356535 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.356622 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.39/identity {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:05:35.356724 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] publish_errors = False {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:05:35.356802 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.356962 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:05:35.357048 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.357196 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:05:35.357280 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.357359 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:05:35.357499 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.357612 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:05:35.357781 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.357861 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:05:35.358029 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.358107 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] standard_threads = False {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:05:35.358270 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.358359 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:05:35.358531 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.358616 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:05:35.358718 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:05:35.358797 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.358897 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] use_journal = False {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:05:35.359043 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.359123 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] use_json = False {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:05:35.359238 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] use_stderr = False {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:05:35.359316 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.359416 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] use_syslog = False {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:05:35.359520 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.359650 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:05:35.359756 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.359913 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.359991 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.360153 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.360231 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.360415 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.360615 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.360695 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.360766 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.360921 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.361009 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.361155 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.361233 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.361403 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.361487 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.361641 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.361836 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.361914 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.362483 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.362833 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.362932 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.363006 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.363090 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.363164 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.363234 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.363372 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.363452 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.363609 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.363697 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.363848 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.363927 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.364084 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.364169 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.364320 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.364407 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.364560 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.364639 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.364812 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.364891 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.365047 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.365134 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.365286 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.365365 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.365521 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.365606 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.365786 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.365898 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.366018 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.366130 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.366270 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.366385 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.366505 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.366595 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.366744 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.366820 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.366986 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.367054 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.367223 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.367301 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.367462 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.367532 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.367701 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.367810 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.367953 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.368142 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.368224 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.368359 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.368437 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.368554 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.368672 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.368749 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.368916 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.369000 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.369168 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.369260 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.369401 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.369488 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.369636 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.369722 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.369903 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.369984 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.370138 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.370224 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.370374 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.370454 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.370607 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.370686 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.370840 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.370920 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.371076 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.371153 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.371325 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.371410 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.371557 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.371638 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.371794 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.371951 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.372063 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.372134 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.372300 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.372382 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.372535 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.372615 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.372781 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.372859 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.373010 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.373087 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.373247 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.373329 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.373484 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.373562 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.373717 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.373841 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.373980 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.374068 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.374214 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.374293 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.374445 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.374524 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.374696 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.374786 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.374931 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.375011 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.375167 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.375251 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.375400 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.375494 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.375639 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.375719 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.375880 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.375961 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.376109 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.376197 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.376343 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.376422 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.376576 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.376662 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.376815 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.376903 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.377050 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.377131 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.377296 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.377377 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.377537 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.377676 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.378447 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.378608 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.378697 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.378789 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.378944 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.379053 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.379191 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.379280 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.379431 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.379512 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.379666 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] auth.external = None {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.379757 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.379904 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.379985 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.380139 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.380219 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.380379 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.380470 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.380616 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.380697 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] auth.password = None {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.380850 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.380932 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] auth.token = None {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.381085 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.381174 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.381332 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.381418 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.381573 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.381653 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.381826 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.381923 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.382071 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.382151 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.382313 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.382394 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.382545 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.382632 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.382779 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.382895 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] credential.caching = True {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.383006 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.383085 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.383237 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.383353 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.383508 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.383610 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.383741 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.383851 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.383977 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.384059 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.384208 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.384297 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.384448 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.384535 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.384683 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.384764 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.384932 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.385022 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.385170 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.385259 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.385424 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.385511 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.385683 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.385804 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.385951 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.386035 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.386185 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] auth.external = None {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.386271 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.386452 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.386549 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.386686 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] federation.caching = True {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.386775 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.386924 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.387005 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.387154 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] auth.password = None {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.387243 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.387386 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] auth.token = None {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.387467 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.387625 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.387705 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.387859 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.387949 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.388096 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.388178 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.388326 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.388407 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.388573 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.388736 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.388814 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.388888 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.389040 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.389122 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.389274 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] credential.caching = True {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.389396 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.389509 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] identity.caching = True {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.389590 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.389783 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.389867 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.390032 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.390116 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.390267 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.390360 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.390502 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.390584 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.390734 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.390815 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.390972 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.391052 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.391219 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.391302 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.391453 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.391536 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.391707 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.391789 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.391939 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.392023 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.392163 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.392247 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.392399 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.392480 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.392645 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.392727 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.392896 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.392979 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.393146 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.393229 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] federation.caching = True {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.393464 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.393559 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.393680 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.393784 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.393981 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.394069 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.394224 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.394306 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.394465 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.394550 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.394700 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.394781 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.394938 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.395018 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.395173 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.395262 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.395411 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.395499 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.395649 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.395729 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.395889 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.395979 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.396123 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] identity.caching = True {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.396203 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.396362 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.396442 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.396609 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.396691 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.396845 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.396930 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.397080 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.397170 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.397327 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.397409 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.397556 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.397637 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.397815 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.397902 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.398057 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.398139 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.398290 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.398371 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.398529 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.398611 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.398758 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.398840 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.398990 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.399071 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.399227 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.399307 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.399467 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.399557 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.399714 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.399795 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.399961 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.400041 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.400196 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.400279 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.400429 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.400510 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.400679 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.400770 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.400918 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.400999 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.401151 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.401232 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.401388 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.401479 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.401620 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.401702 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.401880 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.401965 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] ldap.user = None {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.402123 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.402212 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.402361 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.402442 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.402608 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.402689 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.402838 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.402928 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.403082 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.403165 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.403328 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.403410 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.403561 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.403652 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.403812 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.403948 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.404028 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.404101 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.404258 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.404349 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.404492 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.404572 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.404721 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.404803 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.404957 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.405055 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.405192 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.405274 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.405431 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.405518 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.405665 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.405786 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.405926 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.406009 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.406163 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.406244 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.406408 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.406501 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.406640 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.406721 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.406871 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.406952 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.407106 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.407195 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.407345 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.407428 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.407576 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.407657 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.407810 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.407901 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.408044 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.408126 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.408275 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] ldap.user = None {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.408356 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.408512 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.408602 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.408764 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.408844 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.409183 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.409688 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.409800 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.409894 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.409973 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.410035 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.410035 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.410142 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.410201 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.410292 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.410376 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.410527 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.410634 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.410761 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.410883 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.410996 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.411133 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] resource.caching = True {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.411228 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.411395 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.411576 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.411729 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.411942 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.412072 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.412205 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.412320 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.412403 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.412479 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.412562 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.412638 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.412744 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.412826 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.412988 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.413070 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.413225 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.413308 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.413461 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.413542 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] role.caching = True {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.413696 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.413811 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] role.driver = sql {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.413959 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.414084 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.414206 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.414288 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.414453 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.414543 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.414691 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.414773 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.414946 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.415027 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.415181 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.415271 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.415427 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.415509 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.415663 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.415744 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.415899 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.416005 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.416138 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.416222 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.416381 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.416461 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.416623 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.416713 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.416855 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.416936 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.417091 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.417171 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.417332 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] resource.caching = True {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.417497 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.417579 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.417738 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.417840 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.418015 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.418097 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.418268 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.418351 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.418520 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.418601 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.418761 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.418840 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.418995 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.419076 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.419229 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.419309 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.419469 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.419549 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.419702 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] role.caching = True {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.419784 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.419943 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.420069 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] role.driver = sql {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.420176 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.420255 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.420409 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.420490 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.420660 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.420740 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.420907 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.420991 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.421153 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.421236 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.421392 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.421471 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.421632 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.421726 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.421890 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.421973 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.422130 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] token.caching = True {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.422211 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.422361 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.422452 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.422609 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.422691 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.422846 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.422925 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.423091 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.423180 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.423337 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.423419 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.423578 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.423734 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.423815 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.423976 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.424058 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.424231 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.424312 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.425048 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.425197 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.425373 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.425462 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.425615 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.425698 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.425890 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.425974 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.426148 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.426231 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.426384 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.426464 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.426632 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.426714 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.426865 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.426947 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.427099 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.427181 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] database.connection = **** {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.427333 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.427425 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.427585 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.427680 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.427841 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.427925 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.428089 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.428171 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.428327 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.428417 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.428566 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.428647 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.428796 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.428878 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.429034 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] token.caching = True {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.429124 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.429270 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.429352 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.429510 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.429591 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.429745 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.429864 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.430013 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.430094 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.430265 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.430345 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.430502 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.430591 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.430745 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.430826 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.430978 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.431058 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.431222 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.431312 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.431458 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.431538 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.431612 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 16 17:05:35.431685 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.431921 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.432167 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.432415 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.432648 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.432891 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.433187 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.433451 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] database.connection = **** {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.433698 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.433990 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.434231 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.434475 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.434715 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.434954 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.435193 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.435432 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.435680 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.435919 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.436167 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.436405 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.436658 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.436895 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.437141 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.437374 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.437614 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.437877 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:05:35.438052 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 16 17:05:35.550795 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80874) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 17:05:35.550971 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80874) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 17:05:35.551157 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80874) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 17:05:35.553147 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80873) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 17:05:35.553375 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80873) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 17:05:35.553607 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80873) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 17:05:35.561983 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80873) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 17:05:35.566531 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80874) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 17:05:35.594676 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80874) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 17:05:35.594911 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80874) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 17:05:35.598345 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80873) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 17:05:35.598580 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80873) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 17:05:35.649700 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80873) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 17:05:35.649924 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80874) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 17:05:35.699403 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80873) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 17:05:35.699631 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80873) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 17:05:35.700165 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80874) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 17:05:35.700409 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80874) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 17:05:35.766106 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80873) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 17:05:35.766333 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80873) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 17:05:35.766429 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80874) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 17:05:35.766555 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80873) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 17:05:35.766687 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80874) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 17:05:35.766772 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80873) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 17:05:35.766848 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80874) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 17:05:35.766978 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80873) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 17:05:35.767075 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80874) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 17:05:35.767193 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80873) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 17:05:35.767279 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80874) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 17:05:35.767421 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80874) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 17:05:35.790655 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80873) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 17:05:35.790893 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80873) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 17:05:35.791048 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80874) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 17:05:35.791141 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80873) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 17:05:35.791290 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80874) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 17:05:35.791377 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80873) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 17:05:35.791524 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80874) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 17:05:35.791622 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80873) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 17:05:35.791738 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80873) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 17:05:35.791824 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80874) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 17:05:35.791951 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80873) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 17:05:35.792037 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80874) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 17:05:35.792172 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80874) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 17:05:35.792392 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80874) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 17:05:35.803696 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80873) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 17:05:35.803880 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80874) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 17:05:35.816836 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80873) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 17:05:35.817065 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80873) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 17:05:35.817170 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80874) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 17:05:35.817291 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80873) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 17:05:35.817377 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80874) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 17:05:35.817511 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80873) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 17:05:35.817596 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80874) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 17:05:35.817725 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80873) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 17:05:35.817831 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80874) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 17:05:35.817973 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80873) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 17:05:35.818065 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80874) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 17:05:35.818208 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80873) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 17:05:35.818308 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80874) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 17:05:35.818429 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80874) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 17:05:35.835995 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80873) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:05:35.836205 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80873) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 16 17:05:35.836478 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80874) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:05:35.836565 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80873) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:05:35.836697 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80874) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 16 17:05:35.836785 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80873) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 16 17:05:35.836979 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80873) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:05:35.837064 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80874) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:05:35.837229 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80874) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 16 17:05:35.837322 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80873) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:05:35.837483 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80873) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:05:35.837567 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80874) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:05:35.837737 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80873) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:05:35.837900 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80874) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:05:35.838028 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80874) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:05:35.838291 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80874) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:05:35.848742 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80873) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:05:35.849014 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80873) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:05:35.849258 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80874) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:05:35.849365 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80873) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:05:35.849540 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80874) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:05:35.849631 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80873) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:05:35.849842 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80874) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:05:35.850135 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80874) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:05:35.858089 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80873) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 17:05:35.858722 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80874) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 17:05:35.861370 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80873) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 17:05:35.861650 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80873) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:05:35.862006 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80873) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:05:35.862103 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80874) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 17:05:35.862335 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80873) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:05:35.862444 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80874) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:05:35.862619 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80873) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:05:35.862705 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80874) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:05:35.862875 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80873) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:05:35.862962 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80874) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:05:35.863142 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80873) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:05:35.863230 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80874) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:05:35.863415 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80873) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:05:35.863500 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80874) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:05:35.863683 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80873) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:05:35.863776 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80874) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:05:35.863953 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80873) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:05:35.864038 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80874) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:05:35.864217 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80873) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:05:35.864301 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80874) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:05:35.864491 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80874) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:05:35.864761 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80874) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:05:35.891562 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80873) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:05:35.892100 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80874) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:05:35.893877 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80873) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 17:05:35.894176 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80873) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:05:35.894327 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80874) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 17:05:35.894607 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80874) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:05:35.899520 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80873) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 17:05:35.899936 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80873) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:05:35.900037 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80874) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 17:05:35.900220 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80873) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:05:35.900344 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80874) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:05:35.900632 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80874) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:05:35.907561 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80873) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 17:05:35.907841 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80873) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:05:35.908040 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80874) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 17:05:35.908328 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80874) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:05:35.912424 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80873) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 17:05:35.912711 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80873) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:05:35.912887 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80874) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 17:05:35.912988 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80873) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:05:35.913178 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80874) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:05:35.913265 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80873) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:05:35.913467 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80874) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:05:35.913552 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80873) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:05:35.913771 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80874) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:05:35.913859 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80873) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:05:35.914049 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80873) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:05:35.914132 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80874) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:05:35.914316 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80873) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:05:35.914402 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80874) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:05:35.914591 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80874) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:05:35.914865 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80874) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:05:35.933262 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80873) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:05:35.933538 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80873) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:05:35.933861 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80874) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:05:35.934143 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80874) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:05:35.938087 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80873) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 17:05:35.938743 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80874) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 17:05:35.942265 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80873) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:05:35.942661 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80873) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:05:35.943019 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80874) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:05:35.943421 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80874) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:05:35.947705 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80873) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 17:05:35.948506 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80874) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 17:05:35.951294 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80873) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 17:05:35.952177 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80874) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 17:05:35.955038 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80873) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:05:35.955337 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80873) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:05:35.955631 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80873) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:05:35.956471 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80873) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:05:35.956807 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80873) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:05:35.957023 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80873) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:05:35.957240 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80874) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:05:35.957542 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80874) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:05:35.957862 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80874) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:05:35.958153 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80874) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:05:35.958437 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80874) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:05:35.959544 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80874) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:05:35.976304 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80873) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 17:05:35.976583 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80873) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:05:35.976850 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80873) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:05:35.977121 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80873) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:05:35.978863 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80874) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 17:05:35.979404 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80874) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:05:35.979678 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80874) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:05:35.979955 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80874) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:05:35.985293 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80873) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:05:35.987118 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80873) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:05:35.987539 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80873) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:05:35.988891 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80874) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:05:35.990758 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80874) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:05:35.991050 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80874) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:05:35.991924 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80873) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 17:05:35.992202 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80873) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:05:35.992489 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80873) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:05:35.992767 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80873) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:05:35.993052 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80873) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:05:35.995619 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80874) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 17:05:35.995908 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80874) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:05:35.996195 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80874) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:05:35.996481 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80874) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:05:35.996775 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80874) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:05:36.006979 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80873) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 17:05:36.007255 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80873) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:05:36.007550 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80873) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:05:36.007814 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80873) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:05:36.008184 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80873) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:05:36.008681 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80873) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:05:36.008962 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80873) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:05:36.010777 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80874) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 17:05:36.011062 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80874) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:05:36.011349 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80874) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:05:36.011634 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80874) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:05:36.012019 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80874) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:05:36.012304 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80874) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:05:36.012596 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80874) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:05:36.027504 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80873) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 17:05:36.030780 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80873) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 17:05:36.031394 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80874) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 17:05:36.034195 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80873) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:05:36.034730 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80874) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 17:05:36.035925 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80873) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:05:36.037561 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80873) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 17:05:36.037867 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80873) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:05:36.038103 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80874) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:05:36.038202 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80873) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:05:36.039866 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80874) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:05:36.041534 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80874) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 17:05:36.041847 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80874) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:05:36.042144 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80874) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:05:36.045432 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80873) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:05:36.047078 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80873) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 17:05:36.050044 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80874) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:05:36.050911 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80873) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:05:36.051198 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80873) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:05:36.051581 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80873) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:05:36.051685 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80874) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 17:05:36.051857 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80873) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:05:36.054994 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80874) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:05:36.055244 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80874) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:05:36.055639 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80874) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:05:36.055924 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80874) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:05:36.061383 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80873) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 17:05:36.061678 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80873) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:05:36.061982 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80873) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:05:36.068708 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80874) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 17:05:36.069004 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80874) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:05:36.069289 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80874) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:05:36.071072 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80873) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 17:05:36.071351 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80873) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:05:36.071632 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80873) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:05:36.071904 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80873) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:05:36.072173 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80873) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:05:36.072559 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80873) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:05:36.072834 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80873) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:05:36.073114 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80873) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:05:36.073397 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80873) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:05:36.073665 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80873) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:05:36.073959 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80873) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:05:36.074221 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80873) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:05:36.074493 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80873) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:05:36.074750 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80873) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:05:36.077310 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80874) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 17:05:36.077595 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80874) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:05:36.077907 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80874) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:05:36.078190 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80874) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:05:36.078468 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80874) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:05:36.078867 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80874) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:05:36.079150 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80874) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:05:36.079425 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80874) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:05:36.079715 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80874) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:05:36.079993 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80874) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:05:36.080270 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80874) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:05:36.080539 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80874) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:05:36.081329 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80874) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:05:36.081612 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80874) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:05:36.114087 dv-cinder-837356-2-smb devstack@keystone.service[80873]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x5623ad94a9c0 pid: 80873 (default app) Jun 16 17:05:36.117430 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbcfbf7-1e69-4d0d-94e8-ce2b7da8549c None None] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:05:36.117728 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbcfbf7-1e69-4d0d-94e8-ce2b7da8549c None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:05:36.118034 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbcfbf7-1e69-4d0d-94e8-ce2b7da8549c None None] PATH_INFO: `/v3` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:05:36.120467 dv-cinder-837356-2-smb devstack@keystone.service[80874]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x5623ad94a9c0 pid: 80874 (default app) Jun 16 17:05:36.122362 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1/1] 10.222.0.39 () {50 vars in 791 bytes} [Thu Jun 16 17:05:36 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:05:44.959563 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61121fc6-14c3-4c14-9489-07a396c41617 None None] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:05:44.960128 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61121fc6-14c3-4c14-9489-07a396c41617 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:05:44.960128 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61121fc6-14c3-4c14-9489-07a396c41617 None None] PATH_INFO: `/` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:05:44.964478 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1/2] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 17:05:44 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:05:44.969632 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7973e9b6-8674-47b2-80be-dc74e04224d8 None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:05:44.970044 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7973e9b6-8674-47b2-80be-dc74e04224d8 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:05:44.970235 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7973e9b6-8674-47b2-80be-dc74e04224d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:05:45.039771 dv-cinder-837356-2-smb devstack@keystone.service[80873]: INFO dbcounter [None req-7973e9b6-8674-47b2-80be-dc74e04224d8 None None] Registered counter for database keystone Jun 16 17:05:45.061126 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG oslo_db.sqlalchemy.engines [None req-7973e9b6-8674-47b2-80be-dc74e04224d8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80873) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 17:05:45.068020 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writer thread running {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 17:05:45.244584 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG passlib.handlers.bcrypt [None req-7973e9b6-8674-47b2-80be-dc74e04224d8 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80873) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 16 17:05:45.244937 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG passlib.handlers.bcrypt [None req-7973e9b6-8674-47b2-80be-dc74e04224d8 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80873) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 16 17:05:45.299111 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-7973e9b6-8674-47b2-80be-dc74e04224d8 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:05:45.300737 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-7973e9b6-8674-47b2-80be-dc74e04224d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:05:45.424373 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 2/3] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 17:05:44 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 456 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 16 17:05:45.598248 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61121fc6-14c3-4c14-9489-07a396c41617 None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:05:45.673886 dv-cinder-837356-2-smb devstack@keystone.service[80874]: INFO dbcounter [None req-61121fc6-14c3-4c14-9489-07a396c41617 None None] Registered counter for database keystone Jun 16 17:05:45.694050 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG oslo_db.sqlalchemy.engines [None req-61121fc6-14c3-4c14-9489-07a396c41617 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80874) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 17:05:45.700346 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writer thread running {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 17:05:45.823610 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61121fc6-14c3-4c14-9489-07a396c41617 None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:05:45.827946 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98447db1-611a-4f98-b5cc-f7d8307ce8bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:05:45.828656 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98447db1-611a-4f98-b5cc-f7d8307ce8bf admin admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:05:45.828943 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98447db1-611a-4f98-b5cc-f7d8307ce8bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:05:45.829223 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98447db1-611a-4f98-b5cc-f7d8307ce8bf admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:05:45.837641 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98447db1-611a-4f98-b5cc-f7d8307ce8bf admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:05:45.890578 dv-cinder-837356-2-smb devstack@keystone.service[80874]: WARNING keystone.common.rbac_enforcer.enforcer [None req-98447db1-611a-4f98-b5cc-f7d8307ce8bf admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 16 17:05:45.890929 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98447db1-611a-4f98-b5cc-f7d8307ce8bf admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:05:45.901252 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 2/4] 10.222.0.39 () {58 vars in 1324 bytes} [Thu Jun 16 17:05:45 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 17:05:45.907111 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7973e9b6-8674-47b2-80be-dc74e04224d8 None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:05:45.924739 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7973e9b6-8674-47b2-80be-dc74e04224d8 None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:05:45.929189 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7968f1d4-2cba-4342-ad07-1f65097d96d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:05:45.930472 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7968f1d4-2cba-4342-ad07-1f65097d96d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:05:45.930768 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7968f1d4-2cba-4342-ad07-1f65097d96d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:05:45.931053 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7968f1d4-2cba-4342-ad07-1f65097d96d6 admin admin] PATH_INFO: `/v3/projects/63375056d675488ab27a6e1a845c0237` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:05:45.932552 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7968f1d4-2cba-4342-ad07-1f65097d96d6 admin admin] RBAC: Authorizing `identity:get_project(project_id=63375056d675488ab27a6e1a845c0237)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:05:45.983993 dv-cinder-837356-2-smb devstack@keystone.service[80873]: WARNING keystone.common.rbac_enforcer.enforcer [None req-7968f1d4-2cba-4342-ad07-1f65097d96d6 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 16 17:05:45.984558 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7968f1d4-2cba-4342-ad07-1f65097d96d6 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:05:45.989928 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 3/5] 10.222.0.39 () {56 vars in 1207 bytes} [Thu Jun 16 17:05:45 2022] GET /identity/v3/projects/63375056d675488ab27a6e1a845c0237 => generated 344 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:05:48.125507 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b6af3f-c31a-4036-a1c8-3f5bc1dd60e9 None None] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:05:48.126084 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b6af3f-c31a-4036-a1c8-3f5bc1dd60e9 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:05:48.126226 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b6af3f-c31a-4036-a1c8-3f5bc1dd60e9 None None] PATH_INFO: `/` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:05:48.130894 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 3/6] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 17:05:48 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 17:05:48.136171 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a280604-4706-42a3-8222-1b1b3c04aa89 None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:05:48.136598 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a280604-4706-42a3-8222-1b1b3c04aa89 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:05:48.136742 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a280604-4706-42a3-8222-1b1b3c04aa89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:05:48.155760 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-5a280604-4706-42a3-8222-1b1b3c04aa89 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:05:48.157213 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-5a280604-4706-42a3-8222-1b1b3c04aa89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:05:48.165854 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 4/7] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 17:05:48 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jun 16 17:05:48.188558 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b6af3f-c31a-4036-a1c8-3f5bc1dd60e9 None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:05:48.201283 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b6af3f-c31a-4036-a1c8-3f5bc1dd60e9 None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:05:48.205622 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2f447b-b0ab-41ae-b6ca-f46191ca7844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:05:48.206290 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2f447b-b0ab-41ae-b6ca-f46191ca7844 admin admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:05:48.206583 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2f447b-b0ab-41ae-b6ca-f46191ca7844 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:05:48.206867 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2f447b-b0ab-41ae-b6ca-f46191ca7844 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:05:48.214623 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2f447b-b0ab-41ae-b6ca-f46191ca7844 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:05:48.216429 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2f447b-b0ab-41ae-b6ca-f46191ca7844 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:05:48.225119 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 4/8] 10.222.0.39 () {58 vars in 1324 bytes} [Thu Jun 16 17:05:48 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 17:05:48.230696 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a280604-4706-42a3-8222-1b1b3c04aa89 None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:05:48.240435 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a280604-4706-42a3-8222-1b1b3c04aa89 None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:05:48.244791 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9613d795-e28e-4266-8d29-577661f0ce88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:05:48.245659 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9613d795-e28e-4266-8d29-577661f0ce88 admin admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:05:48.246053 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9613d795-e28e-4266-8d29-577661f0ce88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:05:48.246340 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9613d795-e28e-4266-8d29-577661f0ce88 admin admin] PATH_INFO: `/v3/users/338529aa60c34c3887b1c9ec26ad60d8` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:05:48.247748 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9613d795-e28e-4266-8d29-577661f0ce88 admin admin] RBAC: Authorizing `identity:get_user(user_id=338529aa60c34c3887b1c9ec26ad60d8)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:05:48.249582 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9613d795-e28e-4266-8d29-577661f0ce88 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:05:48.251196 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 5/9] 10.222.0.39 () {56 vars in 1198 bytes} [Thu Jun 16 17:05:48 2022] GET /identity/v3/users/338529aa60c34c3887b1c9ec26ad60d8 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:05:50.462890 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ed2d63-3d0f-4873-9065-7681d13ceebb None None] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:05:50.463453 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ed2d63-3d0f-4873-9065-7681d13ceebb None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:05:50.463453 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ed2d63-3d0f-4873-9065-7681d13ceebb None None] PATH_INFO: `/` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:05:50.464808 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 5/10] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 17:05:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 17:05:50.470493 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089e2579-cee7-4579-83a2-18c59d409261 None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:05:50.471199 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089e2579-cee7-4579-83a2-18c59d409261 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:05:50.471199 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089e2579-cee7-4579-83a2-18c59d409261 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:05:50.488905 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-089e2579-cee7-4579-83a2-18c59d409261 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:05:50.490140 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-089e2579-cee7-4579-83a2-18c59d409261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:05:50.506152 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a006fa01-e8c5-46dc-a8c5-62b32b96d959 None None] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:05:50.506446 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a006fa01-e8c5-46dc-a8c5-62b32b96d959 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:05:50.506733 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a006fa01-e8c5-46dc-a8c5-62b32b96d959 None None] PATH_INFO: `/` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:05:50.508630 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 6/11] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 17:05:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 17:05:50.513602 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4880cb-ec28-4252-aa4e-586d0b70d385 None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:05:50.513928 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4880cb-ec28-4252-aa4e-586d0b70d385 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:05:50.514218 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4880cb-ec28-4252-aa4e-586d0b70d385 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:05:50.555216 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG passlib.handlers.bcrypt [None req-4f4880cb-ec28-4252-aa4e-586d0b70d385 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80874) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 16 17:05:50.555641 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG passlib.handlers.bcrypt [None req-4f4880cb-ec28-4252-aa4e-586d0b70d385 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80874) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 16 17:05:50.572568 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 6/12] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 17:05:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 17:05:50.596322 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089e2579-cee7-4579-83a2-18c59d409261 None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:05:50.601633 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-4f4880cb-ec28-4252-aa4e-586d0b70d385 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:05:50.603293 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-4f4880cb-ec28-4252-aa4e-586d0b70d385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:05:50.619619 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:05:50.718628 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 7/13] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 17:05:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 17:05:50.724688 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089e2579-cee7-4579-83a2-18c59d409261 None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:05:50.741988 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4880cb-ec28-4252-aa4e-586d0b70d385 None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:05:50.760353 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e333c8-74ce-467c-a4bf-cc52b4cb0fd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:05:50.761158 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e333c8-74ce-467c-a4bf-cc52b4cb0fd5 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:05:50.761446 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e333c8-74ce-467c-a4bf-cc52b4cb0fd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:05:50.761725 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e333c8-74ce-467c-a4bf-cc52b4cb0fd5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:05:50.773272 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e333c8-74ce-467c-a4bf-cc52b4cb0fd5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 17:05:50.784439 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application [None req-49e333c8-74ce-467c-a4bf-cc52b4cb0fd5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 17:05:50.784439 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:05:50.784439 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:05:50.784439 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:05:50.784439 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:05:50.784439 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:05:50.784439 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:05:50.784439 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:05:50.784439 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:05:50.784439 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:05:50.784439 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:05:50.784439 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:05:50.784439 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 17:05:50.784439 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 17:05:50.784439 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 17:05:50.784439 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 17:05:50.785577 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 17:05:50.785577 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 17:05:50.785577 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 17:05:50.785577 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 17:05:50.785577 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:05:50.785577 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:05:50.785577 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:05:50.785577 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:05:50.785577 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:05:50.785577 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:05:50.785577 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:05:50.785577 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application with Lock( Jun 16 17:05:50.785577 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:05:50.785577 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:05:50.785577 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:05:50.785577 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:05:50.786556 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:05:50.786556 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:05:50.786556 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:05:50.786556 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:05:50.786556 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 17:05:50.786556 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 17:05:50.786556 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 17:05:50.786556 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 17:05:50.786556 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 17:05:50.786556 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 17:05:50.786556 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 17:05:50.786556 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Jun 16 17:05:50.786556 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 7/14] 10.222.0.39 () {56 vars in 1096 bytes} [Thu Jun 16 17:05:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 17:05:50.791507 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e333c8-74ce-467c-a4bf-cc52b4cb0fd5 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:05:50.845220 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4880cb-ec28-4252-aa4e-586d0b70d385 None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:05:50.848101 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:05:50.875313 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:05:50.883445 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9990e859-b165-4e43-b813-b860bb249730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:05:50.884363 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9990e859-b165-4e43-b813-b860bb249730 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:05:50.884657 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9990e859-b165-4e43-b813-b860bb249730 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:05:50.884956 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9990e859-b165-4e43-b813-b860bb249730 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:05:50.896263 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e333c8-74ce-467c-a4bf-cc52b4cb0fd5 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:05:50.931223 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6906e2-a86c-45f6-8360-aecb730a178d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:05:50.931886 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6906e2-a86c-45f6-8360-aecb730a178d None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:05:50.932173 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6906e2-a86c-45f6-8360-aecb730a178d None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:05:50.932452 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6906e2-a86c-45f6-8360-aecb730a178d None admin] PATH_INFO: `/v3/roles` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:05:50.933231 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6906e2-a86c-45f6-8360-aecb730a178d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80873) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:05:50.933543 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6906e2-a86c-45f6-8360-aecb730a178d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:05:50.934972 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6906e2-a86c-45f6-8360-aecb730a178d None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:05:50.946908 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 8/15] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 16 17:05:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 17:05:50.952209 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6906e2-a86c-45f6-8360-aecb730a178d None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:05:50.955231 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9990e859-b165-4e43-b813-b860bb249730 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:05:50.957281 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9990e859-b165-4e43-b813-b860bb249730 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:05:51.053905 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6906e2-a86c-45f6-8360-aecb730a178d None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:05:51.061412 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 8/16] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 16 17:05:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 16 17:05:51.067134 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9990e859-b165-4e43-b813-b860bb249730 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:05:51.069797 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:05:51.088023 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf383502-0b99-487b-a912-0670abaf7096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:05:51.088904 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf383502-0b99-487b-a912-0670abaf7096 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:05:51.089271 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf383502-0b99-487b-a912-0670abaf7096 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:05:51.089479 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf383502-0b99-487b-a912-0670abaf7096 None admin] PATH_INFO: `/v3/users/338529aa60c34c3887b1c9ec26ad60d8` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:05:51.090729 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf383502-0b99-487b-a912-0670abaf7096 None admin] RBAC: Authorizing `identity:get_user(user_id=338529aa60c34c3887b1c9ec26ad60d8)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:05:51.092207 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf383502-0b99-487b-a912-0670abaf7096 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:05:51.093880 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 9/17] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jun 16 17:05:50 2022] GET /identity/v3/users/338529aa60c34c3887b1c9ec26ad60d8 => generated 247 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 17:05:51.099819 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf383502-0b99-487b-a912-0670abaf7096 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:05:51.114131 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:05:51.163847 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9990e859-b165-4e43-b813-b860bb249730 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:05:51.199803 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ca3daf-3916-40e7-b619-c758df0d750e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:05:51.200598 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ca3daf-3916-40e7-b619-c758df0d750e None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:05:51.200884 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ca3daf-3916-40e7-b619-c758df0d750e None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:05:51.201160 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ca3daf-3916-40e7-b619-c758df0d750e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:05:51.202072 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf383502-0b99-487b-a912-0670abaf7096 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:05:51.219079 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ca3daf-3916-40e7-b619-c758df0d750e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:05:51.220570 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ca3daf-3916-40e7-b619-c758df0d750e None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:05:51.235581 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c19e17e-9026-418d-9967-3b53ce8ce906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:05:51.236884 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c19e17e-9026-418d-9967-3b53ce8ce906 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:05:51.237174 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c19e17e-9026-418d-9967-3b53ce8ce906 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:05:51.237459 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c19e17e-9026-418d-9967-3b53ce8ce906 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:05:51.238685 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c19e17e-9026-418d-9967-3b53ce8ce906 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:05:51.240137 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c19e17e-9026-418d-9967-3b53ce8ce906 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:05:51.241606 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application [None req-41ca3daf-3916-40e7-b619-c758df0d750e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:05:51.241606 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:05:51.241606 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:05:51.241606 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:05:51.241606 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:05:51.241606 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:05:51.241606 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:05:51.241606 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:05:51.241606 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:05:51.241606 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:05:51.241606 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:05:51.241606 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:05:51.241606 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 17:05:51.241606 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 17:05:51.241606 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 17:05:51.242488 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 17:05:51.242488 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:05:51.242488 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:05:51.242488 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:05:51.242488 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:05:51.242488 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:05:51.242488 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:05:51.242488 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:05:51.242488 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application with Lock( Jun 16 17:05:51.242488 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:05:51.242488 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:05:51.242488 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:05:51.242488 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:05:51.242488 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:05:51.242488 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:05:51.242488 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:05:51.242488 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:05:51.243330 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 17:05:51.243330 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 17:05:51.243330 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:05:51.243330 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Jun 16 17:05:51.243542 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 10/18] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 17:05:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 17:05:51.243614 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 9/19] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 17:05:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 17:05:51.247423 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c19e17e-9026-418d-9967-3b53ce8ce906 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:05:51.248753 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ca3daf-3916-40e7-b619-c758df0d750e None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:05:51.306563 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:05:51.327920 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:05:51.347065 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c19e17e-9026-418d-9967-3b53ce8ce906 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:05:51.349592 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ca3daf-3916-40e7-b619-c758df0d750e None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:05:51.382162 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1514265-ef27-4c5f-9fb1-0713f8c3d4e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:05:51.382819 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1514265-ef27-4c5f-9fb1-0713f8c3d4e4 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:05:51.383110 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1514265-ef27-4c5f-9fb1-0713f8c3d4e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:05:51.383393 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1514265-ef27-4c5f-9fb1-0713f8c3d4e4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:05:51.383495 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70563c9-f761-416d-859d-0c622e296768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:05:51.384162 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70563c9-f761-416d-859d-0c622e296768 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:05:51.384249 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1514265-ef27-4c5f-9fb1-0713f8c3d4e4 None admin] RBAC: Adding query filter params (role.id=dba744f8ab2a4c45b9d3212f8d203aba, scope.domain.id=default, user.id=338529aa60c34c3887b1c9ec26ad60d8) {{(pid=80873) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:05:51.384451 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70563c9-f761-416d-859d-0c622e296768 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:05:51.384545 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1514265-ef27-4c5f-9fb1-0713f8c3d4e4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:05:51.384732 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70563c9-f761-416d-859d-0c622e296768 None admin] PATH_INFO: `/v3/domains` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:05:51.385460 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70563c9-f761-416d-859d-0c622e296768 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:05:51.385783 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70563c9-f761-416d-859d-0c622e296768 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:05:51.385981 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1514265-ef27-4c5f-9fb1-0713f8c3d4e4 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:05:51.387178 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70563c9-f761-416d-859d-0c622e296768 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:05:51.392864 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 11/20] 10.222.0.39 () {56 vars in 1322 bytes} [Thu Jun 16 17:05:51 2022] GET /identity/v3/role_assignments?user.id=338529aa60c34c3887b1c9ec26ad60d8&scope.domain.id=default&role.id=dba744f8ab2a4c45b9d3212f8d203aba => generated 233 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:05:51.405107 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 10/21] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 16 17:05:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 17:05:53.712438 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83f02d3-e640-49ff-acce-8c36d5eb5929 None None] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:05:53.713344 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83f02d3-e640-49ff-acce-8c36d5eb5929 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:05:53.713792 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83f02d3-e640-49ff-acce-8c36d5eb5929 None None] PATH_INFO: `/` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:05:53.715339 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 12/22] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 17:05:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:05:53.721261 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae913ca-df48-4e67-acf2-cbb5a2f45863 None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:05:53.722067 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae913ca-df48-4e67-acf2-cbb5a2f45863 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:05:53.722562 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae913ca-df48-4e67-acf2-cbb5a2f45863 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:05:53.750789 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-dae913ca-df48-4e67-acf2-cbb5a2f45863 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:05:53.752865 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-dae913ca-df48-4e67-acf2-cbb5a2f45863 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:05:53.854536 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 11/23] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 17:05:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 17:05:53.899081 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83f02d3-e640-49ff-acce-8c36d5eb5929 None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:05:54.019551 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83f02d3-e640-49ff-acce-8c36d5eb5929 None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:05:54.065481 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6f193f-fdf5-4e01-a78e-54aec6267762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:05:54.066331 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6f193f-fdf5-4e01-a78e-54aec6267762 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:05:54.066620 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6f193f-fdf5-4e01-a78e-54aec6267762 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:05:54.066898 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6f193f-fdf5-4e01-a78e-54aec6267762 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:05:54.081290 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6f193f-fdf5-4e01-a78e-54aec6267762 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 17:05:54.089067 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application [None req-9b6f193f-fdf5-4e01-a78e-54aec6267762 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 17:05:54.089067 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:05:54.089067 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:05:54.089067 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:05:54.089067 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:05:54.089067 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:05:54.089067 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:05:54.089067 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:05:54.089067 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:05:54.089067 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:05:54.089067 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:05:54.089067 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:05:54.089067 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 17:05:54.089067 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 17:05:54.089067 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 17:05:54.089067 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 17:05:54.090169 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 17:05:54.090169 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 17:05:54.090169 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 17:05:54.090169 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 17:05:54.090169 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:05:54.090169 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:05:54.090169 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:05:54.090169 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:05:54.090169 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:05:54.090169 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:05:54.090169 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:05:54.090169 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application with Lock( Jun 16 17:05:54.090169 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:05:54.090169 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:05:54.090169 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:05:54.090169 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:05:54.090978 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:05:54.090978 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:05:54.090978 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:05:54.090978 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:05:54.090978 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 17:05:54.090978 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 17:05:54.090978 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 17:05:54.090978 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 17:05:54.090978 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 17:05:54.090978 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 17:05:54.090978 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 17:05:54.090978 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Jun 16 17:05:54.090978 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 13/24] 10.222.0.39 () {56 vars in 1096 bytes} [Thu Jun 16 17:05:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:05:54.097044 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae913ca-df48-4e67-acf2-cbb5a2f45863 None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:05:54.159280 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:05:54.222273 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae913ca-df48-4e67-acf2-cbb5a2f45863 None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:05:54.256520 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fdb948-7495-40f4-ac96-a375061e6a72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:05:54.257195 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fdb948-7495-40f4-ac96-a375061e6a72 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:05:54.257481 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fdb948-7495-40f4-ac96-a375061e6a72 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:05:54.257787 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fdb948-7495-40f4-ac96-a375061e6a72 None admin] PATH_INFO: `/v3/roles` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:05:54.258544 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fdb948-7495-40f4-ac96-a375061e6a72 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:05:54.258852 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fdb948-7495-40f4-ac96-a375061e6a72 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:05:54.260245 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fdb948-7495-40f4-ac96-a375061e6a72 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:05:54.277278 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 12/25] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 16 17:05:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:05:54.283129 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6f193f-fdf5-4e01-a78e-54aec6267762 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:05:54.288253 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:05:54.418493 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6f193f-fdf5-4e01-a78e-54aec6267762 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:05:54.460777 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a050741-71b0-40d0-bf07-e7fa1f078b34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:05:54.461659 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a050741-71b0-40d0-bf07-e7fa1f078b34 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:05:54.461977 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a050741-71b0-40d0-bf07-e7fa1f078b34 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:05:54.462259 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a050741-71b0-40d0-bf07-e7fa1f078b34 None admin] PATH_INFO: `/v3/users/338529aa60c34c3887b1c9ec26ad60d8` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:05:54.463477 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a050741-71b0-40d0-bf07-e7fa1f078b34 None admin] RBAC: Authorizing `identity:get_user(user_id=338529aa60c34c3887b1c9ec26ad60d8)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:05:54.464935 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a050741-71b0-40d0-bf07-e7fa1f078b34 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:05:54.466589 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 14/26] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jun 16 17:05:54 2022] GET /identity/v3/users/338529aa60c34c3887b1c9ec26ad60d8 => generated 247 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:05:54.472891 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fdb948-7495-40f4-ac96-a375061e6a72 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:05:54.598319 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fdb948-7495-40f4-ac96-a375061e6a72 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:05:54.609545 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:05:54.634552 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2d01d8-f366-413d-8f61-38ba5bfcfc10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:05:54.635353 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2d01d8-f366-413d-8f61-38ba5bfcfc10 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:05:54.635642 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2d01d8-f366-413d-8f61-38ba5bfcfc10 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:05:54.635985 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2d01d8-f366-413d-8f61-38ba5bfcfc10 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:05:54.637439 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2d01d8-f366-413d-8f61-38ba5bfcfc10 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:05:54.638981 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2d01d8-f366-413d-8f61-38ba5bfcfc10 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:05:54.640609 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 13/27] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 17:05:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 17:05:54.646935 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a050741-71b0-40d0-bf07-e7fa1f078b34 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:05:54.669413 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fe768e-d69b-4a7e-9a39-bfb56e469615 None None] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:05:54.669729 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fe768e-d69b-4a7e-9a39-bfb56e469615 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:05:54.670018 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fe768e-d69b-4a7e-9a39-bfb56e469615 None None] PATH_INFO: `/` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:05:54.671622 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 14/28] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 17:05:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:05:54.686549 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd329590-4078-4e30-bfd0-13579fe4ec9f None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:05:54.686842 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd329590-4078-4e30-bfd0-13579fe4ec9f None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:05:54.687116 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd329590-4078-4e30-bfd0-13579fe4ec9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:05:54.714227 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-cd329590-4078-4e30-bfd0-13579fe4ec9f None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:05:54.715496 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-cd329590-4078-4e30-bfd0-13579fe4ec9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:05:54.758979 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:05:54.791510 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 15/29] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 17:05:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 17:05:54.793380 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5791a8-0ba3-4068-a0bc-3dfc4c3ca602 None None] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:05:54.793863 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5791a8-0ba3-4068-a0bc-3dfc4c3ca602 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:05:54.794279 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5791a8-0ba3-4068-a0bc-3dfc4c3ca602 None None] PATH_INFO: `/` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:05:54.796011 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 16/30] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 17:05:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:05:54.798184 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a050741-71b0-40d0-bf07-e7fa1f078b34 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:05:54.803658 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a650d8-8768-4581-994d-fb04d6190d1c None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:05:54.804246 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a650d8-8768-4581-994d-fb04d6190d1c None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:05:54.804738 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a650d8-8768-4581-994d-fb04d6190d1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:05:54.833363 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-23a650d8-8768-4581-994d-fb04d6190d1c None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:05:54.834698 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-23a650d8-8768-4581-994d-fb04d6190d1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:05:54.871014 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cc4328-dea7-4fd2-a417-d71101a5bee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:05:54.871905 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cc4328-dea7-4fd2-a417-d71101a5bee9 None admin] REQUEST_METHOD: `PUT` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:05:54.872189 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cc4328-dea7-4fd2-a417-d71101a5bee9 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:05:54.872488 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cc4328-dea7-4fd2-a417-d71101a5bee9 None admin] PATH_INFO: `/v3/domains/default/users/338529aa60c34c3887b1c9ec26ad60d8/roles/dba744f8ab2a4c45b9d3212f8d203aba` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:05:54.874572 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cc4328-dea7-4fd2-a417-d71101a5bee9 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=338529aa60c34c3887b1c9ec26ad60d8, role_id=dba744f8ab2a4c45b9d3212f8d203aba)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:05:54.876020 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cc4328-dea7-4fd2-a417-d71101a5bee9 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:05:54.920264 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 17/31] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 17:05:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 17:05:54.921666 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a650d8-8768-4581-994d-fb04d6190d1c None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:05:54.960076 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:05:55.031857 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a650d8-8768-4581-994d-fb04d6190d1c None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:05:55.068417 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d3a9c9-d8f3-41ae-ae86-93e89bd5f06d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:05:55.069457 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d3a9c9-d8f3-41ae-ae86-93e89bd5f06d None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:05:55.069921 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d3a9c9-d8f3-41ae-ae86-93e89bd5f06d None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:05:55.070366 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d3a9c9-d8f3-41ae-ae86-93e89bd5f06d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:05:55.081835 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d3a9c9-d8f3-41ae-ae86-93e89bd5f06d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:05:55.083518 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d3a9c9-d8f3-41ae-ae86-93e89bd5f06d None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:05:55.104634 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application [None req-19d3a9c9-d8f3-41ae-ae86-93e89bd5f06d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:05:55.104634 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:05:55.104634 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:05:55.104634 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:05:55.104634 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:05:55.104634 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:05:55.104634 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:05:55.104634 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:05:55.104634 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:05:55.104634 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:05:55.104634 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:05:55.104634 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:05:55.104634 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 17:05:55.104634 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 17:05:55.104634 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 17:05:55.105733 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 17:05:55.105733 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:05:55.105733 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:05:55.105733 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:05:55.105733 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:05:55.105733 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:05:55.105733 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:05:55.105733 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:05:55.105733 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application with Lock( Jun 16 17:05:55.105733 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:05:55.105733 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:05:55.105733 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:05:55.105733 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:05:55.105733 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:05:55.105733 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:05:55.105733 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:05:55.105733 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:05:55.106785 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 17:05:55.106785 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 17:05:55.106785 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:05:55.106785 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Jun 16 17:05:55.108421 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 18/32] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 17:05:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:05:55.110181 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7bb26f-3330-49b9-90be-ea0ab8ca57fe None None] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:05:55.110682 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7bb26f-3330-49b9-90be-ea0ab8ca57fe None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:05:55.111703 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7bb26f-3330-49b9-90be-ea0ab8ca57fe None None] PATH_INFO: `/` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:05:55.113568 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 19/33] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 17:05:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:05:55.114693 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7bb26f-3330-49b9-90be-ea0ab8ca57fe None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:05:55.222030 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 15/34] 10.222.0.39 () {58 vars in 1361 bytes} [Thu Jun 16 17:05:54 2022] PUT /identity/v3/domains/default/users/338529aa60c34c3887b1c9ec26ad60d8/roles/dba744f8ab2a4c45b9d3212f8d203aba => generated 0 bytes in 568 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:05:55.222771 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:05:55.224939 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cc4328-dea7-4fd2-a417-d71101a5bee9 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:05:55.233964 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7bb26f-3330-49b9-90be-ea0ab8ca57fe None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:05:55.278734 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd237c2-8868-4e1f-95c5-f94037708eb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:05:55.279840 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd237c2-8868-4e1f-95c5-f94037708eb7 None admin] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:05:55.280387 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd237c2-8868-4e1f-95c5-f94037708eb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:05:55.280879 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd237c2-8868-4e1f-95c5-f94037708eb7 None admin] PATH_INFO: `/v3/roles` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:05:55.282069 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd237c2-8868-4e1f-95c5-f94037708eb7 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:05:55.284437 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd237c2-8868-4e1f-95c5-f94037708eb7 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:05:55.385018 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cc4328-dea7-4fd2-a417-d71101a5bee9 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:05:55.422840 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:05:55.428417 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486bce37-421f-4535-9a69-8d18172be6a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:05:55.429111 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486bce37-421f-4535-9a69-8d18172be6a2 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:05:55.429406 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486bce37-421f-4535-9a69-8d18172be6a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:05:55.429700 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486bce37-421f-4535-9a69-8d18172be6a2 None admin] PATH_INFO: `/v3/domains` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:05:55.430494 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486bce37-421f-4535-9a69-8d18172be6a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80873) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:05:55.430811 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486bce37-421f-4535-9a69-8d18172be6a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:05:55.432427 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486bce37-421f-4535-9a69-8d18172be6a2 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:05:55.456095 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 16/35] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 16 17:05:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:05:55.457615 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69f8cd1-9e21-489f-a868-7aba4c3bd092 None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:05:55.457946 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69f8cd1-9e21-489f-a868-7aba4c3bd092 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:05:55.458235 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69f8cd1-9e21-489f-a868-7aba4c3bd092 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:05:55.476664 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-b69f8cd1-9e21-489f-a868-7aba4c3bd092 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:05:55.478179 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-b69f8cd1-9e21-489f-a868-7aba4c3bd092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:05:55.556702 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 17/36] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 17:05:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 17:05:55.558147 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d752aab-400f-4f52-96cd-17008f337244 None None] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:05:55.558446 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d752aab-400f-4f52-96cd-17008f337244 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:05:55.558733 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d752aab-400f-4f52-96cd-17008f337244 None None] PATH_INFO: `/` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:05:55.560110 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 18/37] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 17:05:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:05:55.573834 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d752aab-400f-4f52-96cd-17008f337244 None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:05:55.592631 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 20/38] 10.222.0.39 () {60 vars in 1131 bytes} [Thu Jun 16 17:05:55 2022] POST /identity/v3/roles => generated 219 bytes in 478 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:05:55.594362 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ce0d17-e5a1-4790-b9f0-e833f8bdc2b2 None None] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:05:55.594668 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ce0d17-e5a1-4790-b9f0-e833f8bdc2b2 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:05:55.594961 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ce0d17-e5a1-4790-b9f0-e833f8bdc2b2 None None] PATH_INFO: `/` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:05:55.596300 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 21/39] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 17:05:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:05:55.597617 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06b736f-9fc3-4a8d-8f77-1eab7eed888c None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:05:55.597958 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06b736f-9fc3-4a8d-8f77-1eab7eed888c None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:05:55.598253 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06b736f-9fc3-4a8d-8f77-1eab7eed888c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:05:55.617439 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-e06b736f-9fc3-4a8d-8f77-1eab7eed888c None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:05:55.619113 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-e06b736f-9fc3-4a8d-8f77-1eab7eed888c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:05:55.699485 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 22/40] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 17:05:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 17:05:55.700445 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06b736f-9fc3-4a8d-8f77-1eab7eed888c None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:05:55.714587 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d752aab-400f-4f52-96cd-17008f337244 None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:05:55.755045 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:05:55.770088 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9ecc60-19fc-4877-8acf-9838d36d50b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:05:55.770831 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9ecc60-19fc-4877-8acf-9838d36d50b9 None admin] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:05:55.771061 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9ecc60-19fc-4877-8acf-9838d36d50b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:05:55.771401 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9ecc60-19fc-4877-8acf-9838d36d50b9 None admin] PATH_INFO: `/v3/projects` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:05:55.772148 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9ecc60-19fc-4877-8acf-9838d36d50b9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:05:55.773739 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9ecc60-19fc-4877-8acf-9838d36d50b9 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:05:55.803922 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:05:55.827759 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06b736f-9fc3-4a8d-8f77-1eab7eed888c None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:05:55.865607 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd456cf-d714-4509-a4c8-9ae2abc87c43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:05:55.866334 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd456cf-d714-4509-a4c8-9ae2abc87c43 None admin] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:05:55.866629 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd456cf-d714-4509-a4c8-9ae2abc87c43 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:05:55.866920 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd456cf-d714-4509-a4c8-9ae2abc87c43 None admin] PATH_INFO: `/v3/roles` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:05:55.867684 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd456cf-d714-4509-a4c8-9ae2abc87c43 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:05:55.869219 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd456cf-d714-4509-a4c8-9ae2abc87c43 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:05:55.922720 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 19/41] 10.222.0.39 () {60 vars in 1141 bytes} [Thu Jun 16 17:05:55 2022] POST /identity/v3/projects => generated 301 bytes in 362 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:05:55.924313 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dea2b8-b869-4d63-ab65-5e5a72677d29 None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:05:55.924615 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dea2b8-b869-4d63-ab65-5e5a72677d29 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:05:55.924963 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dea2b8-b869-4d63-ab65-5e5a72677d29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:05:55.947674 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-f4dea2b8-b869-4d63-ab65-5e5a72677d29 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:05:55.949025 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-f4dea2b8-b869-4d63-ab65-5e5a72677d29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:05:56.029887 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 23/42] 10.222.0.39 () {60 vars in 1131 bytes} [Thu Jun 16 17:05:55 2022] POST /identity/v3/roles => generated 225 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:05:56.029887 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd456cf-d714-4509-a4c8-9ae2abc87c43 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:05:56.057903 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 20/43] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 17:05:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 17:05:56.093747 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dea2b8-b869-4d63-ab65-5e5a72677d29 None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:05:56.196848 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd456cf-d714-4509-a4c8-9ae2abc87c43 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:05:56.239809 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dea2b8-b869-4d63-ab65-5e5a72677d29 None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:05:56.244071 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:05:56.244296 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c923f7b-0037-48d5-b60c-e943d1da9082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:05:56.244989 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c923f7b-0037-48d5-b60c-e943d1da9082 None admin] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:05:56.245281 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c923f7b-0037-48d5-b60c-e943d1da9082 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:05:56.245565 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c923f7b-0037-48d5-b60c-e943d1da9082 None admin] PATH_INFO: `/v3/roles` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:05:56.246369 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c923f7b-0037-48d5-b60c-e943d1da9082 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:05:56.247797 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c923f7b-0037-48d5-b60c-e943d1da9082 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:05:56.279528 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33b9ff2-2ce5-4471-a771-36e2a4801e31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:05:56.280444 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33b9ff2-2ce5-4471-a771-36e2a4801e31 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:05:56.281089 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33b9ff2-2ce5-4471-a771-36e2a4801e31 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:05:56.281687 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33b9ff2-2ce5-4471-a771-36e2a4801e31 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:05:56.283930 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33b9ff2-2ce5-4471-a771-36e2a4801e31 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:05:56.285661 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33b9ff2-2ce5-4471-a771-36e2a4801e31 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:05:56.287387 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 21/44] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 17:05:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 17:05:56.292941 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33b9ff2-2ce5-4471-a771-36e2a4801e31 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:05:56.310414 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:05:56.316650 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 24/45] 10.222.0.39 () {60 vars in 1131 bytes} [Thu Jun 16 17:05:56 2022] POST /identity/v3/roles => generated 223 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:05:56.409169 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33b9ff2-2ce5-4471-a771-36e2a4801e31 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:05:56.448732 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5573f2e-7ae6-455b-9797-b9a875e14155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:05:56.449421 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5573f2e-7ae6-455b-9797-b9a875e14155 None admin] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:05:56.449714 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5573f2e-7ae6-455b-9797-b9a875e14155 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:05:56.450031 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5573f2e-7ae6-455b-9797-b9a875e14155 None admin] PATH_INFO: `/v3/projects` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:05:56.450793 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5573f2e-7ae6-455b-9797-b9a875e14155 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:05:56.452256 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5573f2e-7ae6-455b-9797-b9a875e14155 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:05:56.571893 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 22/46] 10.222.0.39 () {60 vars in 1141 bytes} [Thu Jun 16 17:05:56 2022] POST /identity/v3/projects => generated 312 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 17:05:57.549609 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb6bf2f-f0d2-40b7-9fe4-1c52f985701d None None] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:05:57.550226 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb6bf2f-f0d2-40b7-9fe4-1c52f985701d None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:05:57.550226 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb6bf2f-f0d2-40b7-9fe4-1c52f985701d None None] PATH_INFO: `/` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:05:57.551610 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 25/47] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 17:05:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:05:57.556884 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8078cb67-522e-42c8-92b2-e11371dfb3e8 None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:05:57.557298 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8078cb67-522e-42c8-92b2-e11371dfb3e8 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:05:57.557455 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8078cb67-522e-42c8-92b2-e11371dfb3e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:05:57.573862 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-8078cb67-522e-42c8-92b2-e11371dfb3e8 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:05:57.575050 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-8078cb67-522e-42c8-92b2-e11371dfb3e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:05:57.592157 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:05:57.641339 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 23/48] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 17:05:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 17:05:57.664270 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb6bf2f-f0d2-40b7-9fe4-1c52f985701d None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:05:57.769612 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb6bf2f-f0d2-40b7-9fe4-1c52f985701d None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:05:57.804802 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b26564-54bb-461d-ae42-323d9ff094b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:05:57.805517 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b26564-54bb-461d-ae42-323d9ff094b0 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:05:57.805840 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b26564-54bb-461d-ae42-323d9ff094b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:05:57.806126 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b26564-54bb-461d-ae42-323d9ff094b0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:05:57.818177 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b26564-54bb-461d-ae42-323d9ff094b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 17:05:57.826785 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application [None req-d9b26564-54bb-461d-ae42-323d9ff094b0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 17:05:57.826785 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:05:57.826785 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:05:57.826785 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:05:57.826785 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:05:57.826785 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:05:57.826785 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:05:57.826785 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:05:57.826785 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:05:57.826785 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:05:57.826785 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:05:57.826785 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:05:57.826785 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 17:05:57.826785 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 17:05:57.826785 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 17:05:57.826785 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 17:05:57.827805 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 17:05:57.827805 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 17:05:57.827805 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 17:05:57.827805 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 17:05:57.827805 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:05:57.827805 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:05:57.827805 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:05:57.827805 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:05:57.827805 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:05:57.827805 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:05:57.827805 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:05:57.827805 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application with Lock( Jun 16 17:05:57.827805 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:05:57.827805 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:05:57.827805 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:05:57.827805 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:05:57.828790 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:05:57.828790 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:05:57.828790 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:05:57.828790 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:05:57.828790 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 17:05:57.828790 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 17:05:57.828790 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 17:05:57.828790 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 17:05:57.828790 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 17:05:57.828790 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 17:05:57.828790 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 17:05:57.828790 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Jun 16 17:05:57.828790 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 26/49] 10.222.0.39 () {56 vars in 1096 bytes} [Thu Jun 16 17:05:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:05:57.835491 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8078cb67-522e-42c8-92b2-e11371dfb3e8 None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:05:57.935071 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8078cb67-522e-42c8-92b2-e11371dfb3e8 None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:05:57.968754 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14ea97a-3ca0-41df-88d7-a5ba3f79ad25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:05:57.969427 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14ea97a-3ca0-41df-88d7-a5ba3f79ad25 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:05:57.969729 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14ea97a-3ca0-41df-88d7-a5ba3f79ad25 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:05:57.970048 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14ea97a-3ca0-41df-88d7-a5ba3f79ad25 None admin] PATH_INFO: `/v3/roles` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:05:57.970934 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14ea97a-3ca0-41df-88d7-a5ba3f79ad25 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80873) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:05:57.971249 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14ea97a-3ca0-41df-88d7-a5ba3f79ad25 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:05:57.972632 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14ea97a-3ca0-41df-88d7-a5ba3f79ad25 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:05:57.981128 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 24/50] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 16 17:05:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:05:57.987258 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b26564-54bb-461d-ae42-323d9ff094b0 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:05:58.044088 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:05:58.086699 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b26564-54bb-461d-ae42-323d9ff094b0 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:05:58.120162 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494c707b-9155-49df-97f3-fac3af51b972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:05:58.121045 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494c707b-9155-49df-97f3-fac3af51b972 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:05:58.121335 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494c707b-9155-49df-97f3-fac3af51b972 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:05:58.121616 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494c707b-9155-49df-97f3-fac3af51b972 None admin] PATH_INFO: `/v3/users/338529aa60c34c3887b1c9ec26ad60d8` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:05:58.123108 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494c707b-9155-49df-97f3-fac3af51b972 None admin] RBAC: Authorizing `identity:get_user(user_id=338529aa60c34c3887b1c9ec26ad60d8)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:05:58.124580 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494c707b-9155-49df-97f3-fac3af51b972 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:05:58.126275 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 27/51] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jun 16 17:05:57 2022] GET /identity/v3/users/338529aa60c34c3887b1c9ec26ad60d8 => generated 247 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:05:58.132196 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14ea97a-3ca0-41df-88d7-a5ba3f79ad25 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:05:58.151921 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:05:58.234784 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14ea97a-3ca0-41df-88d7-a5ba3f79ad25 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:05:58.268368 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f876c5-cfe9-4b9b-b051-ed2319120175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:05:58.269163 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f876c5-cfe9-4b9b-b051-ed2319120175 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:05:58.269458 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f876c5-cfe9-4b9b-b051-ed2319120175 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:05:58.269746 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f876c5-cfe9-4b9b-b051-ed2319120175 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:05:58.270976 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f876c5-cfe9-4b9b-b051-ed2319120175 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:05:58.272427 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f876c5-cfe9-4b9b-b051-ed2319120175 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:05:58.274105 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 25/52] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 17:05:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:05:58.279849 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494c707b-9155-49df-97f3-fac3af51b972 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:05:58.382045 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494c707b-9155-49df-97f3-fac3af51b972 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:05:58.408079 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:05:58.416556 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899c41c9-d355-46b4-a3fe-8e47c5bde73c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:05:58.417224 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899c41c9-d355-46b4-a3fe-8e47c5bde73c None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:05:58.417515 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899c41c9-d355-46b4-a3fe-8e47c5bde73c None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:05:58.417818 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899c41c9-d355-46b4-a3fe-8e47c5bde73c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:05:58.418662 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899c41c9-d355-46b4-a3fe-8e47c5bde73c None admin] RBAC: Adding query filter params (role.id=dba744f8ab2a4c45b9d3212f8d203aba, scope.domain.id=default, user.id=338529aa60c34c3887b1c9ec26ad60d8) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:05:58.418982 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899c41c9-d355-46b4-a3fe-8e47c5bde73c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:05:58.420425 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899c41c9-d355-46b4-a3fe-8e47c5bde73c None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:05:58.429552 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 28/53] 10.222.0.39 () {56 vars in 1322 bytes} [Thu Jun 16 17:05:58 2022] GET /identity/v3/role_assignments?user.id=338529aa60c34c3887b1c9ec26ad60d8&scope.domain.id=default&role.id=dba744f8ab2a4c45b9d3212f8d203aba => generated 530 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:05:58.743471 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0ffb09-41ed-4e82-821a-049a47612c97 None None] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:05:58.743958 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0ffb09-41ed-4e82-821a-049a47612c97 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:05:58.743958 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0ffb09-41ed-4e82-821a-049a47612c97 None None] PATH_INFO: `/` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:05:58.745350 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 26/54] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 17:05:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:05:58.750663 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e14c962-026a-42fc-974c-2a4dd54148a5 None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:05:58.751052 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e14c962-026a-42fc-974c-2a4dd54148a5 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:05:58.751258 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e14c962-026a-42fc-974c-2a4dd54148a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:05:58.768209 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-6e14c962-026a-42fc-974c-2a4dd54148a5 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:05:58.769417 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-6e14c962-026a-42fc-974c-2a4dd54148a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:05:58.835181 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 29/55] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 17:05:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 17:05:58.858872 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0ffb09-41ed-4e82-821a-049a47612c97 None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:05:58.944899 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:05:58.961792 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0ffb09-41ed-4e82-821a-049a47612c97 None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:05:58.997267 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8c1164-5ca3-44d6-abd4-a00db684e68d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:05:58.998019 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8c1164-5ca3-44d6-abd4-a00db684e68d None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:05:58.998314 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8c1164-5ca3-44d6-abd4-a00db684e68d None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:05:58.998606 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8c1164-5ca3-44d6-abd4-a00db684e68d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:05:58.999786 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8c1164-5ca3-44d6-abd4-a00db684e68d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:05:59.001224 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8c1164-5ca3-44d6-abd4-a00db684e68d None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:05:59.003427 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 27/56] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 17:05:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:05:59.009177 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e14c962-026a-42fc-974c-2a4dd54148a5 None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:05:59.106256 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e14c962-026a-42fc-974c-2a4dd54148a5 None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:05:59.125285 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:05:59.139106 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084c12d2-06b9-4b25-b784-561ff1b07777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:05:59.139763 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084c12d2-06b9-4b25-b784-561ff1b07777 None admin] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:05:59.140051 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084c12d2-06b9-4b25-b784-561ff1b07777 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:05:59.140333 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084c12d2-06b9-4b25-b784-561ff1b07777 None admin] PATH_INFO: `/v3/projects` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:05:59.141058 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084c12d2-06b9-4b25-b784-561ff1b07777 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:05:59.143191 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084c12d2-06b9-4b25-b784-561ff1b07777 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:05:59.239740 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 30/57] 10.222.0.39 () {60 vars in 1140 bytes} [Thu Jun 16 17:05:59 2022] POST /identity/v3/projects => generated 298 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:06:01.402863 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96325db5-4c50-438c-87ec-660d327fd099 None None] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:01.403367 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96325db5-4c50-438c-87ec-660d327fd099 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:01.403449 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96325db5-4c50-438c-87ec-660d327fd099 None None] PATH_INFO: `/` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:01.404832 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 28/58] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 17:06:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:06:01.410552 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29003234-9210-447c-9622-c21e2b047add None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:01.410969 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29003234-9210-447c-9622-c21e2b047add None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:01.411125 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29003234-9210-447c-9622-c21e2b047add None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:01.428195 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-29003234-9210-447c-9622-c21e2b047add None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:06:01.429378 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-29003234-9210-447c-9622-c21e2b047add None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:06:01.494606 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 31/59] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 17:06:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 17:06:01.519972 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96325db5-4c50-438c-87ec-660d327fd099 None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:01.619086 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96325db5-4c50-438c-87ec-660d327fd099 None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:01.651784 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b5a46f-ca9a-4be4-9842-f1eda486ef81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:01.652566 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b5a46f-ca9a-4be4-9842-f1eda486ef81 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:01.652853 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b5a46f-ca9a-4be4-9842-f1eda486ef81 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:01.653183 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b5a46f-ca9a-4be4-9842-f1eda486ef81 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:01.654327 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b5a46f-ca9a-4be4-9842-f1eda486ef81 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:01.655757 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b5a46f-ca9a-4be4-9842-f1eda486ef81 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:01.657376 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 29/60] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 17:06:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:06:01.662874 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29003234-9210-447c-9622-c21e2b047add None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:01.758942 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29003234-9210-447c-9622-c21e2b047add None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:01.760450 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:01.791535 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46455a57-d650-4a91-9feb-30b5d065389b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:01.792204 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46455a57-d650-4a91-9feb-30b5d065389b None admin] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:01.792498 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46455a57-d650-4a91-9feb-30b5d065389b None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:01.792784 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46455a57-d650-4a91-9feb-30b5d065389b None admin] PATH_INFO: `/v3/users` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:01.793518 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46455a57-d650-4a91-9feb-30b5d065389b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:01.795087 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46455a57-d650-4a91-9feb-30b5d065389b None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:01.895802 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 32/61] 10.222.0.39 () {60 vars in 1132 bytes} [Thu Jun 16 17:06:01 2022] POST /identity/v3/users => generated 275 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:06:05.167852 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ff7f56-f7d1-4c8c-97cb-029d31f39822 None None] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:05.168840 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ff7f56-f7d1-4c8c-97cb-029d31f39822 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:05.169347 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ff7f56-f7d1-4c8c-97cb-029d31f39822 None None] PATH_INFO: `/` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:05.171246 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 30/62] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 17:06:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:06:05.177743 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb5dc5e-d1bf-4989-8181-333e3c363aee None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:05.178659 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb5dc5e-d1bf-4989-8181-333e3c363aee None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:05.179148 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb5dc5e-d1bf-4989-8181-333e3c363aee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:05.206837 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-5eb5dc5e-d1bf-4989-8181-333e3c363aee None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:06:05.208403 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-5eb5dc5e-d1bf-4989-8181-333e3c363aee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:06:05.307529 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 33/63] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 17:06:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 17:06:05.340894 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ff7f56-f7d1-4c8c-97cb-029d31f39822 None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:05.373322 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:05.392271 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fa8c1c-2532-4aeb-a96c-4caff460c466 None None] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:05.393045 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fa8c1c-2532-4aeb-a96c-4caff460c466 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:05.394388 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fa8c1c-2532-4aeb-a96c-4caff460c466 None None] PATH_INFO: `/` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:05.396230 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 34/64] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 17:06:05 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 17:06:05.402677 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c874e29-6492-40f9-8d7f-d5de7e22a88a None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:05.403374 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c874e29-6492-40f9-8d7f-d5de7e22a88a None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:05.403947 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c874e29-6492-40f9-8d7f-d5de7e22a88a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:05.440194 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-9c874e29-6492-40f9-8d7f-d5de7e22a88a None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:06:05.441355 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-9c874e29-6492-40f9-8d7f-d5de7e22a88a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:06:05.508995 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ff7f56-f7d1-4c8c-97cb-029d31f39822 None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:05.548074 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 35/65] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 17:06:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 17:06:05.548913 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bb7150-668e-4388-9cd9-cbabf6f9f3cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:05.549825 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bb7150-668e-4388-9cd9-cbabf6f9f3cd None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:05.550125 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bb7150-668e-4388-9cd9-cbabf6f9f3cd None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:05.550413 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bb7150-668e-4388-9cd9-cbabf6f9f3cd None admin] PATH_INFO: `/v3/roles/member` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:05.550763 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eb5430-5cb6-466d-ae7c-b93123112fc1 None None] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:05.551227 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eb5430-5cb6-466d-ae7c-b93123112fc1 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:05.551682 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eb5430-5cb6-466d-ae7c-b93123112fc1 None None] PATH_INFO: `/` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:05.553172 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 36/66] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 17:06:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:06:05.558588 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4026e6c-21be-499f-b6ec-4ea042d9661e None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:05.558882 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4026e6c-21be-499f-b6ec-4ea042d9661e None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:05.559166 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4026e6c-21be-499f-b6ec-4ea042d9661e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:05.565270 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bb7150-668e-4388-9cd9-cbabf6f9f3cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 17:06:05.573607 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application [None req-f4bb7150-668e-4388-9cd9-cbabf6f9f3cd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 17:06:05.573607 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:06:05.573607 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:06:05.573607 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:06:05.573607 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:06:05.573607 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:06:05.573607 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:06:05.573607 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:06:05.573607 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:06:05.573607 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:06:05.573607 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:06:05.573607 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:06:05.573607 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 17:06:05.573607 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 17:06:05.573607 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 17:06:05.573607 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 17:06:05.574524 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 17:06:05.574524 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 17:06:05.574524 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 17:06:05.574524 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 17:06:05.574524 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:06:05.574524 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:06:05.574524 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:06:05.574524 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:06:05.574524 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:06:05.574524 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:06:05.574524 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:06:05.574524 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application with Lock( Jun 16 17:06:05.574524 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:06:05.574524 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:06:05.574524 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:06:05.574524 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:06:05.575280 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:06:05.575280 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:06:05.575280 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:06:05.575280 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:06:05.575280 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 17:06:05.575280 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 17:06:05.575280 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 17:06:05.575280 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 17:06:05.575280 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 17:06:05.575280 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 17:06:05.575280 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 17:06:05.575280 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Jun 16 17:06:05.577827 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 31/67] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 16 17:06:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:06:05.578158 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-f4026e6c-21be-499f-b6ec-4ea042d9661e None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:06:05.580014 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-f4026e6c-21be-499f-b6ec-4ea042d9661e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:06:05.588547 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bb7150-668e-4388-9cd9-cbabf6f9f3cd None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:05.595934 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:05.659568 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 37/68] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 17:06:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 17:06:05.667711 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4026e6c-21be-499f-b6ec-4ea042d9661e None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:05.695004 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:05.717508 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bb7150-668e-4388-9cd9-cbabf6f9f3cd None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:05.757436 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd80f724-f66b-4fb6-99d3-1313b7718790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:05.758261 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd80f724-f66b-4fb6-99d3-1313b7718790 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:05.758613 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd80f724-f66b-4fb6-99d3-1313b7718790 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:05.758908 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd80f724-f66b-4fb6-99d3-1313b7718790 None admin] PATH_INFO: `/v3/roles` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:05.759701 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd80f724-f66b-4fb6-99d3-1313b7718790 None admin] RBAC: Adding query filter params (name=member) {{(pid=80873) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:06:05.760024 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd80f724-f66b-4fb6-99d3-1313b7718790 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:05.761460 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd80f724-f66b-4fb6-99d3-1313b7718790 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:05.775735 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 32/69] 10.222.0.39 () {56 vars in 1101 bytes} [Thu Jun 16 17:06:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:06:05.775735 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd80f724-f66b-4fb6-99d3-1313b7718790 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:05.796931 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4026e6c-21be-499f-b6ec-4ea042d9661e None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:05.832551 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd29bf03-43b6-4f06-97b4-af934c0e4f27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:05.833346 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd29bf03-43b6-4f06-97b4-af934c0e4f27 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:05.833634 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd29bf03-43b6-4f06-97b4-af934c0e4f27 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:05.833956 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd29bf03-43b6-4f06-97b4-af934c0e4f27 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:05.843842 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd29bf03-43b6-4f06-97b4-af934c0e4f27 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 17:06:05.852115 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application [None req-fd29bf03-43b6-4f06-97b4-af934c0e4f27 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 17:06:05.852115 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:06:05.852115 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:06:05.852115 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:06:05.852115 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:06:05.852115 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:06:05.852115 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:06:05.852115 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:06:05.852115 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:06:05.852115 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:06:05.852115 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:06:05.852115 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:06:05.852115 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 17:06:05.852115 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 17:06:05.852115 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 17:06:05.852115 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 17:06:05.853235 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 17:06:05.853235 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 17:06:05.853235 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 17:06:05.853235 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 17:06:05.853235 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:06:05.853235 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:06:05.853235 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:06:05.853235 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:06:05.853235 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:06:05.853235 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:06:05.853235 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:06:05.853235 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application with Lock( Jun 16 17:06:05.853235 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:06:05.853235 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:06:05.853235 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:06:05.853235 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:06:05.854034 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:06:05.854034 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:06:05.854034 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:06:05.854034 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:06:05.854034 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 17:06:05.854034 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 17:06:05.854034 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 17:06:05.854034 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 17:06:05.854034 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 17:06:05.854034 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 17:06:05.854034 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 17:06:05.854034 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Jun 16 17:06:05.854034 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 38/70] 10.222.0.39 () {56 vars in 1096 bytes} [Thu Jun 16 17:06:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:06:05.854814 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed20487-8e95-4ce5-af84-2569782dcd8f None None] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:05.855072 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed20487-8e95-4ce5-af84-2569782dcd8f None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:05.855503 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed20487-8e95-4ce5-af84-2569782dcd8f None None] PATH_INFO: `/` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:05.856907 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 39/71] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 17:06:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:06:05.857753 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed20487-8e95-4ce5-af84-2569782dcd8f None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:05.871135 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:05.882043 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd80f724-f66b-4fb6-99d3-1313b7718790 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:05.916699 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f1bc2c-4969-4976-9d8e-9282cc08a04f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:05.917495 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f1bc2c-4969-4976-9d8e-9282cc08a04f None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:05.917809 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f1bc2c-4969-4976-9d8e-9282cc08a04f None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:05.918099 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f1bc2c-4969-4976-9d8e-9282cc08a04f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:05.919281 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f1bc2c-4969-4976-9d8e-9282cc08a04f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:05.920857 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f1bc2c-4969-4976-9d8e-9282cc08a04f None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:05.922506 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 33/72] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 17:06:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:06:05.924355 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e733ace9-c303-4fb2-b1d6-21fc652b4891 None None] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:05.924645 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e733ace9-c303-4fb2-b1d6-21fc652b4891 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:05.924925 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e733ace9-c303-4fb2-b1d6-21fc652b4891 None None] PATH_INFO: `/` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:05.926274 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 34/73] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 17:06:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:06:05.926964 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e733ace9-c303-4fb2-b1d6-21fc652b4891 None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:05.940465 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:05.969176 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed20487-8e95-4ce5-af84-2569782dcd8f None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:06.008423 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e74f17f-23ff-4249-a689-f45225fd580f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:06.009289 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e74f17f-23ff-4249-a689-f45225fd580f None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:06.009579 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e74f17f-23ff-4249-a689-f45225fd580f None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:06.009891 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e74f17f-23ff-4249-a689-f45225fd580f None admin] PATH_INFO: `/v3/users/ef9bfbcc66f1498383e8c137bc8a81b7` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:06.025615 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e74f17f-23ff-4249-a689-f45225fd580f None admin] RBAC: Authorizing `identity:get_user(user_id=ef9bfbcc66f1498383e8c137bc8a81b7)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:06.027115 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e74f17f-23ff-4249-a689-f45225fd580f None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:06.028796 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 40/74] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jun 16 17:06:05 2022] GET /identity/v3/users/ef9bfbcc66f1498383e8c137bc8a81b7 => generated 275 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:06:06.030063 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdf9d41-f1d5-4e4a-9d62-3ed8136fe843 None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:06.030358 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdf9d41-f1d5-4e4a-9d62-3ed8136fe843 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:06.030645 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdf9d41-f1d5-4e4a-9d62-3ed8136fe843 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:06.034530 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e733ace9-c303-4fb2-b1d6-21fc652b4891 None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:06.047531 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-7fdf9d41-f1d5-4e4a-9d62-3ed8136fe843 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:06:06.049423 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-7fdf9d41-f1d5-4e4a-9d62-3ed8136fe843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:06:06.070000 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f319b054-2a8f-418d-b460-c0dc5cbb4b5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:06.070695 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f319b054-2a8f-418d-b460-c0dc5cbb4b5a None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:06.070985 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f319b054-2a8f-418d-b460-c0dc5cbb4b5a None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:06.071266 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f319b054-2a8f-418d-b460-c0dc5cbb4b5a None admin] PATH_INFO: `/v3/roles` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:06.072020 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f319b054-2a8f-418d-b460-c0dc5cbb4b5a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80873) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:06:06.072334 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f319b054-2a8f-418d-b460-c0dc5cbb4b5a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:06.073715 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f319b054-2a8f-418d-b460-c0dc5cbb4b5a None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:06.085858 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 35/75] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 16 17:06:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:06:06.088433 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f319b054-2a8f-418d-b460-c0dc5cbb4b5a None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:06.113417 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:06.120881 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 41/76] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 17:06:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 17:06:06.125953 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cc06f3-741a-4723-a7a6-dbc865c1f25b None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:06.125953 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cc06f3-741a-4723-a7a6-dbc865c1f25b None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:06.125953 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cc06f3-741a-4723-a7a6-dbc865c1f25b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:06.142126 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-56cc06f3-741a-4723-a7a6-dbc865c1f25b None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:06:06.144388 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-56cc06f3-741a-4723-a7a6-dbc865c1f25b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:06:06.171342 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:06.201848 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f319b054-2a8f-418d-b460-c0dc5cbb4b5a None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:06.213203 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 42/77] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 17:06:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 17:06:06.214684 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cc06f3-741a-4723-a7a6-dbc865c1f25b None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:06.236736 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074891a1-a85c-46be-9cd0-52f445e48c57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:06.237348 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074891a1-a85c-46be-9cd0-52f445e48c57 None admin] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:06.237899 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074891a1-a85c-46be-9cd0-52f445e48c57 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:06.238001 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074891a1-a85c-46be-9cd0-52f445e48c57 None admin] PATH_INFO: `/v3/users` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:06.238675 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074891a1-a85c-46be-9cd0-52f445e48c57 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:06.240189 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074891a1-a85c-46be-9cd0-52f445e48c57 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:06.323377 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cc06f3-741a-4723-a7a6-dbc865c1f25b None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:06.352143 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:06.360954 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1545e4-cbcd-4a37-9543-2adccd757846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:06.361604 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1545e4-cbcd-4a37-9543-2adccd757846 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:06.361936 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1545e4-cbcd-4a37-9543-2adccd757846 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:06.362220 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1545e4-cbcd-4a37-9543-2adccd757846 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:06.406989 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 36/78] 10.222.0.39 () {60 vars in 1132 bytes} [Thu Jun 16 17:06:06 2022] POST /identity/v3/users => generated 289 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:06:06.407841 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074891a1-a85c-46be-9cd0-52f445e48c57 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:06.446920 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1545e4-cbcd-4a37-9543-2adccd757846 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:06.448454 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1545e4-cbcd-4a37-9543-2adccd757846 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:06.537028 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074891a1-a85c-46be-9cd0-52f445e48c57 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:06.565979 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 43/79] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 16 17:06:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 17:06:06.566173 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:06.566597 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1545e4-cbcd-4a37-9543-2adccd757846 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:06.579448 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c69d425-7622-4715-be4b-d903fd0aefd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:06.581209 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c69d425-7622-4715-be4b-d903fd0aefd9 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:06.581209 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c69d425-7622-4715-be4b-d903fd0aefd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:06.581452 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c69d425-7622-4715-be4b-d903fd0aefd9 None admin] PATH_INFO: `/v3/users/338529aa60c34c3887b1c9ec26ad60d8` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:06.583258 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c69d425-7622-4715-be4b-d903fd0aefd9 None admin] RBAC: Authorizing `identity:get_user(user_id=338529aa60c34c3887b1c9ec26ad60d8)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:06.585293 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c69d425-7622-4715-be4b-d903fd0aefd9 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:06.587289 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 37/80] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jun 16 17:06:06 2022] GET /identity/v3/users/338529aa60c34c3887b1c9ec26ad60d8 => generated 247 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:06:06.587870 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c69d425-7622-4715-be4b-d903fd0aefd9 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:06.604677 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:06.687528 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1545e4-cbcd-4a37-9543-2adccd757846 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:06.721300 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c69d425-7622-4715-be4b-d903fd0aefd9 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:06.730238 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069a7c66-3d92-4ada-8ce4-d83f3715703d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:06.731372 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069a7c66-3d92-4ada-8ce4-d83f3715703d None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:06.731799 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069a7c66-3d92-4ada-8ce4-d83f3715703d None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:06.732217 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069a7c66-3d92-4ada-8ce4-d83f3715703d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:06.749393 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069a7c66-3d92-4ada-8ce4-d83f3715703d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 17:06:06.758116 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application [None req-069a7c66-3d92-4ada-8ce4-d83f3715703d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 17:06:06.758116 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:06:06.758116 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:06:06.758116 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:06:06.758116 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:06:06.758116 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:06:06.758116 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:06:06.758116 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:06:06.758116 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:06:06.758116 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:06:06.758116 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:06:06.758116 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:06:06.758116 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 17:06:06.758116 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 17:06:06.758116 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 17:06:06.758116 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 17:06:06.759011 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 17:06:06.759011 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 17:06:06.759011 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 17:06:06.759011 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 17:06:06.759011 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:06:06.759011 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:06:06.759011 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:06:06.759011 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:06:06.759011 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:06:06.759011 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:06:06.759011 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:06:06.759011 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application with Lock( Jun 16 17:06:06.759011 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:06:06.759011 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:06:06.759011 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:06:06.759011 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:06:06.759964 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:06:06.759964 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:06:06.759964 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:06:06.759964 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:06:06.759964 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 17:06:06.759964 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 17:06:06.759964 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 17:06:06.759964 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 17:06:06.759964 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 17:06:06.759964 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 17:06:06.759964 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 17:06:06.759964 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Jun 16 17:06:06.762008 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 44/81] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 16 17:06:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:06:06.762928 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069a7c66-3d92-4ada-8ce4-d83f3715703d None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:06.771006 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f25efb-7302-442d-9339-f67fb85bed48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:06.771956 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f25efb-7302-442d-9339-f67fb85bed48 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:06.772251 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f25efb-7302-442d-9339-f67fb85bed48 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:06.772543 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f25efb-7302-442d-9339-f67fb85bed48 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:06.789874 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f25efb-7302-442d-9339-f67fb85bed48 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 17:06:06.793524 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application [None req-38f25efb-7302-442d-9339-f67fb85bed48 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 17:06:06.793524 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:06:06.793524 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:06:06.793524 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:06:06.793524 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:06:06.793524 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:06:06.793524 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:06:06.793524 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:06:06.793524 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:06:06.793524 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:06:06.793524 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:06:06.793524 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:06:06.793524 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 17:06:06.793524 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 17:06:06.793524 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 17:06:06.793524 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 17:06:06.794429 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 17:06:06.794429 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 17:06:06.794429 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 17:06:06.794429 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 17:06:06.794429 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:06:06.794429 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:06:06.794429 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:06:06.794429 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:06:06.794429 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:06:06.794429 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:06:06.794429 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:06:06.794429 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application with Lock( Jun 16 17:06:06.794429 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:06:06.794429 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:06:06.794429 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:06:06.794429 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:06:06.795187 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:06:06.795187 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:06:06.795187 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:06:06.795187 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:06:06.795187 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 17:06:06.795187 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 17:06:06.795187 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 17:06:06.795187 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 17:06:06.795187 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 17:06:06.795187 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 17:06:06.795187 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 17:06:06.795187 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Jun 16 17:06:06.795187 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 38/82] 10.222.0.39 () {56 vars in 1114 bytes} [Thu Jun 16 17:06:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:06:06.799220 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f25efb-7302-442d-9339-f67fb85bed48 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:06.874736 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:06.881968 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:06.907037 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069a7c66-3d92-4ada-8ce4-d83f3715703d None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:06.931114 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f25efb-7302-442d-9339-f67fb85bed48 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:06.948118 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9597a47-0a42-418c-90a2-24484c18de6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:06.949332 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9597a47-0a42-418c-90a2-24484c18de6e None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:06.949903 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9597a47-0a42-418c-90a2-24484c18de6e None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:06.950458 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9597a47-0a42-418c-90a2-24484c18de6e None admin] PATH_INFO: `/v3/projects/ac5b05cf174a49b0aae4343f1ac0f173` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:06.951946 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9597a47-0a42-418c-90a2-24484c18de6e None admin] RBAC: Authorizing `identity:get_project(project_id=ac5b05cf174a49b0aae4343f1ac0f173)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:06.953638 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9597a47-0a42-418c-90a2-24484c18de6e None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:06.956264 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 45/83] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 16 17:06:06 2022] GET /identity/v3/projects/ac5b05cf174a49b0aae4343f1ac0f173 => generated 298 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:06:06.957433 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9597a47-0a42-418c-90a2-24484c18de6e None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:06.968179 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29bbd51-ab29-44b2-94db-ab8db3251556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:06.968846 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29bbd51-ab29-44b2-94db-ab8db3251556 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:06.969136 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29bbd51-ab29-44b2-94db-ab8db3251556 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:06.969419 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29bbd51-ab29-44b2-94db-ab8db3251556 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:07.044645 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29bbd51-ab29-44b2-94db-ab8db3251556 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:07.046130 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29bbd51-ab29-44b2-94db-ab8db3251556 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:07.067416 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9597a47-0a42-418c-90a2-24484c18de6e None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:07.104540 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931fcb3e-f74b-4f86-a4ce-8f500b74425f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:07.105607 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931fcb3e-f74b-4f86-a4ce-8f500b74425f None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:07.106128 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931fcb3e-f74b-4f86-a4ce-8f500b74425f None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:07.106618 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931fcb3e-f74b-4f86-a4ce-8f500b74425f None admin] PATH_INFO: `/v3/roles` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:07.107580 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931fcb3e-f74b-4f86-a4ce-8f500b74425f None admin] RBAC: Adding query filter params (name=member) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:06:07.108097 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931fcb3e-f74b-4f86-a4ce-8f500b74425f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:07.109699 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931fcb3e-f74b-4f86-a4ce-8f500b74425f None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:07.118641 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 46/84] 10.222.0.39 () {56 vars in 1101 bytes} [Thu Jun 16 17:06:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:06:07.119869 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931fcb3e-f74b-4f86-a4ce-8f500b74425f None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:07.126555 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:07.153184 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 39/85] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 16 17:06:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 17:06:07.158563 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29bbd51-ab29-44b2-94db-ab8db3251556 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:07.174514 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:07.236725 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931fcb3e-f74b-4f86-a4ce-8f500b74425f None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:07.262908 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29bbd51-ab29-44b2-94db-ab8db3251556 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:07.274765 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cda282-9515-4216-bb8e-5c4dc2b55916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:07.275864 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cda282-9515-4216-bb8e-5c4dc2b55916 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:07.276389 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cda282-9515-4216-bb8e-5c4dc2b55916 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:07.276879 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cda282-9515-4216-bb8e-5c4dc2b55916 None admin] PATH_INFO: `/v3/roles` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:07.277876 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cda282-9515-4216-bb8e-5c4dc2b55916 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:06:07.278398 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cda282-9515-4216-bb8e-5c4dc2b55916 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:07.280003 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cda282-9515-4216-bb8e-5c4dc2b55916 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:07.290425 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 47/86] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 16 17:06:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:06:07.295974 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cda282-9515-4216-bb8e-5c4dc2b55916 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:07.299561 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d078365c-5bcd-458e-be2d-4f75b440176d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:07.301052 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d078365c-5bcd-458e-be2d-4f75b440176d None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:07.301052 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d078365c-5bcd-458e-be2d-4f75b440176d None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:07.301052 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d078365c-5bcd-458e-be2d-4f75b440176d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:07.301711 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d078365c-5bcd-458e-be2d-4f75b440176d None admin] RBAC: Adding query filter params (role.id=896bff49c5d6464eb612a15f4aa9badc, scope.project.id=ac5b05cf174a49b0aae4343f1ac0f173, user.id=ef9bfbcc66f1498383e8c137bc8a81b7) {{(pid=80873) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:06:07.302084 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d078365c-5bcd-458e-be2d-4f75b440176d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:07.303539 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d078365c-5bcd-458e-be2d-4f75b440176d None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:07.309519 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 40/87] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jun 16 17:06:07 2022] GET /identity/v3/role_assignments?user.id=ef9bfbcc66f1498383e8c137bc8a81b7&scope.project.id=ac5b05cf174a49b0aae4343f1ac0f173&role.id=896bff49c5d6464eb612a15f4aa9badc => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:06:07.310361 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d078365c-5bcd-458e-be2d-4f75b440176d None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:07.371408 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:07.394630 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:07.418490 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cda282-9515-4216-bb8e-5c4dc2b55916 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:07.424067 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d078365c-5bcd-458e-be2d-4f75b440176d None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:07.458895 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c73a12-3b49-47c3-863f-812beab222f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:07.460492 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c73a12-3b49-47c3-863f-812beab222f2 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:07.460993 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c73a12-3b49-47c3-863f-812beab222f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:07.461483 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c73a12-3b49-47c3-863f-812beab222f2 None admin] PATH_INFO: `/v3/users/ef9bfbcc66f1498383e8c137bc8a81b7` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:07.462929 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c73a12-3b49-47c3-863f-812beab222f2 None admin] RBAC: Authorizing `identity:get_user(user_id=ef9bfbcc66f1498383e8c137bc8a81b7)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:07.463427 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ea75d4-a620-4a19-b51a-89864f40352c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:07.464302 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ea75d4-a620-4a19-b51a-89864f40352c None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:07.464589 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ea75d4-a620-4a19-b51a-89864f40352c None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:07.464871 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ea75d4-a620-4a19-b51a-89864f40352c None admin] PATH_INFO: `/v3/projects/ac5b05cf174a49b0aae4343f1ac0f173` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:07.465557 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c73a12-3b49-47c3-863f-812beab222f2 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:07.466099 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ea75d4-a620-4a19-b51a-89864f40352c None admin] RBAC: Authorizing `identity:get_project(project_id=ac5b05cf174a49b0aae4343f1ac0f173)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:07.467523 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ea75d4-a620-4a19-b51a-89864f40352c None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:07.467978 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 48/88] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jun 16 17:06:07 2022] GET /identity/v3/users/ef9bfbcc66f1498383e8c137bc8a81b7 => generated 275 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:06:07.469073 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c73a12-3b49-47c3-863f-812beab222f2 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:07.469584 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 41/89] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 16 17:06:07 2022] GET /identity/v3/projects/ac5b05cf174a49b0aae4343f1ac0f173 => generated 298 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:06:07.474859 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ea75d4-a620-4a19-b51a-89864f40352c None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:07.586546 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:07.601078 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ea75d4-a620-4a19-b51a-89864f40352c None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:07.640645 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7a35c3-6983-49ec-8e7f-1cc48188b5a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:07.642989 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7a35c3-6983-49ec-8e7f-1cc48188b5a0 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:07.643542 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7a35c3-6983-49ec-8e7f-1cc48188b5a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:07.644029 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7a35c3-6983-49ec-8e7f-1cc48188b5a0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:07.711719 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c73a12-3b49-47c3-863f-812beab222f2 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:07.723309 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7a35c3-6983-49ec-8e7f-1cc48188b5a0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:07.725752 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7a35c3-6983-49ec-8e7f-1cc48188b5a0 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:07.799131 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a936eb-06af-48fd-bed6-e4407bb27043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:07.800036 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a936eb-06af-48fd-bed6-e4407bb27043 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:07.800327 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a936eb-06af-48fd-bed6-e4407bb27043 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:07.800612 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a936eb-06af-48fd-bed6-e4407bb27043 None admin] PATH_INFO: `/v3/users/ef9bfbcc66f1498383e8c137bc8a81b7` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:07.801986 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a936eb-06af-48fd-bed6-e4407bb27043 None admin] RBAC: Authorizing `identity:get_user(user_id=ef9bfbcc66f1498383e8c137bc8a81b7)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:07.803458 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a936eb-06af-48fd-bed6-e4407bb27043 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:07.809791 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 49/90] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jun 16 17:06:07 2022] GET /identity/v3/users/ef9bfbcc66f1498383e8c137bc8a81b7 => generated 275 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:06:07.809791 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a936eb-06af-48fd-bed6-e4407bb27043 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:07.829992 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:07.848229 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 42/91] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 16 17:06:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 16 17:06:07.848229 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7a35c3-6983-49ec-8e7f-1cc48188b5a0 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:07.848989 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:07.991821 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7a35c3-6983-49ec-8e7f-1cc48188b5a0 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:08.036691 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a936eb-06af-48fd-bed6-e4407bb27043 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:08.060330 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0a1bc2-ba83-452c-bf71-44fd67ab9365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:08.061053 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0a1bc2-ba83-452c-bf71-44fd67ab9365 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:08.061349 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0a1bc2-ba83-452c-bf71-44fd67ab9365 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:08.061634 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0a1bc2-ba83-452c-bf71-44fd67ab9365 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:08.101811 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176ea764-2922-42b9-b9bc-22a64ef3cae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:08.102388 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176ea764-2922-42b9-b9bc-22a64ef3cae6 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:08.102686 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176ea764-2922-42b9-b9bc-22a64ef3cae6 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:08.103225 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176ea764-2922-42b9-b9bc-22a64ef3cae6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:08.104072 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176ea764-2922-42b9-b9bc-22a64ef3cae6 None admin] RBAC: Adding query filter params (role.id=dba744f8ab2a4c45b9d3212f8d203aba, scope.project.id=ac5b05cf174a49b0aae4343f1ac0f173, user.id=338529aa60c34c3887b1c9ec26ad60d8) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:06:08.104393 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176ea764-2922-42b9-b9bc-22a64ef3cae6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:08.105881 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176ea764-2922-42b9-b9bc-22a64ef3cae6 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:08.119471 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 50/92] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jun 16 17:06:07 2022] GET /identity/v3/role_assignments?user.id=338529aa60c34c3887b1c9ec26ad60d8&scope.project.id=ac5b05cf174a49b0aae4343f1ac0f173&role.id=dba744f8ab2a4c45b9d3212f8d203aba => generated 259 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:06:08.120702 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176ea764-2922-42b9-b9bc-22a64ef3cae6 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:08.153066 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:08.177377 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0a1bc2-ba83-452c-bf71-44fd67ab9365 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:08.180712 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0a1bc2-ba83-452c-bf71-44fd67ab9365 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:08.338214 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:08.399815 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176ea764-2922-42b9-b9bc-22a64ef3cae6 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:08.481283 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 43/93] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 16 17:06:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 637 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 17:06:08.485171 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcc3b99-60a0-4e83-adf1-234a503f8661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:08.486564 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcc3b99-60a0-4e83-adf1-234a503f8661 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:08.486862 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcc3b99-60a0-4e83-adf1-234a503f8661 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:08.487142 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0a1bc2-ba83-452c-bf71-44fd67ab9365 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:08.487245 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcc3b99-60a0-4e83-adf1-234a503f8661 None admin] PATH_INFO: `/v3/projects/590e405fe8a64179bcedf55b5577f0b1` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:08.489677 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcc3b99-60a0-4e83-adf1-234a503f8661 None admin] RBAC: Authorizing `identity:get_project(project_id=590e405fe8a64179bcedf55b5577f0b1)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:08.491192 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcc3b99-60a0-4e83-adf1-234a503f8661 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:08.492959 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 51/94] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 16 17:06:08 2022] GET /identity/v3/projects/590e405fe8a64179bcedf55b5577f0b1 => generated 312 bytes in 373 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:06:08.499939 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcc3b99-60a0-4e83-adf1-234a503f8661 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:08.638138 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:08.666219 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0a1bc2-ba83-452c-bf71-44fd67ab9365 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:08.729921 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad74e31f-de2c-455d-9353-acbec6bb5f2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:08.730836 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad74e31f-de2c-455d-9353-acbec6bb5f2a None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:08.731132 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad74e31f-de2c-455d-9353-acbec6bb5f2a None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:08.731416 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad74e31f-de2c-455d-9353-acbec6bb5f2a None admin] PATH_INFO: `/v3/projects/ac5b05cf174a49b0aae4343f1ac0f173` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:08.732611 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad74e31f-de2c-455d-9353-acbec6bb5f2a None admin] RBAC: Authorizing `identity:get_project(project_id=ac5b05cf174a49b0aae4343f1ac0f173)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:08.734092 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad74e31f-de2c-455d-9353-acbec6bb5f2a None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:08.736334 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 44/95] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 16 17:06:08 2022] GET /identity/v3/projects/ac5b05cf174a49b0aae4343f1ac0f173 => generated 298 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 17:06:08.742710 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad74e31f-de2c-455d-9353-acbec6bb5f2a None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:08.763914 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcc3b99-60a0-4e83-adf1-234a503f8661 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:08.866501 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4594dc5-7093-4774-8dc2-fe43997010e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:08.867186 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4594dc5-7093-4774-8dc2-fe43997010e9 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:08.867483 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4594dc5-7093-4774-8dc2-fe43997010e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:08.867774 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4594dc5-7093-4774-8dc2-fe43997010e9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:08.868636 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4594dc5-7093-4774-8dc2-fe43997010e9 None admin] RBAC: Adding query filter params (role.id=896bff49c5d6464eb612a15f4aa9badc, scope.project.id=590e405fe8a64179bcedf55b5577f0b1, user.id=ef9bfbcc66f1498383e8c137bc8a81b7) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:06:08.868960 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4594dc5-7093-4774-8dc2-fe43997010e9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:08.870483 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4594dc5-7093-4774-8dc2-fe43997010e9 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:08.896196 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 52/96] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jun 16 17:06:08 2022] GET /identity/v3/role_assignments?user.id=ef9bfbcc66f1498383e8c137bc8a81b7&scope.project.id=590e405fe8a64179bcedf55b5577f0b1&role.id=896bff49c5d6464eb612a15f4aa9badc => generated 259 bytes in 397 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:06:08.946467 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad74e31f-de2c-455d-9353-acbec6bb5f2a None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:09.001987 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4141976-8f1d-4e6f-af80-4efb2be420c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:09.002670 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4141976-8f1d-4e6f-af80-4efb2be420c4 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:09.002961 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4141976-8f1d-4e6f-af80-4efb2be420c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:09.003241 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4141976-8f1d-4e6f-af80-4efb2be420c4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:09.004112 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4141976-8f1d-4e6f-af80-4efb2be420c4 None admin] RBAC: Adding query filter params (role.id=9331b396c9894ab88267e7b82ef6f224, scope.project.id=ac5b05cf174a49b0aae4343f1ac0f173, user.id=ef9bfbcc66f1498383e8c137bc8a81b7) {{(pid=80873) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:06:09.004438 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4141976-8f1d-4e6f-af80-4efb2be420c4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:09.005903 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4141976-8f1d-4e6f-af80-4efb2be420c4 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:09.012225 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 45/97] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jun 16 17:06:08 2022] GET /identity/v3/role_assignments?user.id=ef9bfbcc66f1498383e8c137bc8a81b7&scope.project.id=ac5b05cf174a49b0aae4343f1ac0f173&role.id=9331b396c9894ab88267e7b82ef6f224 => generated 259 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:06:09.201679 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb54851-f310-4225-b432-b6d5ed9fcfdd None None] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:09.202002 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb54851-f310-4225-b432-b6d5ed9fcfdd None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:09.202215 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb54851-f310-4225-b432-b6d5ed9fcfdd None None] PATH_INFO: `/` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:09.203657 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 53/98] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 17:06:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:06:09.209666 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6805be98-eca8-410f-bfca-6a551eaedd8e None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:09.209976 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6805be98-eca8-410f-bfca-6a551eaedd8e None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:09.210265 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6805be98-eca8-410f-bfca-6a551eaedd8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:09.232797 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-6805be98-eca8-410f-bfca-6a551eaedd8e None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:06:09.234053 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-6805be98-eca8-410f-bfca-6a551eaedd8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:06:09.256640 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:09.321252 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 46/99] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 17:06:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 17:06:09.362118 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb54851-f310-4225-b432-b6d5ed9fcfdd None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:09.374449 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95e3ca0-eac0-4492-be0e-ebb5c032b895 None None] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:09.374745 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95e3ca0-eac0-4492-be0e-ebb5c032b895 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:09.375033 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95e3ca0-eac0-4492-be0e-ebb5c032b895 None None] PATH_INFO: `/` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:09.377116 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 47/100] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 17:06:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:06:09.382216 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df10e184-3659-4933-ad07-69025578a9f2 None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:09.383038 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df10e184-3659-4933-ad07-69025578a9f2 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:09.383339 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df10e184-3659-4933-ad07-69025578a9f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:09.404811 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-df10e184-3659-4933-ad07-69025578a9f2 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:06:09.405713 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:09.406021 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-df10e184-3659-4933-ad07-69025578a9f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:06:09.507859 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 48/101] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 17:06:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 17:06:09.543989 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df10e184-3659-4933-ad07-69025578a9f2 None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:09.623577 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb54851-f310-4225-b432-b6d5ed9fcfdd None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:09.703274 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:09.714510 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2a508c-390e-4046-be80-8355ed41e7b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:09.715337 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2a508c-390e-4046-be80-8355ed41e7b5 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:09.715633 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2a508c-390e-4046-be80-8355ed41e7b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:09.715919 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2a508c-390e-4046-be80-8355ed41e7b5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:09.718853 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2a508c-390e-4046-be80-8355ed41e7b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:09.718853 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2a508c-390e-4046-be80-8355ed41e7b5 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:09.721025 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 54/102] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 17:06:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 359 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:06:09.726527 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2a508c-390e-4046-be80-8355ed41e7b5 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:09.726777 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df10e184-3659-4933-ad07-69025578a9f2 None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:09.784469 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b468db6-c287-4240-bb59-273b07264450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:09.785203 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b468db6-c287-4240-bb59-273b07264450 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:09.785492 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b468db6-c287-4240-bb59-273b07264450 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:09.785791 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b468db6-c287-4240-bb59-273b07264450 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:09.818753 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b468db6-c287-4240-bb59-273b07264450 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 17:06:09.833589 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application [None req-2b468db6-c287-4240-bb59-273b07264450 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 17:06:09.833589 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:06:09.833589 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:06:09.833589 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:06:09.833589 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:06:09.833589 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:06:09.833589 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:06:09.833589 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:06:09.833589 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:06:09.833589 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:06:09.833589 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:06:09.833589 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:06:09.833589 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 17:06:09.833589 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 17:06:09.833589 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 17:06:09.833589 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 17:06:09.834551 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 17:06:09.834551 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 17:06:09.834551 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 17:06:09.834551 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 17:06:09.834551 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:06:09.834551 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:06:09.834551 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:06:09.834551 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:06:09.834551 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:06:09.834551 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:06:09.834551 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:06:09.834551 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application with Lock( Jun 16 17:06:09.834551 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:06:09.834551 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:06:09.834551 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:06:09.834551 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:06:09.835342 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:06:09.835342 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:06:09.835342 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:06:09.835342 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:06:09.835342 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 17:06:09.835342 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 17:06:09.835342 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 17:06:09.835342 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 17:06:09.835342 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 17:06:09.835342 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 17:06:09.835342 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 17:06:09.835342 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Jun 16 17:06:09.836427 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 49/103] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 16 17:06:09 2022] GET /identity/v3/roles/reader => generated 84 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 17:06:09.855078 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b468db6-c287-4240-bb59-273b07264450 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:09.887214 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:09.935672 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2a508c-390e-4046-be80-8355ed41e7b5 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:10.035133 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c581960b-73a0-4a17-a891-717e1444ec2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:10.035735 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c581960b-73a0-4a17-a891-717e1444ec2c None admin] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:10.036030 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c581960b-73a0-4a17-a891-717e1444ec2c None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:10.036315 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c581960b-73a0-4a17-a891-717e1444ec2c None admin] PATH_INFO: `/v3/projects` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:10.037049 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c581960b-73a0-4a17-a891-717e1444ec2c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:10.038552 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c581960b-73a0-4a17-a891-717e1444ec2c None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:10.064709 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b468db6-c287-4240-bb59-273b07264450 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:10.122670 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218d0110-5f67-401e-9eac-0d041487d8f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:10.123350 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218d0110-5f67-401e-9eac-0d041487d8f1 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:10.123642 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218d0110-5f67-401e-9eac-0d041487d8f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:10.123925 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218d0110-5f67-401e-9eac-0d041487d8f1 None admin] PATH_INFO: `/v3/roles` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:10.124683 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218d0110-5f67-401e-9eac-0d041487d8f1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80873) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:06:10.124993 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218d0110-5f67-401e-9eac-0d041487d8f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:10.127081 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218d0110-5f67-401e-9eac-0d041487d8f1 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:10.144015 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 50/104] 10.222.0.39 () {56 vars in 1101 bytes} [Thu Jun 16 17:06:09 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:06:10.149568 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218d0110-5f67-401e-9eac-0d041487d8f1 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:10.152615 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:10.156178 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 55/105] 10.222.0.39 () {60 vars in 1141 bytes} [Thu Jun 16 17:06:09 2022] POST /identity/v3/projects => generated 302 bytes in 430 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:06:10.296876 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218d0110-5f67-401e-9eac-0d041487d8f1 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:10.345717 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f2c394-8c91-4267-9598-d7198f5e5f9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:10.346717 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f2c394-8c91-4267-9598-d7198f5e5f9e None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:10.347010 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f2c394-8c91-4267-9598-d7198f5e5f9e None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:10.347297 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f2c394-8c91-4267-9598-d7198f5e5f9e None admin] PATH_INFO: `/v3/users/1fef9400dc574700a67fee19442404b8` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:10.400915 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f2c394-8c91-4267-9598-d7198f5e5f9e None admin] RBAC: Authorizing `identity:get_user(user_id=1fef9400dc574700a67fee19442404b8)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:10.402447 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f2c394-8c91-4267-9598-d7198f5e5f9e None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:10.404278 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 51/106] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jun 16 17:06:10 2022] GET /identity/v3/users/1fef9400dc574700a67fee19442404b8 => generated 289 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:06:10.411015 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c581960b-73a0-4a17-a891-717e1444ec2c None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:10.554033 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796aa6c9-7283-4f18-83ad-83966b7a6ec7 None None] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:10.554850 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796aa6c9-7283-4f18-83ad-83966b7a6ec7 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:10.555309 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796aa6c9-7283-4f18-83ad-83966b7a6ec7 None None] PATH_INFO: `/` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:10.556851 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 52/107] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 17:06:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 17:06:10.562326 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85caf4e-7696-45ee-bcf4-efd570944880 None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:10.562782 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85caf4e-7696-45ee-bcf4-efd570944880 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:10.563267 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85caf4e-7696-45ee-bcf4-efd570944880 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:10.564171 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c581960b-73a0-4a17-a891-717e1444ec2c None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:10.596982 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-d85caf4e-7696-45ee-bcf4-efd570944880 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:06:10.598251 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-d85caf4e-7696-45ee-bcf4-efd570944880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:06:10.608274 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:10.619630 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c975dbf-cb98-42dd-909f-2704339b573f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:10.628523 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c975dbf-cb98-42dd-909f-2704339b573f None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:10.628523 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c975dbf-cb98-42dd-909f-2704339b573f None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:10.628523 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c975dbf-cb98-42dd-909f-2704339b573f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:10.722331 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:10.749088 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 53/108] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 17:06:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 17:06:10.756854 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c975dbf-cb98-42dd-909f-2704339b573f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:10.758394 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c975dbf-cb98-42dd-909f-2704339b573f None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:10.795237 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85caf4e-7696-45ee-bcf4-efd570944880 None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:10.930359 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 56/109] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 16 17:06:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 520 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 17:06:10.938415 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c975dbf-cb98-42dd-909f-2704339b573f None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:10.972665 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:11.044657 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c975dbf-cb98-42dd-909f-2704339b573f None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:11.056466 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85caf4e-7696-45ee-bcf4-efd570944880 None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:11.103259 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ad838f-18a3-4956-b7ca-27eba07228e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:11.104132 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ad838f-18a3-4956-b7ca-27eba07228e4 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:11.104423 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ad838f-18a3-4956-b7ca-27eba07228e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:11.104709 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ad838f-18a3-4956-b7ca-27eba07228e4 None admin] PATH_INFO: `/v3/projects/ac5b05cf174a49b0aae4343f1ac0f173` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:11.106077 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ad838f-18a3-4956-b7ca-27eba07228e4 None admin] RBAC: Authorizing `identity:get_project(project_id=ac5b05cf174a49b0aae4343f1ac0f173)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:11.107540 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ad838f-18a3-4956-b7ca-27eba07228e4 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:11.109427 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 57/110] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 16 17:06:10 2022] GET /identity/v3/projects/ac5b05cf174a49b0aae4343f1ac0f173 => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 17:06:11.111048 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b703ff-c9c7-4989-a07a-a301bbd1e4df None None] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:11.111342 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b703ff-c9c7-4989-a07a-a301bbd1e4df None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:11.111628 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b703ff-c9c7-4989-a07a-a301bbd1e4df None None] PATH_INFO: `/` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:11.112876 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 58/111] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 17:06:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:06:11.119050 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b703ff-c9c7-4989-a07a-a301bbd1e4df None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:11.127849 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccd42b5-805c-483d-9785-c384abcd5a7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:11.128665 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccd42b5-805c-483d-9785-c384abcd5a7b None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:11.128959 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccd42b5-805c-483d-9785-c384abcd5a7b None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:11.129241 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccd42b5-805c-483d-9785-c384abcd5a7b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:11.152866 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccd42b5-805c-483d-9785-c384abcd5a7b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 17:06:11.167127 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application [None req-7ccd42b5-805c-483d-9785-c384abcd5a7b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 17:06:11.167127 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:06:11.167127 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:06:11.167127 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:06:11.167127 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:06:11.167127 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:06:11.167127 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:06:11.167127 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:06:11.167127 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:06:11.167127 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:06:11.167127 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:06:11.167127 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:06:11.167127 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 17:06:11.167127 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 17:06:11.167127 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 17:06:11.167127 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 17:06:11.168079 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 17:06:11.168079 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 17:06:11.168079 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 17:06:11.168079 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 17:06:11.168079 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:06:11.168079 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:06:11.168079 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:06:11.168079 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:06:11.168079 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:06:11.168079 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:06:11.168079 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:06:11.168079 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application with Lock( Jun 16 17:06:11.168079 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:06:11.168079 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:06:11.168079 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:06:11.168079 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:06:11.168878 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:06:11.168878 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:06:11.168878 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:06:11.168878 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:06:11.168878 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 17:06:11.168878 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 17:06:11.168878 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 17:06:11.168878 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 17:06:11.168878 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 17:06:11.168878 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 17:06:11.168878 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 17:06:11.168878 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Jun 16 17:06:11.168878 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 54/112] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 16 17:06:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 374 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 17:06:11.170072 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cab1f5-aaec-4ed5-b7a6-f377278bba50 None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:11.170072 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cab1f5-aaec-4ed5-b7a6-f377278bba50 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:11.170366 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cab1f5-aaec-4ed5-b7a6-f377278bba50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:11.212182 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-06cab1f5-aaec-4ed5-b7a6-f377278bba50 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:06:11.213420 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-06cab1f5-aaec-4ed5-b7a6-f377278bba50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:06:11.304320 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:11.319283 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:11.336302 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b703ff-c9c7-4989-a07a-a301bbd1e4df None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:11.341170 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 55/113] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 17:06:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 17:06:11.342068 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cab1f5-aaec-4ed5-b7a6-f377278bba50 None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:11.404122 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62773630-c4d7-4209-965c-c05a586c507c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:11.405118 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62773630-c4d7-4209-965c-c05a586c507c None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:11.406494 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62773630-c4d7-4209-965c-c05a586c507c None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:11.407126 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62773630-c4d7-4209-965c-c05a586c507c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:11.413187 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62773630-c4d7-4209-965c-c05a586c507c None admin] RBAC: Adding query filter params (role.id=74b3015ca91b437f8d6ee242563b6547, scope.project.id=ac5b05cf174a49b0aae4343f1ac0f173, user.id=1fef9400dc574700a67fee19442404b8) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:06:11.414216 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62773630-c4d7-4209-965c-c05a586c507c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:11.415891 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62773630-c4d7-4209-965c-c05a586c507c None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:11.426019 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 59/114] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jun 16 17:06:11 2022] GET /identity/v3/role_assignments?user.id=1fef9400dc574700a67fee19442404b8&scope.project.id=ac5b05cf174a49b0aae4343f1ac0f173&role.id=74b3015ca91b437f8d6ee242563b6547 => generated 259 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:06:11.427126 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62773630-c4d7-4209-965c-c05a586c507c None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:11.535792 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cab1f5-aaec-4ed5-b7a6-f377278bba50 None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:11.617515 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57abb0ea-9697-477b-86fd-6905040e1686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:11.618324 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57abb0ea-9697-477b-86fd-6905040e1686 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:11.618529 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57abb0ea-9697-477b-86fd-6905040e1686 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:11.618815 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57abb0ea-9697-477b-86fd-6905040e1686 None admin] PATH_INFO: `/v3/roles` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:11.619591 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57abb0ea-9697-477b-86fd-6905040e1686 None admin] RBAC: Adding query filter params (name=member) {{(pid=80873) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:06:11.619907 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57abb0ea-9697-477b-86fd-6905040e1686 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:11.621316 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57abb0ea-9697-477b-86fd-6905040e1686 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:11.633781 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 56/115] 10.222.0.39 () {56 vars in 1101 bytes} [Thu Jun 16 17:06:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:06:11.640537 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57abb0ea-9697-477b-86fd-6905040e1686 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:11.718678 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62773630-c4d7-4209-965c-c05a586c507c None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:11.736048 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:11.788586 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d473af-4398-48b6-885f-5592304e3473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:11.789786 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d473af-4398-48b6-885f-5592304e3473 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:11.790238 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d473af-4398-48b6-885f-5592304e3473 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:11.790685 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d473af-4398-48b6-885f-5592304e3473 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:11.820218 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d473af-4398-48b6-885f-5592304e3473 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 17:06:11.823454 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57abb0ea-9697-477b-86fd-6905040e1686 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:11.837792 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application [None req-c3d473af-4398-48b6-885f-5592304e3473 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 17:06:11.837792 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:06:11.837792 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:06:11.837792 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:06:11.837792 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:06:11.837792 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:06:11.837792 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:06:11.837792 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:06:11.837792 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:06:11.837792 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:06:11.837792 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:06:11.837792 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:06:11.837792 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 17:06:11.837792 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 17:06:11.837792 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 17:06:11.837792 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 17:06:11.838751 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 17:06:11.838751 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 17:06:11.838751 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 17:06:11.838751 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 17:06:11.838751 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:06:11.838751 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:06:11.838751 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:06:11.838751 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:06:11.838751 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:06:11.838751 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:06:11.838751 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:06:11.838751 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application with Lock( Jun 16 17:06:11.838751 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:06:11.838751 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:06:11.838751 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:06:11.838751 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:06:11.839499 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:06:11.839499 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:06:11.839499 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:06:11.839499 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:06:11.839499 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 17:06:11.839499 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 17:06:11.839499 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 17:06:11.839499 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 17:06:11.839499 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 17:06:11.839499 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 17:06:11.839499 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 17:06:11.839499 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Jun 16 17:06:11.843260 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 60/116] 10.222.0.39 () {56 vars in 1096 bytes} [Thu Jun 16 17:06:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 416 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:06:11.850836 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d473af-4398-48b6-885f-5592304e3473 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:11.883129 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b897c5-0a12-42ba-87f5-963eb4fa58f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:11.884096 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b897c5-0a12-42ba-87f5-963eb4fa58f5 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:11.884393 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b897c5-0a12-42ba-87f5-963eb4fa58f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:11.884679 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b897c5-0a12-42ba-87f5-963eb4fa58f5 None admin] PATH_INFO: `/v3/users/ef9bfbcc66f1498383e8c137bc8a81b7` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:11.885946 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b897c5-0a12-42ba-87f5-963eb4fa58f5 None admin] RBAC: Authorizing `identity:get_user(user_id=ef9bfbcc66f1498383e8c137bc8a81b7)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:11.889192 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b897c5-0a12-42ba-87f5-963eb4fa58f5 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:11.891469 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 57/117] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jun 16 17:06:11 2022] GET /identity/v3/users/ef9bfbcc66f1498383e8c137bc8a81b7 => generated 275 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:06:11.900789 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b897c5-0a12-42ba-87f5-963eb4fa58f5 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:11.906749 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:12.091243 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b897c5-0a12-42ba-87f5-963eb4fa58f5 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:12.105423 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d473af-4398-48b6-885f-5592304e3473 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:12.108775 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:12.137207 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c813889-26a0-43ad-91cf-841b83f7625b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:12.138471 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c813889-26a0-43ad-91cf-841b83f7625b None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:12.138915 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c813889-26a0-43ad-91cf-841b83f7625b None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:12.139342 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c813889-26a0-43ad-91cf-841b83f7625b None admin] PATH_INFO: `/v3/projects/ac5b05cf174a49b0aae4343f1ac0f173` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:12.140999 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c813889-26a0-43ad-91cf-841b83f7625b None admin] RBAC: Authorizing `identity:get_project(project_id=ac5b05cf174a49b0aae4343f1ac0f173)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:12.143642 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c813889-26a0-43ad-91cf-841b83f7625b None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:12.144112 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2726d8f3-996d-44bd-9faf-9a91a5d3348f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:12.144896 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2726d8f3-996d-44bd-9faf-9a91a5d3348f None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:12.145290 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2726d8f3-996d-44bd-9faf-9a91a5d3348f None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:12.145675 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2726d8f3-996d-44bd-9faf-9a91a5d3348f None admin] PATH_INFO: `/v3/roles` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:12.146538 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 58/118] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 16 17:06:11 2022] GET /identity/v3/projects/ac5b05cf174a49b0aae4343f1ac0f173 => generated 298 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:06:12.146746 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2726d8f3-996d-44bd-9faf-9a91a5d3348f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:06:12.147214 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2726d8f3-996d-44bd-9faf-9a91a5d3348f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:12.148261 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ee9b3d-b8b0-49f9-a1b3-85f211da2f7c None None] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:12.148710 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ee9b3d-b8b0-49f9-a1b3-85f211da2f7c None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:12.148885 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2726d8f3-996d-44bd-9faf-9a91a5d3348f None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:12.149282 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ee9b3d-b8b0-49f9-a1b3-85f211da2f7c None None] PATH_INFO: `/` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:12.150879 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 59/119] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 17:06:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:06:12.152267 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc0367c-8b91-4aa8-841f-96a8cd7ece79 None None] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:12.152734 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc0367c-8b91-4aa8-841f-96a8cd7ece79 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:12.153228 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc0367c-8b91-4aa8-841f-96a8cd7ece79 None None] PATH_INFO: `/` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:12.155729 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 60/120] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 17:06:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:06:12.160542 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 61/121] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 16 17:06:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:06:12.161564 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc0367c-8b91-4aa8-841f-96a8cd7ece79 None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:12.162083 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b997b4d4-515a-4634-90f4-6e661fbe7d84 None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:12.162651 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b997b4d4-515a-4634-90f4-6e661fbe7d84 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:12.163008 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b997b4d4-515a-4634-90f4-6e661fbe7d84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:12.188942 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-b997b4d4-515a-4634-90f4-6e661fbe7d84 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:06:12.191035 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-b997b4d4-515a-4634-90f4-6e661fbe7d84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:06:12.278038 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 62/122] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 17:06:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 17:06:12.279813 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a9cf60-6255-465f-b98d-b29f58f9f163 None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:12.280184 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a9cf60-6255-465f-b98d-b29f58f9f163 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:12.280526 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a9cf60-6255-465f-b98d-b29f58f9f163 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:12.305209 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc0367c-8b91-4aa8-841f-96a8cd7ece79 None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:12.310437 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-c7a9cf60-6255-465f-b98d-b29f58f9f163 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:06:12.311632 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-c7a9cf60-6255-465f-b98d-b29f58f9f163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:06:12.323400 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:12.345329 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4fa251-13ca-4dab-ae7d-23858b224463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:12.346515 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4fa251-13ca-4dab-ae7d-23858b224463 None admin] REQUEST_METHOD: `PUT` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:12.346985 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4fa251-13ca-4dab-ae7d-23858b224463 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:12.347431 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4fa251-13ca-4dab-ae7d-23858b224463 None admin] PATH_INFO: `/v3/projects/ac5b05cf174a49b0aae4343f1ac0f173/users/ef9bfbcc66f1498383e8c137bc8a81b7/roles/896bff49c5d6464eb612a15f4aa9badc` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:12.349693 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4fa251-13ca-4dab-ae7d-23858b224463 None admin] RBAC: Authorizing `identity:create_grant(project_id=ac5b05cf174a49b0aae4343f1ac0f173, user_id=ef9bfbcc66f1498383e8c137bc8a81b7, role_id=896bff49c5d6464eb612a15f4aa9badc)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:12.351430 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4fa251-13ca-4dab-ae7d-23858b224463 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:12.388933 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 63/123] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 17:06:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 17:06:12.397123 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a9cf60-6255-465f-b98d-b29f58f9f163 None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:12.418994 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 61/124] 10.222.0.39 () {58 vars in 1439 bytes} [Thu Jun 16 17:06:12 2022] PUT /identity/v3/projects/ac5b05cf174a49b0aae4343f1ac0f173/users/ef9bfbcc66f1498383e8c137bc8a81b7/roles/896bff49c5d6464eb612a15f4aa9badc => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:06:12.419875 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4fa251-13ca-4dab-ae7d-23858b224463 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:12.466701 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:12.513698 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a9cf60-6255-465f-b98d-b29f58f9f163 None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:12.539724 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4fa251-13ca-4dab-ae7d-23858b224463 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:12.558623 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dae474a-1e9c-47c3-8281-62973b09e41e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:12.559988 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dae474a-1e9c-47c3-8281-62973b09e41e None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:12.560435 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dae474a-1e9c-47c3-8281-62973b09e41e None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:12.560866 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dae474a-1e9c-47c3-8281-62973b09e41e None admin] PATH_INFO: `/v3/users/338529aa60c34c3887b1c9ec26ad60d8` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:12.562390 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dae474a-1e9c-47c3-8281-62973b09e41e None admin] RBAC: Authorizing `identity:get_user(user_id=338529aa60c34c3887b1c9ec26ad60d8)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:12.564704 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dae474a-1e9c-47c3-8281-62973b09e41e None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:12.566770 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 64/125] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jun 16 17:06:12 2022] GET /identity/v3/users/338529aa60c34c3887b1c9ec26ad60d8 => generated 247 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:06:12.567879 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dae474a-1e9c-47c3-8281-62973b09e41e None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:12.584242 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f830e43b-dcfc-489a-881e-adcfe4a621f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:12.585186 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f830e43b-dcfc-489a-881e-adcfe4a621f0 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:12.585550 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f830e43b-dcfc-489a-881e-adcfe4a621f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:12.585937 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f830e43b-dcfc-489a-881e-adcfe4a621f0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:12.586261 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:12.599451 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f830e43b-dcfc-489a-881e-adcfe4a621f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 17:06:12.607677 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application [None req-f830e43b-dcfc-489a-881e-adcfe4a621f0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 17:06:12.607677 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:06:12.607677 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:06:12.607677 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:06:12.607677 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:06:12.607677 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:06:12.607677 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:06:12.607677 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:06:12.607677 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:06:12.607677 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:06:12.607677 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:06:12.607677 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:06:12.607677 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 17:06:12.607677 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 17:06:12.607677 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 17:06:12.607677 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 17:06:12.608584 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 17:06:12.608584 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 17:06:12.608584 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 17:06:12.608584 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 17:06:12.608584 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:06:12.608584 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:06:12.608584 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:06:12.608584 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:06:12.608584 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:06:12.608584 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:06:12.608584 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:06:12.608584 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application with Lock( Jun 16 17:06:12.608584 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:06:12.608584 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:06:12.608584 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:06:12.608584 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:06:12.609332 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:06:12.609332 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:06:12.609332 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:06:12.609332 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:06:12.609332 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 17:06:12.609332 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 17:06:12.609332 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 17:06:12.609332 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 17:06:12.609332 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 17:06:12.609332 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 17:06:12.609332 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 17:06:12.609332 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Jun 16 17:06:12.614603 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 62/126] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 16 17:06:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:06:12.615225 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f830e43b-dcfc-489a-881e-adcfe4a621f0 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:12.696974 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dae474a-1e9c-47c3-8281-62973b09e41e None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:12.725493 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:12.730679 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f830e43b-dcfc-489a-881e-adcfe4a621f0 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:12.757154 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c867b7e1-2d2e-4e75-a856-f76ee366490d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:12.758593 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c867b7e1-2d2e-4e75-a856-f76ee366490d None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:12.759460 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c867b7e1-2d2e-4e75-a856-f76ee366490d None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:12.760208 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c867b7e1-2d2e-4e75-a856-f76ee366490d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:12.770612 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ba2429-db59-468d-9176-2a2ecb06d193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:12.771493 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ba2429-db59-468d-9176-2a2ecb06d193 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:12.771787 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ba2429-db59-468d-9176-2a2ecb06d193 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:12.772077 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ba2429-db59-468d-9176-2a2ecb06d193 None admin] PATH_INFO: `/v3/projects/ac5b05cf174a49b0aae4343f1ac0f173` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:12.773317 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ba2429-db59-468d-9176-2a2ecb06d193 None admin] RBAC: Authorizing `identity:get_project(project_id=ac5b05cf174a49b0aae4343f1ac0f173)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:12.774823 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ba2429-db59-468d-9176-2a2ecb06d193 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:12.776355 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c867b7e1-2d2e-4e75-a856-f76ee366490d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 17:06:12.776559 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 63/127] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 16 17:06:12 2022] GET /identity/v3/projects/ac5b05cf174a49b0aae4343f1ac0f173 => generated 298 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:06:12.777411 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ba2429-db59-468d-9176-2a2ecb06d193 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:12.794001 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application [None req-c867b7e1-2d2e-4e75-a856-f76ee366490d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 17:06:12.794001 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:06:12.794001 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:06:12.794001 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:06:12.794001 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:06:12.794001 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:06:12.794001 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:06:12.794001 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:06:12.794001 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:06:12.794001 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:06:12.794001 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:06:12.794001 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:06:12.794001 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 17:06:12.794001 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 17:06:12.794001 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 17:06:12.794001 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 17:06:12.794955 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 17:06:12.794955 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 17:06:12.794955 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 17:06:12.794955 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 17:06:12.794955 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:06:12.794955 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:06:12.794955 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:06:12.794955 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:06:12.794955 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:06:12.794955 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:06:12.794955 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:06:12.794955 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application with Lock( Jun 16 17:06:12.794955 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:06:12.794955 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:06:12.794955 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:06:12.794955 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:06:12.795726 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:06:12.795726 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:06:12.795726 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:06:12.795726 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:06:12.795726 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 17:06:12.795726 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 17:06:12.795726 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 17:06:12.795726 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 17:06:12.795726 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 17:06:12.795726 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 17:06:12.795726 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 17:06:12.795726 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Jun 16 17:06:12.795726 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 65/128] 10.222.0.39 () {56 vars in 1114 bytes} [Thu Jun 16 17:06:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:06:12.796389 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c867b7e1-2d2e-4e75-a856-f76ee366490d None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:12.906683 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:12.931490 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ba2429-db59-468d-9176-2a2ecb06d193 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:12.942911 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c867b7e1-2d2e-4e75-a856-f76ee366490d None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:12.980091 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c61a11a-f4ec-43c4-a5d7-e9e25a524244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:12.980867 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c61a11a-f4ec-43c4-a5d7-e9e25a524244 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:12.981170 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c61a11a-f4ec-43c4-a5d7-e9e25a524244 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:12.981558 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c61a11a-f4ec-43c4-a5d7-e9e25a524244 None admin] PATH_INFO: `/v3/roles` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:12.982538 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c61a11a-f4ec-43c4-a5d7-e9e25a524244 None admin] RBAC: Adding query filter params (name=member) {{(pid=80873) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:06:12.982861 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c61a11a-f4ec-43c4-a5d7-e9e25a524244 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:12.983316 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf1c6ae-6108-4b8b-a2a4-6ed7aff7d93f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:12.984266 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c61a11a-f4ec-43c4-a5d7-e9e25a524244 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:12.984665 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf1c6ae-6108-4b8b-a2a4-6ed7aff7d93f None admin] REQUEST_METHOD: `PUT` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:12.985747 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf1c6ae-6108-4b8b-a2a4-6ed7aff7d93f None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:12.986289 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf1c6ae-6108-4b8b-a2a4-6ed7aff7d93f None admin] PATH_INFO: `/v3/projects/ac5b05cf174a49b0aae4343f1ac0f173/users/338529aa60c34c3887b1c9ec26ad60d8/roles/dba744f8ab2a4c45b9d3212f8d203aba` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:12.990042 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf1c6ae-6108-4b8b-a2a4-6ed7aff7d93f None admin] RBAC: Authorizing `identity:create_grant(project_id=ac5b05cf174a49b0aae4343f1ac0f173, user_id=338529aa60c34c3887b1c9ec26ad60d8, role_id=dba744f8ab2a4c45b9d3212f8d203aba)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:12.991767 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf1c6ae-6108-4b8b-a2a4-6ed7aff7d93f None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:12.997794 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 64/129] 10.222.0.39 () {56 vars in 1101 bytes} [Thu Jun 16 17:06:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:06:12.997794 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c61a11a-f4ec-43c4-a5d7-e9e25a524244 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:13.028520 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:13.103321 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c61a11a-f4ec-43c4-a5d7-e9e25a524244 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:13.138216 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5a6333-0d83-4878-a1ec-ada112f66b79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:13.138902 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5a6333-0d83-4878-a1ec-ada112f66b79 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:13.139197 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5a6333-0d83-4878-a1ec-ada112f66b79 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:13.139487 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5a6333-0d83-4878-a1ec-ada112f66b79 None admin] PATH_INFO: `/v3/roles` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:13.140251 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5a6333-0d83-4878-a1ec-ada112f66b79 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80873) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:06:13.140574 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5a6333-0d83-4878-a1ec-ada112f66b79 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:13.141999 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5a6333-0d83-4878-a1ec-ada112f66b79 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:13.165861 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 65/130] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 16 17:06:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:06:13.165861 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5a6333-0d83-4878-a1ec-ada112f66b79 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:13.166118 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 66/131] 10.222.0.39 () {58 vars in 1439 bytes} [Thu Jun 16 17:06:12 2022] PUT /identity/v3/projects/ac5b05cf174a49b0aae4343f1ac0f173/users/338529aa60c34c3887b1c9ec26ad60d8/roles/dba744f8ab2a4c45b9d3212f8d203aba => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:06:13.167468 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf1c6ae-6108-4b8b-a2a4-6ed7aff7d93f None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:13.259196 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:13.282388 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5a6333-0d83-4878-a1ec-ada112f66b79 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:13.368243 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d09c77d-1e0d-436b-a55c-60b22cf1612b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:13.369137 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d09c77d-1e0d-436b-a55c-60b22cf1612b None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:13.369427 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d09c77d-1e0d-436b-a55c-60b22cf1612b None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:13.369706 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d09c77d-1e0d-436b-a55c-60b22cf1612b None admin] PATH_INFO: `/v3/users/ef9bfbcc66f1498383e8c137bc8a81b7` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:13.372143 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d09c77d-1e0d-436b-a55c-60b22cf1612b None admin] RBAC: Authorizing `identity:get_user(user_id=ef9bfbcc66f1498383e8c137bc8a81b7)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:13.373590 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d09c77d-1e0d-436b-a55c-60b22cf1612b None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:13.375267 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 66/132] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jun 16 17:06:13 2022] GET /identity/v3/users/ef9bfbcc66f1498383e8c137bc8a81b7 => generated 275 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:06:13.381210 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13015776-0a65-4beb-a75d-c0e0ff5de4ad None None] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:13.381503 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13015776-0a65-4beb-a75d-c0e0ff5de4ad None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:13.381819 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13015776-0a65-4beb-a75d-c0e0ff5de4ad None None] PATH_INFO: `/` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:13.383275 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 67/133] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 17:06:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:06:13.384386 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13015776-0a65-4beb-a75d-c0e0ff5de4ad None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:13.387312 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf1c6ae-6108-4b8b-a2a4-6ed7aff7d93f None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:13.425250 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:13.430638 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92ddb45-5472-4cbf-b0f0-d161d597f412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:13.431529 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92ddb45-5472-4cbf-b0f0-d161d597f412 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:13.431818 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92ddb45-5472-4cbf-b0f0-d161d597f412 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:13.432099 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92ddb45-5472-4cbf-b0f0-d161d597f412 None admin] PATH_INFO: `/v3/users/ef9bfbcc66f1498383e8c137bc8a81b7` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:13.434109 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92ddb45-5472-4cbf-b0f0-d161d597f412 None admin] RBAC: Authorizing `identity:get_user(user_id=ef9bfbcc66f1498383e8c137bc8a81b7)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:13.435729 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92ddb45-5472-4cbf-b0f0-d161d597f412 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:13.437406 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 67/134] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jun 16 17:06:13 2022] GET /identity/v3/users/ef9bfbcc66f1498383e8c137bc8a81b7 => generated 275 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:06:13.439160 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6447b32a-fb1e-46cf-ac5b-850a33ed67f7 None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:13.441644 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6447b32a-fb1e-46cf-ac5b-850a33ed67f7 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:13.441644 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6447b32a-fb1e-46cf-ac5b-850a33ed67f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:13.470666 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-6447b32a-fb1e-46cf-ac5b-850a33ed67f7 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:06:13.471963 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-6447b32a-fb1e-46cf-ac5b-850a33ed67f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:06:13.527539 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13015776-0a65-4beb-a75d-c0e0ff5de4ad None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:13.566192 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1240f583-a4ab-474a-80aa-6ac39bb4ed6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:13.567513 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1240f583-a4ab-474a-80aa-6ac39bb4ed6f None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:13.568020 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1240f583-a4ab-474a-80aa-6ac39bb4ed6f None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:13.568508 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1240f583-a4ab-474a-80aa-6ac39bb4ed6f None admin] PATH_INFO: `/v3/projects/590e405fe8a64179bcedf55b5577f0b1` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:13.570014 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1240f583-a4ab-474a-80aa-6ac39bb4ed6f None admin] RBAC: Authorizing `identity:get_project(project_id=590e405fe8a64179bcedf55b5577f0b1)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:13.572279 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1240f583-a4ab-474a-80aa-6ac39bb4ed6f None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:13.574755 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 68/135] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 16 17:06:13 2022] GET /identity/v3/projects/590e405fe8a64179bcedf55b5577f0b1 => generated 312 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:06:13.576153 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1240f583-a4ab-474a-80aa-6ac39bb4ed6f None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:13.630140 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:13.688180 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 68/136] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 17:06:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 17:06:13.688819 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6447b32a-fb1e-46cf-ac5b-850a33ed67f7 None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:13.697125 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1240f583-a4ab-474a-80aa-6ac39bb4ed6f None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:13.736313 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518d0fba-fb0c-41d9-9da4-287430c7d246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:13.738524 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518d0fba-fb0c-41d9-9da4-287430c7d246 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:13.739036 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518d0fba-fb0c-41d9-9da4-287430c7d246 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:13.739526 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518d0fba-fb0c-41d9-9da4-287430c7d246 None admin] PATH_INFO: `/v3/projects/ac5b05cf174a49b0aae4343f1ac0f173` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:13.740991 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518d0fba-fb0c-41d9-9da4-287430c7d246 None admin] RBAC: Authorizing `identity:get_project(project_id=ac5b05cf174a49b0aae4343f1ac0f173)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:13.742882 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518d0fba-fb0c-41d9-9da4-287430c7d246 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:13.744828 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 69/137] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 16 17:06:13 2022] GET /identity/v3/projects/ac5b05cf174a49b0aae4343f1ac0f173 => generated 298 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:06:13.746114 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518d0fba-fb0c-41d9-9da4-287430c7d246 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:13.858540 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518d0fba-fb0c-41d9-9da4-287430c7d246 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:13.886145 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:13.899414 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1aa87d-3653-4923-9bc1-e79321a11608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:13.900461 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1aa87d-3653-4923-9bc1-e79321a11608 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:13.906271 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1aa87d-3653-4923-9bc1-e79321a11608 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:13.906271 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1aa87d-3653-4923-9bc1-e79321a11608 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:13.906271 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1aa87d-3653-4923-9bc1-e79321a11608 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:13.906271 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1aa87d-3653-4923-9bc1-e79321a11608 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:13.906271 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 70/138] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 17:06:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:06:13.908224 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1aa87d-3653-4923-9bc1-e79321a11608 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:14.022102 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1aa87d-3653-4923-9bc1-e79321a11608 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:14.060655 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d93e36-c447-4de1-83be-9fec12d5783b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:14.061966 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d93e36-c447-4de1-83be-9fec12d5783b None admin] REQUEST_METHOD: `PUT` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:14.062471 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d93e36-c447-4de1-83be-9fec12d5783b None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:14.063350 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d93e36-c447-4de1-83be-9fec12d5783b None admin] PATH_INFO: `/v3/projects/ac5b05cf174a49b0aae4343f1ac0f173/users/ef9bfbcc66f1498383e8c137bc8a81b7/roles/9331b396c9894ab88267e7b82ef6f224` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:14.065911 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d93e36-c447-4de1-83be-9fec12d5783b None admin] RBAC: Authorizing `identity:create_grant(project_id=ac5b05cf174a49b0aae4343f1ac0f173, user_id=ef9bfbcc66f1498383e8c137bc8a81b7, role_id=9331b396c9894ab88267e7b82ef6f224)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:14.067745 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d93e36-c447-4de1-83be-9fec12d5783b None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:14.081610 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6447b32a-fb1e-46cf-ac5b-850a33ed67f7 None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:14.119304 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:14.126525 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa28d84a-37ab-4422-acd4-6b852f21d587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:14.127821 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa28d84a-37ab-4422-acd4-6b852f21d587 None admin] REQUEST_METHOD: `PUT` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:14.128328 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa28d84a-37ab-4422-acd4-6b852f21d587 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:14.128894 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa28d84a-37ab-4422-acd4-6b852f21d587 None admin] PATH_INFO: `/v3/projects/590e405fe8a64179bcedf55b5577f0b1/users/ef9bfbcc66f1498383e8c137bc8a81b7/roles/896bff49c5d6464eb612a15f4aa9badc` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:14.131417 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa28d84a-37ab-4422-acd4-6b852f21d587 None admin] RBAC: Authorizing `identity:create_grant(project_id=590e405fe8a64179bcedf55b5577f0b1, user_id=ef9bfbcc66f1498383e8c137bc8a81b7, role_id=896bff49c5d6464eb612a15f4aa9badc)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:14.133208 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa28d84a-37ab-4422-acd4-6b852f21d587 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:14.171146 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 71/139] 10.222.0.39 () {58 vars in 1439 bytes} [Thu Jun 16 17:06:13 2022] PUT /identity/v3/projects/ac5b05cf174a49b0aae4343f1ac0f173/users/ef9bfbcc66f1498383e8c137bc8a81b7/roles/9331b396c9894ab88267e7b82ef6f224 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:06:14.173150 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d93e36-c447-4de1-83be-9fec12d5783b None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:14.204340 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:14.292914 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 69/140] 10.222.0.39 () {58 vars in 1439 bytes} [Thu Jun 16 17:06:13 2022] PUT /identity/v3/projects/590e405fe8a64179bcedf55b5577f0b1/users/ef9bfbcc66f1498383e8c137bc8a81b7/roles/896bff49c5d6464eb612a15f4aa9badc => generated 0 bytes in 604 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:06:14.294575 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9453eb73-110f-4425-a3ee-bdd0c9500839 None None] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:14.294926 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9453eb73-110f-4425-a3ee-bdd0c9500839 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:14.295219 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9453eb73-110f-4425-a3ee-bdd0c9500839 None None] PATH_INFO: `/` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:14.295998 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d93e36-c447-4de1-83be-9fec12d5783b None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:14.310667 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 70/141] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 17:06:14 2022] GET /identity => generated 270 bytes in 17 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:06:14.317450 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba41623e-962c-4f92-8455-359d259dadcd None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:14.317778 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba41623e-962c-4f92-8455-359d259dadcd None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:14.318092 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba41623e-962c-4f92-8455-359d259dadcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:14.352273 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-ba41623e-962c-4f92-8455-359d259dadcd None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:06:14.353791 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-ba41623e-962c-4f92-8455-359d259dadcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:06:14.366546 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a677dd-8a46-4bd5-8500-d4e3f907ceb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:14.367247 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a677dd-8a46-4bd5-8500-d4e3f907ceb8 None admin] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:14.367541 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a677dd-8a46-4bd5-8500-d4e3f907ceb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:14.373998 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a677dd-8a46-4bd5-8500-d4e3f907ceb8 None admin] PATH_INFO: `/v3/users` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:14.373998 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a677dd-8a46-4bd5-8500-d4e3f907ceb8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:14.373998 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a677dd-8a46-4bd5-8500-d4e3f907ceb8 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:14.457718 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 71/142] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 17:06:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 17:06:14.481525 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 72/143] 10.222.0.39 () {60 vars in 1132 bytes} [Thu Jun 16 17:06:14 2022] POST /identity/v3/users => generated 283 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:06:14.504002 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba41623e-962c-4f92-8455-359d259dadcd None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:14.640430 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba41623e-962c-4f92-8455-359d259dadcd None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:14.668144 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:14.686437 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c1379f-a56c-4e82-ad48-88d1598ee758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:14.687281 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c1379f-a56c-4e82-ad48-88d1598ee758 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:14.687574 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c1379f-a56c-4e82-ad48-88d1598ee758 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:14.687859 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c1379f-a56c-4e82-ad48-88d1598ee758 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:14.701636 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c1379f-a56c-4e82-ad48-88d1598ee758 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 17:06:14.710428 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application [None req-b2c1379f-a56c-4e82-ad48-88d1598ee758 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 17:06:14.710428 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:06:14.710428 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:06:14.710428 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:06:14.710428 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:06:14.710428 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:06:14.710428 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:06:14.710428 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:06:14.710428 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:06:14.710428 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:06:14.710428 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:06:14.710428 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:06:14.710428 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 17:06:14.710428 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 17:06:14.710428 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 17:06:14.710428 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 17:06:14.711301 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 17:06:14.711301 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 17:06:14.711301 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 17:06:14.711301 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 17:06:14.711301 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:06:14.711301 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:06:14.711301 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:06:14.711301 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:06:14.711301 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:06:14.711301 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:06:14.711301 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:06:14.711301 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application with Lock( Jun 16 17:06:14.711301 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:06:14.711301 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:06:14.711301 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:06:14.711301 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:06:14.713474 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:06:14.713474 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:06:14.713474 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:06:14.713474 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:06:14.713474 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 17:06:14.713474 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 17:06:14.713474 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 17:06:14.713474 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 17:06:14.713474 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 17:06:14.713474 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 17:06:14.713474 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 17:06:14.713474 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Jun 16 17:06:14.713474 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 72/144] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 16 17:06:14 2022] GET /identity/v3/roles/reader => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:06:14.718364 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a677dd-8a46-4bd5-8500-d4e3f907ceb8 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:14.821610 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:14.846650 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a677dd-8a46-4bd5-8500-d4e3f907ceb8 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:14.896270 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34049419-b967-4130-9386-c40ccb9e5552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:14.896975 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34049419-b967-4130-9386-c40ccb9e5552 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:14.897270 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34049419-b967-4130-9386-c40ccb9e5552 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:14.897549 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34049419-b967-4130-9386-c40ccb9e5552 None admin] PATH_INFO: `/v3/roles` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:14.898347 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34049419-b967-4130-9386-c40ccb9e5552 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80873) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:06:14.898660 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34049419-b967-4130-9386-c40ccb9e5552 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:14.900052 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34049419-b967-4130-9386-c40ccb9e5552 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:14.917611 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 73/145] 10.222.0.39 () {56 vars in 1101 bytes} [Thu Jun 16 17:06:14 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:06:14.924031 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c1379f-a56c-4e82-ad48-88d1598ee758 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:15.083660 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c1379f-a56c-4e82-ad48-88d1598ee758 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:15.132153 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3212739b-d657-4e63-9126-e8f3ffc43a2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:15.133040 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3212739b-d657-4e63-9126-e8f3ffc43a2b None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:15.133330 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3212739b-d657-4e63-9126-e8f3ffc43a2b None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:15.133613 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3212739b-d657-4e63-9126-e8f3ffc43a2b None admin] PATH_INFO: `/v3/users/1fef9400dc574700a67fee19442404b8` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:15.134864 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3212739b-d657-4e63-9126-e8f3ffc43a2b None admin] RBAC: Authorizing `identity:get_user(user_id=1fef9400dc574700a67fee19442404b8)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:15.136309 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3212739b-d657-4e63-9126-e8f3ffc43a2b None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:15.137964 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 73/146] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jun 16 17:06:14 2022] GET /identity/v3/users/1fef9400dc574700a67fee19442404b8 => generated 289 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:06:15.144328 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34049419-b967-4130-9386-c40ccb9e5552 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:15.278235 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34049419-b967-4130-9386-c40ccb9e5552 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:15.320970 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ea7e69-ee94-43bb-9c34-5ef151256101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:15.321881 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ea7e69-ee94-43bb-9c34-5ef151256101 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:15.322174 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ea7e69-ee94-43bb-9c34-5ef151256101 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:15.322458 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ea7e69-ee94-43bb-9c34-5ef151256101 None admin] PATH_INFO: `/v3/projects/ac5b05cf174a49b0aae4343f1ac0f173` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:15.323771 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ea7e69-ee94-43bb-9c34-5ef151256101 None admin] RBAC: Authorizing `identity:get_project(project_id=ac5b05cf174a49b0aae4343f1ac0f173)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:15.325341 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ea7e69-ee94-43bb-9c34-5ef151256101 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:15.327106 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 74/147] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 16 17:06:15 2022] GET /identity/v3/projects/ac5b05cf174a49b0aae4343f1ac0f173 => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 17:06:15.333171 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3212739b-d657-4e63-9126-e8f3ffc43a2b None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:15.395028 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:15.457200 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3212739b-d657-4e63-9126-e8f3ffc43a2b None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:15.496263 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608615a4-a5fa-42e2-bbd3-9d89c6849ef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:15.497223 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608615a4-a5fa-42e2-bbd3-9d89c6849ef2 None admin] REQUEST_METHOD: `PUT` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:15.497520 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608615a4-a5fa-42e2-bbd3-9d89c6849ef2 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:15.497861 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608615a4-a5fa-42e2-bbd3-9d89c6849ef2 None admin] PATH_INFO: `/v3/projects/ac5b05cf174a49b0aae4343f1ac0f173/users/1fef9400dc574700a67fee19442404b8/roles/74b3015ca91b437f8d6ee242563b6547` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:15.499904 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608615a4-a5fa-42e2-bbd3-9d89c6849ef2 None admin] RBAC: Authorizing `identity:create_grant(project_id=ac5b05cf174a49b0aae4343f1ac0f173, user_id=1fef9400dc574700a67fee19442404b8, role_id=74b3015ca91b437f8d6ee242563b6547)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:15.502077 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608615a4-a5fa-42e2-bbd3-9d89c6849ef2 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:15.595827 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 74/148] 10.222.0.39 () {58 vars in 1439 bytes} [Thu Jun 16 17:06:15 2022] PUT /identity/v3/projects/ac5b05cf174a49b0aae4343f1ac0f173/users/1fef9400dc574700a67fee19442404b8/roles/74b3015ca91b437f8d6ee242563b6547 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:06:15.636907 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d394b866-1cf8-4228-ac71-8eef4f0601fa None None] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:15.637212 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d394b866-1cf8-4228-ac71-8eef4f0601fa None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:15.637475 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d394b866-1cf8-4228-ac71-8eef4f0601fa None None] PATH_INFO: `/` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:15.638951 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 75/149] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 17:06:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:06:15.645274 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6213ecbb-2622-4e8f-b20a-4a441641033f None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:15.645549 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6213ecbb-2622-4e8f-b20a-4a441641033f None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:15.645800 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6213ecbb-2622-4e8f-b20a-4a441641033f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:15.666182 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-6213ecbb-2622-4e8f-b20a-4a441641033f None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:06:15.667435 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-6213ecbb-2622-4e8f-b20a-4a441641033f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:06:15.744994 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 75/150] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 17:06:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 17:06:15.769115 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d394b866-1cf8-4228-ac71-8eef4f0601fa None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:15.781500 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:15.890309 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d394b866-1cf8-4228-ac71-8eef4f0601fa None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:15.940225 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97554967-fdfd-4a72-8736-e4f3c4dd60b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:15.941006 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97554967-fdfd-4a72-8736-e4f3c4dd60b6 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:15.941329 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97554967-fdfd-4a72-8736-e4f3c4dd60b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:15.941616 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97554967-fdfd-4a72-8736-e4f3c4dd60b6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:15.960141 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97554967-fdfd-4a72-8736-e4f3c4dd60b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 17:06:15.968188 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application [None req-97554967-fdfd-4a72-8736-e4f3c4dd60b6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 17:06:15.968188 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:06:15.968188 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:06:15.968188 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:06:15.968188 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:06:15.968188 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:06:15.968188 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:06:15.968188 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:06:15.968188 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:06:15.968188 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:06:15.968188 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:06:15.968188 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:06:15.968188 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 17:06:15.968188 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 17:06:15.968188 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 17:06:15.968188 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 17:06:15.969162 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 17:06:15.969162 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 17:06:15.969162 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 17:06:15.969162 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 17:06:15.969162 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:06:15.969162 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:06:15.969162 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:06:15.969162 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:06:15.969162 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:06:15.969162 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:06:15.969162 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:06:15.969162 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application with Lock( Jun 16 17:06:15.969162 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:06:15.969162 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:06:15.969162 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:06:15.969162 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:06:15.970715 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:06:15.970715 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:06:15.970715 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:06:15.970715 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:06:15.970715 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 17:06:15.970715 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 17:06:15.970715 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 17:06:15.970715 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 17:06:15.970715 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 17:06:15.970715 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 17:06:15.970715 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 17:06:15.970715 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Jun 16 17:06:15.970715 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 76/151] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 16 17:06:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:06:15.979326 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6213ecbb-2622-4e8f-b20a-4a441641033f None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:16.036848 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:16.100734 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6213ecbb-2622-4e8f-b20a-4a441641033f None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:16.130147 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c626c4-4255-42e0-b7ca-ffbe98044dc1 None None] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:16.130439 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c626c4-4255-42e0-b7ca-ffbe98044dc1 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:16.130707 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c626c4-4255-42e0-b7ca-ffbe98044dc1 None None] PATH_INFO: `/` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:16.132094 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 77/152] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 17:06:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:06:16.143206 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce38f9f0-4ed4-461b-8c78-f0310275333e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:16.143881 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce38f9f0-4ed4-461b-8c78-f0310275333e None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:16.144163 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce38f9f0-4ed4-461b-8c78-f0310275333e None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:16.144496 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce38f9f0-4ed4-461b-8c78-f0310275333e None admin] PATH_INFO: `/v3/roles` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:16.145291 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce38f9f0-4ed4-461b-8c78-f0310275333e None admin] RBAC: Adding query filter params (name=member) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:06:16.145597 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce38f9f0-4ed4-461b-8c78-f0310275333e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:16.147160 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce38f9f0-4ed4-461b-8c78-f0310275333e None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:16.148563 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beaf65a-8962-4200-b2e0-f26a96cc5e9b None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:16.148853 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beaf65a-8962-4200-b2e0-f26a96cc5e9b None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:16.149126 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beaf65a-8962-4200-b2e0-f26a96cc5e9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:16.172127 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 76/153] 10.222.0.39 () {56 vars in 1101 bytes} [Thu Jun 16 17:06:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:06:16.175814 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-2beaf65a-8962-4200-b2e0-f26a96cc5e9b None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:06:16.177037 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-2beaf65a-8962-4200-b2e0-f26a96cc5e9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:06:16.178325 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce38f9f0-4ed4-461b-8c78-f0310275333e None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:16.286228 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:16.289032 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce38f9f0-4ed4-461b-8c78-f0310275333e None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:16.310153 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:16.319349 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 78/154] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 17:06:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 17:06:16.327131 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af009709-8a3e-481b-8acb-aba9aac37310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:16.328018 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af009709-8a3e-481b-8acb-aba9aac37310 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:16.328303 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af009709-8a3e-481b-8acb-aba9aac37310 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:16.328684 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af009709-8a3e-481b-8acb-aba9aac37310 None admin] PATH_INFO: `/v3/users/ef9bfbcc66f1498383e8c137bc8a81b7` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:16.330537 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af009709-8a3e-481b-8acb-aba9aac37310 None admin] RBAC: Authorizing `identity:get_user(user_id=ef9bfbcc66f1498383e8c137bc8a81b7)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:16.332106 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af009709-8a3e-481b-8acb-aba9aac37310 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:16.334944 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 77/155] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jun 16 17:06:16 2022] GET /identity/v3/users/ef9bfbcc66f1498383e8c137bc8a81b7 => generated 275 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 17:06:16.340470 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2beaf65a-8962-4200-b2e0-f26a96cc5e9b None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:16.366853 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af009709-8a3e-481b-8acb-aba9aac37310 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:16.517433 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af009709-8a3e-481b-8acb-aba9aac37310 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:16.569785 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a84918b-9a24-4e11-9eea-9b33e40d6c8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:16.570576 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a84918b-9a24-4e11-9eea-9b33e40d6c8a None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:16.570869 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a84918b-9a24-4e11-9eea-9b33e40d6c8a None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:16.571150 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a84918b-9a24-4e11-9eea-9b33e40d6c8a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:16.592969 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a84918b-9a24-4e11-9eea-9b33e40d6c8a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 17:06:16.608352 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application [None req-2a84918b-9a24-4e11-9eea-9b33e40d6c8a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 17:06:16.608352 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:06:16.608352 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:06:16.608352 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:06:16.608352 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:06:16.608352 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:06:16.608352 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:06:16.608352 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:06:16.608352 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:06:16.608352 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:06:16.608352 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:06:16.608352 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:06:16.608352 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 17:06:16.608352 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 17:06:16.608352 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 17:06:16.608352 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 17:06:16.609279 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 17:06:16.609279 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 17:06:16.609279 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 17:06:16.609279 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 17:06:16.609279 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:06:16.609279 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:06:16.609279 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:06:16.609279 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:06:16.609279 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:06:16.609279 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:06:16.609279 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:06:16.609279 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application with Lock( Jun 16 17:06:16.609279 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:06:16.609279 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:06:16.609279 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:06:16.609279 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:06:16.611375 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:06:16.611375 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:06:16.611375 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:06:16.611375 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:06:16.611375 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 17:06:16.611375 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 17:06:16.611375 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 17:06:16.611375 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 17:06:16.611375 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 17:06:16.611375 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 17:06:16.611375 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 17:06:16.611375 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Jun 16 17:06:16.611375 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 78/156] 10.222.0.39 () {56 vars in 1096 bytes} [Thu Jun 16 17:06:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:06:16.615911 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a84918b-9a24-4e11-9eea-9b33e40d6c8a None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:16.616775 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2beaf65a-8962-4200-b2e0-f26a96cc5e9b None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:16.658190 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:16.736408 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071c9775-bda5-4fca-9403-dd9ab32ebc65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:16.737585 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071c9775-bda5-4fca-9403-dd9ab32ebc65 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:16.738107 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071c9775-bda5-4fca-9403-dd9ab32ebc65 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:16.738608 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071c9775-bda5-4fca-9403-dd9ab32ebc65 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:16.815695 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a84918b-9a24-4e11-9eea-9b33e40d6c8a None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:16.904395 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cacc9ad-f06c-4ae8-9b94-cbeaa5bff1d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:16.905089 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cacc9ad-f06c-4ae8-9b94-cbeaa5bff1d2 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:16.905385 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cacc9ad-f06c-4ae8-9b94-cbeaa5bff1d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:16.905675 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cacc9ad-f06c-4ae8-9b94-cbeaa5bff1d2 None admin] PATH_INFO: `/v3/roles` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:16.907101 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cacc9ad-f06c-4ae8-9b94-cbeaa5bff1d2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:06:16.907439 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cacc9ad-f06c-4ae8-9b94-cbeaa5bff1d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:16.909015 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cacc9ad-f06c-4ae8-9b94-cbeaa5bff1d2 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:16.910121 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:16.911391 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071c9775-bda5-4fca-9403-dd9ab32ebc65 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:16.913119 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071c9775-bda5-4fca-9403-dd9ab32ebc65 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:16.926982 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 79/157] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 16 17:06:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 17:06:16.932212 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cacc9ad-f06c-4ae8-9b94-cbeaa5bff1d2 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:17.105151 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:17.117321 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cacc9ad-f06c-4ae8-9b94-cbeaa5bff1d2 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:17.138059 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 79/158] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 16 17:06:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 798 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 17:06:17.145418 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071c9775-bda5-4fca-9403-dd9ab32ebc65 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:17.179797 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760ea01f-d42f-4515-b972-716c93c0493c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:17.180695 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760ea01f-d42f-4515-b972-716c93c0493c None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:17.180991 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760ea01f-d42f-4515-b972-716c93c0493c None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:17.181279 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760ea01f-d42f-4515-b972-716c93c0493c None admin] PATH_INFO: `/v3/users/338529aa60c34c3887b1c9ec26ad60d8` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:17.183595 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760ea01f-d42f-4515-b972-716c93c0493c None admin] RBAC: Authorizing `identity:get_user(user_id=338529aa60c34c3887b1c9ec26ad60d8)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:17.185065 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760ea01f-d42f-4515-b972-716c93c0493c None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:17.187235 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 80/159] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jun 16 17:06:16 2022] GET /identity/v3/users/338529aa60c34c3887b1c9ec26ad60d8 => generated 247 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 17:06:17.196412 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760ea01f-d42f-4515-b972-716c93c0493c None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:17.327876 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:17.335323 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071c9775-bda5-4fca-9403-dd9ab32ebc65 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:17.401123 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfbd289-9219-4c96-a342-d34cf169bde5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:17.402350 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfbd289-9219-4c96-a342-d34cf169bde5 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:17.402839 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfbd289-9219-4c96-a342-d34cf169bde5 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:17.403393 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfbd289-9219-4c96-a342-d34cf169bde5 None admin] PATH_INFO: `/v3/projects/ac5b05cf174a49b0aae4343f1ac0f173` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:17.407909 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfbd289-9219-4c96-a342-d34cf169bde5 None admin] RBAC: Authorizing `identity:get_project(project_id=ac5b05cf174a49b0aae4343f1ac0f173)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:17.409689 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfbd289-9219-4c96-a342-d34cf169bde5 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:17.411783 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 80/160] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 16 17:06:17 2022] GET /identity/v3/projects/ac5b05cf174a49b0aae4343f1ac0f173 => generated 298 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 17:06:17.414303 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760ea01f-d42f-4515-b972-716c93c0493c None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:17.418180 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfbd289-9219-4c96-a342-d34cf169bde5 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:17.491424 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab22eb44-3818-4fc6-8f24-3c3e112fb42c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:17.492127 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab22eb44-3818-4fc6-8f24-3c3e112fb42c None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:17.492416 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab22eb44-3818-4fc6-8f24-3c3e112fb42c None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:17.492697 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab22eb44-3818-4fc6-8f24-3c3e112fb42c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:17.557211 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:17.605216 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfbd289-9219-4c96-a342-d34cf169bde5 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:17.645338 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab22eb44-3818-4fc6-8f24-3c3e112fb42c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:17.647268 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab22eb44-3818-4fc6-8f24-3c3e112fb42c None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:17.664426 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04477719-e16c-4a10-bf3f-c494f172c59d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:17.665272 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04477719-e16c-4a10-bf3f-c494f172c59d None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:17.665827 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04477719-e16c-4a10-bf3f-c494f172c59d None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:17.666341 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04477719-e16c-4a10-bf3f-c494f172c59d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:17.667434 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04477719-e16c-4a10-bf3f-c494f172c59d None admin] RBAC: Adding query filter params (role.id=896bff49c5d6464eb612a15f4aa9badc, scope.project.id=ac5b05cf174a49b0aae4343f1ac0f173, user.id=ef9bfbcc66f1498383e8c137bc8a81b7) {{(pid=80873) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:06:17.667982 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04477719-e16c-4a10-bf3f-c494f172c59d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:17.669685 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04477719-e16c-4a10-bf3f-c494f172c59d None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:17.682519 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 81/161] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jun 16 17:06:17 2022] GET /identity/v3/role_assignments?user.id=ef9bfbcc66f1498383e8c137bc8a81b7&scope.project.id=ac5b05cf174a49b0aae4343f1ac0f173&role.id=896bff49c5d6464eb612a15f4aa9badc => generated 608 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:06:17.806129 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 81/162] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 16 17:06:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 610 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 16 17:06:17.812289 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04477719-e16c-4a10-bf3f-c494f172c59d None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:17.866871 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:17.979016 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04477719-e16c-4a10-bf3f-c494f172c59d None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:18.020597 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e67e33b-3273-4a18-95f3-eacaaa2f4883 None None] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:18.021228 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e67e33b-3273-4a18-95f3-eacaaa2f4883 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:18.021626 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e67e33b-3273-4a18-95f3-eacaaa2f4883 None None] PATH_INFO: `/` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:18.024328 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 82/163] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 17:06:18 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 17:06:18.030809 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695ff0c1-9197-4f11-bda3-c5b083b6c995 None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:18.031096 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695ff0c1-9197-4f11-bda3-c5b083b6c995 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:18.031386 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695ff0c1-9197-4f11-bda3-c5b083b6c995 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:18.063833 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-695ff0c1-9197-4f11-bda3-c5b083b6c995 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:06:18.065058 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-695ff0c1-9197-4f11-bda3-c5b083b6c995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:06:18.069510 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5760b67f-8ae9-48f0-9557-20be10e77d33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:18.070540 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5760b67f-8ae9-48f0-9557-20be10e77d33 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:18.070828 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5760b67f-8ae9-48f0-9557-20be10e77d33 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:18.071159 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5760b67f-8ae9-48f0-9557-20be10e77d33 None admin] PATH_INFO: `/v3/projects/ac5b05cf174a49b0aae4343f1ac0f173` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:18.073169 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5760b67f-8ae9-48f0-9557-20be10e77d33 None admin] RBAC: Authorizing `identity:get_project(project_id=ac5b05cf174a49b0aae4343f1ac0f173)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:18.074671 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5760b67f-8ae9-48f0-9557-20be10e77d33 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:18.076601 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 82/164] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 16 17:06:17 2022] GET /identity/v3/projects/ac5b05cf174a49b0aae4343f1ac0f173 => generated 298 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:06:18.096256 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5760b67f-8ae9-48f0-9557-20be10e77d33 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:18.184030 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:18.215464 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 83/165] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 17:06:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 17:06:18.257381 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695ff0c1-9197-4f11-bda3-c5b083b6c995 None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:18.318151 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:18.323743 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5760b67f-8ae9-48f0-9557-20be10e77d33 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:18.403722 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695ff0c1-9197-4f11-bda3-c5b083b6c995 None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:18.405562 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc32e898-3d17-4714-839f-e73117e5e61a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:18.406273 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc32e898-3d17-4714-839f-e73117e5e61a None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:18.407100 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc32e898-3d17-4714-839f-e73117e5e61a None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:18.407493 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc32e898-3d17-4714-839f-e73117e5e61a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:18.408399 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc32e898-3d17-4714-839f-e73117e5e61a None admin] RBAC: Adding query filter params (role.id=dba744f8ab2a4c45b9d3212f8d203aba, scope.project.id=ac5b05cf174a49b0aae4343f1ac0f173, user.id=338529aa60c34c3887b1c9ec26ad60d8) {{(pid=80873) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:06:18.408732 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc32e898-3d17-4714-839f-e73117e5e61a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:18.410323 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc32e898-3d17-4714-839f-e73117e5e61a None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:18.432056 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 83/166] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jun 16 17:06:18 2022] GET /identity/v3/role_assignments?user.id=338529aa60c34c3887b1c9ec26ad60d8&scope.project.id=ac5b05cf174a49b0aae4343f1ac0f173&role.id=dba744f8ab2a4c45b9d3212f8d203aba => generated 608 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 17:06:18.461239 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b1f205-b9c3-4db4-9524-f88d0f6ff4f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:18.462105 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b1f205-b9c3-4db4-9524-f88d0f6ff4f4 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:18.462391 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b1f205-b9c3-4db4-9524-f88d0f6ff4f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:18.462670 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b1f205-b9c3-4db4-9524-f88d0f6ff4f4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:18.484436 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b1f205-b9c3-4db4-9524-f88d0f6ff4f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 17:06:18.493478 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application [None req-28b1f205-b9c3-4db4-9524-f88d0f6ff4f4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 17:06:18.493478 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:06:18.493478 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:06:18.493478 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:06:18.493478 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:06:18.493478 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:06:18.493478 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:06:18.493478 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:06:18.493478 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:06:18.493478 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:06:18.493478 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:06:18.493478 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:06:18.493478 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 17:06:18.493478 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 17:06:18.493478 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 17:06:18.493478 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 17:06:18.495171 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 17:06:18.495171 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 17:06:18.495171 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 17:06:18.495171 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 17:06:18.495171 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:06:18.495171 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:06:18.495171 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:06:18.495171 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:06:18.495171 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:06:18.495171 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:06:18.495171 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:06:18.495171 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application with Lock( Jun 16 17:06:18.495171 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:06:18.495171 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:06:18.495171 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:06:18.495171 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:06:18.496901 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:06:18.496901 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:06:18.496901 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:06:18.496901 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:06:18.496901 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 17:06:18.496901 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 17:06:18.496901 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 17:06:18.496901 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 17:06:18.496901 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 17:06:18.496901 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 17:06:18.496901 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 17:06:18.496901 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Jun 16 17:06:18.496901 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 84/167] 10.222.0.39 () {56 vars in 1114 bytes} [Thu Jun 16 17:06:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 17:06:18.513430 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc32e898-3d17-4714-839f-e73117e5e61a None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:18.667427 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc32e898-3d17-4714-839f-e73117e5e61a None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:18.721254 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5d0359-a41b-4398-bb61-b75ec85f6162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:18.721974 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5d0359-a41b-4398-bb61-b75ec85f6162 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:18.722266 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5d0359-a41b-4398-bb61-b75ec85f6162 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:18.722551 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5d0359-a41b-4398-bb61-b75ec85f6162 None admin] PATH_INFO: `/v3/roles` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:18.723321 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5d0359-a41b-4398-bb61-b75ec85f6162 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80873) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:06:18.723637 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5d0359-a41b-4398-bb61-b75ec85f6162 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:18.725034 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5d0359-a41b-4398-bb61-b75ec85f6162 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:18.737902 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 84/168] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 16 17:06:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:06:18.743399 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b1f205-b9c3-4db4-9524-f88d0f6ff4f4 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:18.812208 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:18.880290 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b1f205-b9c3-4db4-9524-f88d0f6ff4f4 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:18.918027 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84634386-d3fe-423f-89a7-431a79ec0799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:18.919048 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84634386-d3fe-423f-89a7-431a79ec0799 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:18.919332 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84634386-d3fe-423f-89a7-431a79ec0799 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:18.919618 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84634386-d3fe-423f-89a7-431a79ec0799 None admin] PATH_INFO: `/v3/users/ef9bfbcc66f1498383e8c137bc8a81b7` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:18.926622 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84634386-d3fe-423f-89a7-431a79ec0799 None admin] RBAC: Authorizing `identity:get_user(user_id=ef9bfbcc66f1498383e8c137bc8a81b7)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:18.928136 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84634386-d3fe-423f-89a7-431a79ec0799 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:18.930044 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 85/169] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jun 16 17:06:18 2022] GET /identity/v3/users/ef9bfbcc66f1498383e8c137bc8a81b7 => generated 275 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:06:18.938977 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5d0359-a41b-4398-bb61-b75ec85f6162 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:18.981603 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:19.095957 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5d0359-a41b-4398-bb61-b75ec85f6162 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:19.140384 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464200dc-2799-464c-b0e1-065e0f032984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:19.141654 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464200dc-2799-464c-b0e1-065e0f032984 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:19.141983 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464200dc-2799-464c-b0e1-065e0f032984 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:19.142270 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464200dc-2799-464c-b0e1-065e0f032984 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:19.225110 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464200dc-2799-464c-b0e1-065e0f032984 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:19.226617 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464200dc-2799-464c-b0e1-065e0f032984 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:19.241071 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d363be4-a7f8-4fda-8c60-99d2c2af33c9 None None] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:19.241604 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d363be4-a7f8-4fda-8c60-99d2c2af33c9 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:19.241681 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d363be4-a7f8-4fda-8c60-99d2c2af33c9 None None] PATH_INFO: `/` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:19.243055 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 86/170] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 17:06:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:06:19.248298 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ca6042-c1a5-44ce-9de2-044b7b90e0e8 None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:19.248591 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ca6042-c1a5-44ce-9de2-044b7b90e0e8 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:19.248878 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ca6042-c1a5-44ce-9de2-044b7b90e0e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:19.286245 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:19.287336 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-f5ca6042-c1a5-44ce-9de2-044b7b90e0e8 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:06:19.288782 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-f5ca6042-c1a5-44ce-9de2-044b7b90e0e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:06:19.421953 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 85/171] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 16 17:06:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 483 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 17:06:19.425401 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b171fd-7531-4433-8c67-fa2af5c215a1 None None] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:19.425954 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b171fd-7531-4433-8c67-fa2af5c215a1 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:19.426439 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b171fd-7531-4433-8c67-fa2af5c215a1 None None] PATH_INFO: `/` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:19.428291 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 86/172] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 17:06:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:06:19.429695 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b171fd-7531-4433-8c67-fa2af5c215a1 None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:19.443264 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 87/173] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 17:06:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 17:06:19.449779 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d581419-3eda-4300-8ee3-4932e21cb2be None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:19.449779 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d581419-3eda-4300-8ee3-4932e21cb2be None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:19.449779 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d581419-3eda-4300-8ee3-4932e21cb2be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:19.486172 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-1d581419-3eda-4300-8ee3-4932e21cb2be None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:06:19.487438 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-1d581419-3eda-4300-8ee3-4932e21cb2be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:06:19.555602 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:19.584605 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 88/174] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 17:06:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 17:06:19.585420 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d581419-3eda-4300-8ee3-4932e21cb2be None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:19.606853 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b171fd-7531-4433-8c67-fa2af5c215a1 None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:19.638016 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:19.651884 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a3fa3f-f1d5-4138-9a40-18993d0f13e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:19.655509 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a3fa3f-f1d5-4138-9a40-18993d0f13e3 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:19.655509 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a3fa3f-f1d5-4138-9a40-18993d0f13e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:19.655509 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a3fa3f-f1d5-4138-9a40-18993d0f13e3 None admin] PATH_INFO: `/v3/projects/ac5b05cf174a49b0aae4343f1ac0f173` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:19.655509 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a3fa3f-f1d5-4138-9a40-18993d0f13e3 None admin] RBAC: Authorizing `identity:get_project(project_id=ac5b05cf174a49b0aae4343f1ac0f173)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:19.657893 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a3fa3f-f1d5-4138-9a40-18993d0f13e3 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:19.660473 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 87/175] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 16 17:06:19 2022] GET /identity/v3/projects/ac5b05cf174a49b0aae4343f1ac0f173 => generated 298 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:06:19.666769 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63729e8-88d8-4933-a465-77204344cb5f None None] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:19.666769 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63729e8-88d8-4933-a465-77204344cb5f None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:19.666769 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63729e8-88d8-4933-a465-77204344cb5f None None] PATH_INFO: `/` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:19.667998 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 88/176] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 17:06:19 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:06:19.668586 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63729e8-88d8-4933-a465-77204344cb5f None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:19.742096 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d581419-3eda-4300-8ee3-4932e21cb2be None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:19.788277 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63729e8-88d8-4933-a465-77204344cb5f None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:19.792206 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9aaeeb-a710-4d08-b161-100ad1b13a31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:19.793276 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9aaeeb-a710-4d08-b161-100ad1b13a31 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:19.793774 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9aaeeb-a710-4d08-b161-100ad1b13a31 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:19.794250 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9aaeeb-a710-4d08-b161-100ad1b13a31 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:19.808434 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9aaeeb-a710-4d08-b161-100ad1b13a31 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 17:06:19.819801 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application [None req-bd9aaeeb-a710-4d08-b161-100ad1b13a31 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 17:06:19.819801 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:06:19.819801 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:06:19.819801 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:06:19.819801 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:06:19.819801 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:06:19.819801 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:06:19.819801 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:06:19.819801 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:06:19.819801 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:06:19.819801 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:06:19.819801 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:06:19.819801 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 17:06:19.819801 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 17:06:19.819801 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 17:06:19.819801 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 17:06:19.820771 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 17:06:19.820771 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 17:06:19.820771 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 17:06:19.820771 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 17:06:19.820771 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:06:19.820771 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:06:19.820771 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:06:19.820771 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:06:19.820771 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:06:19.820771 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:06:19.820771 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:06:19.820771 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application with Lock( Jun 16 17:06:19.820771 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:06:19.820771 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:06:19.820771 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:06:19.820771 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:06:19.821551 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:06:19.821551 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:06:19.821551 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:06:19.821551 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:06:19.821551 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 17:06:19.821551 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 17:06:19.821551 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 17:06:19.821551 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 17:06:19.821551 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 17:06:19.821551 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 17:06:19.821551 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 17:06:19.821551 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Jun 16 17:06:19.823167 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 89/177] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 16 17:06:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:06:19.827083 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e35056-671a-49fa-95d0-cb833109f602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:19.829095 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e35056-671a-49fa-95d0-cb833109f602 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:19.829751 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9aaeeb-a710-4d08-b161-100ad1b13a31 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:19.830255 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e35056-671a-49fa-95d0-cb833109f602 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:19.830741 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e35056-671a-49fa-95d0-cb833109f602 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:19.847689 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e35056-671a-49fa-95d0-cb833109f602 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 17:06:19.859876 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application [None req-e1e35056-671a-49fa-95d0-cb833109f602 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 17:06:19.859876 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:06:19.859876 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:06:19.859876 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:06:19.859876 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:06:19.859876 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:06:19.859876 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:06:19.859876 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:06:19.859876 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:06:19.859876 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:06:19.859876 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:06:19.859876 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:06:19.859876 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 17:06:19.859876 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 17:06:19.859876 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 17:06:19.859876 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 17:06:19.860835 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 17:06:19.860835 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 17:06:19.860835 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 17:06:19.860835 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 17:06:19.860835 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:06:19.860835 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:06:19.860835 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:06:19.860835 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:06:19.860835 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:06:19.860835 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:06:19.860835 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:06:19.860835 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application with Lock( Jun 16 17:06:19.860835 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:06:19.860835 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:06:19.860835 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:06:19.860835 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:06:19.861617 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:06:19.861617 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:06:19.861617 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:06:19.861617 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:06:19.861617 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 17:06:19.861617 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 17:06:19.861617 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 17:06:19.861617 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 17:06:19.861617 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 17:06:19.861617 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 17:06:19.861617 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 17:06:19.861617 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Jun 16 17:06:19.863361 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 89/178] 10.222.0.39 () {56 vars in 1114 bytes} [Thu Jun 16 17:06:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:06:19.872779 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65507941-8ca4-452a-a2f9-ea6e1713dbc0 None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:19.873099 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65507941-8ca4-452a-a2f9-ea6e1713dbc0 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:19.873337 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65507941-8ca4-452a-a2f9-ea6e1713dbc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:19.879606 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:19.905642 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-65507941-8ca4-452a-a2f9-ea6e1713dbc0 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:06:19.907531 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-65507941-8ca4-452a-a2f9-ea6e1713dbc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:06:19.956635 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9aaeeb-a710-4d08-b161-100ad1b13a31 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:19.964982 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:19.986891 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 90/179] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 17:06:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 17:06:19.987749 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65507941-8ca4-452a-a2f9-ea6e1713dbc0 None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:20.002466 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b08d996-b7dc-4d26-876b-62d90d66ccc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:20.003664 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b08d996-b7dc-4d26-876b-62d90d66ccc0 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:20.004627 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b08d996-b7dc-4d26-876b-62d90d66ccc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:20.005113 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b08d996-b7dc-4d26-876b-62d90d66ccc0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:20.006421 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b08d996-b7dc-4d26-876b-62d90d66ccc0 None admin] RBAC: Adding query filter params (role.id=9331b396c9894ab88267e7b82ef6f224, scope.project.id=ac5b05cf174a49b0aae4343f1ac0f173, user.id=ef9bfbcc66f1498383e8c137bc8a81b7) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:06:20.007193 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b08d996-b7dc-4d26-876b-62d90d66ccc0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:20.009230 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b08d996-b7dc-4d26-876b-62d90d66ccc0 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:20.016676 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 90/180] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jun 16 17:06:19 2022] GET /identity/v3/role_assignments?user.id=ef9bfbcc66f1498383e8c137bc8a81b7&scope.project.id=ac5b05cf174a49b0aae4343f1ac0f173&role.id=9331b396c9894ab88267e7b82ef6f224 => generated 608 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:06:20.025836 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b08d996-b7dc-4d26-876b-62d90d66ccc0 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:20.131514 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65507941-8ca4-452a-a2f9-ea6e1713dbc0 None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:20.162010 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:20.166202 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b08d996-b7dc-4d26-876b-62d90d66ccc0 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:20.178778 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea479b1-0504-4465-b718-7cb15653fe51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:20.179465 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea479b1-0504-4465-b718-7cb15653fe51 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:20.184013 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea479b1-0504-4465-b718-7cb15653fe51 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:20.184013 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea479b1-0504-4465-b718-7cb15653fe51 None admin] PATH_INFO: `/v3/roles` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:20.184013 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea479b1-0504-4465-b718-7cb15653fe51 None admin] RBAC: Adding query filter params (name=member) {{(pid=80873) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:06:20.184013 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea479b1-0504-4465-b718-7cb15653fe51 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:20.184013 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea479b1-0504-4465-b718-7cb15653fe51 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:20.193012 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 91/181] 10.222.0.39 () {56 vars in 1101 bytes} [Thu Jun 16 17:06:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:06:20.197814 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929be846-1ac5-4477-a585-5ad88db641db None None] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:20.197814 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929be846-1ac5-4477-a585-5ad88db641db None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:20.197814 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929be846-1ac5-4477-a585-5ad88db641db None None] PATH_INFO: `/` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:20.197814 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 92/182] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 17:06:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:06:20.201108 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929be846-1ac5-4477-a585-5ad88db641db None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:20.213019 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba621cf-f986-4add-a296-2508aa6097f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:20.214111 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba621cf-f986-4add-a296-2508aa6097f5 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:20.214605 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba621cf-f986-4add-a296-2508aa6097f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:20.215100 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba621cf-f986-4add-a296-2508aa6097f5 None admin] PATH_INFO: `/v3/roles` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:20.216532 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba621cf-f986-4add-a296-2508aa6097f5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:06:20.217086 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba621cf-f986-4add-a296-2508aa6097f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:20.220244 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba621cf-f986-4add-a296-2508aa6097f5 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:20.232288 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 91/183] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 16 17:06:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:06:20.235325 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97558c5c-7fb2-44a2-95fc-f78a3985ee6e None None] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:20.235621 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97558c5c-7fb2-44a2-95fc-f78a3985ee6e None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:20.235909 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97558c5c-7fb2-44a2-95fc-f78a3985ee6e None None] PATH_INFO: `/` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:20.237427 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 92/184] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 17:06:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:06:20.239425 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97558c5c-7fb2-44a2-95fc-f78a3985ee6e None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:20.260496 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:20.327086 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929be846-1ac5-4477-a585-5ad88db641db None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:20.362925 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8339a4fa-25bf-445f-a655-ec3dc935afd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:20.363715 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8339a4fa-25bf-445f-a655-ec3dc935afd0 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:20.363999 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8339a4fa-25bf-445f-a655-ec3dc935afd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:20.364278 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8339a4fa-25bf-445f-a655-ec3dc935afd0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:20.367310 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97558c5c-7fb2-44a2-95fc-f78a3985ee6e None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:20.374699 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8339a4fa-25bf-445f-a655-ec3dc935afd0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 17:06:20.383252 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application [None req-8339a4fa-25bf-445f-a655-ec3dc935afd0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 17:06:20.383252 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:06:20.383252 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:06:20.383252 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:06:20.383252 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:06:20.383252 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:06:20.383252 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:06:20.383252 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:06:20.383252 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:06:20.383252 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:06:20.383252 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:06:20.383252 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:06:20.383252 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 17:06:20.383252 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 17:06:20.383252 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 17:06:20.383252 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 17:06:20.384315 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 17:06:20.384315 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 17:06:20.384315 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 17:06:20.384315 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 17:06:20.384315 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:06:20.384315 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:06:20.384315 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:06:20.384315 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:06:20.384315 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:06:20.384315 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:06:20.384315 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:06:20.384315 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application with Lock( Jun 16 17:06:20.384315 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:06:20.384315 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:06:20.384315 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:06:20.384315 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:06:20.390042 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:06:20.390042 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:06:20.390042 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:06:20.390042 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:06:20.390042 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 17:06:20.390042 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 17:06:20.390042 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 17:06:20.390042 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 17:06:20.390042 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 17:06:20.390042 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 17:06:20.390042 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 17:06:20.390042 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Jun 16 17:06:20.390042 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 93/185] 10.222.0.39 () {56 vars in 1096 bytes} [Thu Jun 16 17:06:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:06:20.390042 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7b81f8-7810-4615-a859-9a087947947a None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:20.391273 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7b81f8-7810-4615-a859-9a087947947a None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:20.391273 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7b81f8-7810-4615-a859-9a087947947a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:20.402909 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2ccad3-bcbc-4383-9465-e1bb1079f500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:20.403777 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2ccad3-bcbc-4383-9465-e1bb1079f500 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:20.404032 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-fb7b81f8-7810-4615-a859-9a087947947a None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:06:20.404129 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2ccad3-bcbc-4383-9465-e1bb1079f500 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:20.404325 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2ccad3-bcbc-4383-9465-e1bb1079f500 None admin] PATH_INFO: `/v3/users/ef9bfbcc66f1498383e8c137bc8a81b7` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:20.405235 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-fb7b81f8-7810-4615-a859-9a087947947a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:06:20.406023 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2ccad3-bcbc-4383-9465-e1bb1079f500 None admin] RBAC: Authorizing `identity:get_user(user_id=ef9bfbcc66f1498383e8c137bc8a81b7)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:20.408170 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2ccad3-bcbc-4383-9465-e1bb1079f500 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:20.409834 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 93/186] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jun 16 17:06:20 2022] GET /identity/v3/users/ef9bfbcc66f1498383e8c137bc8a81b7 => generated 275 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:06:20.414510 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2ccad3-bcbc-4383-9465-e1bb1079f500 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:20.446036 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:20.482698 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 94/187] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 17:06:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 17:06:20.482698 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737beb03-6035-43e8-a532-b9dbe9d65f3e None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:20.482698 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737beb03-6035-43e8-a532-b9dbe9d65f3e None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:20.482698 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737beb03-6035-43e8-a532-b9dbe9d65f3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:20.503043 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-737beb03-6035-43e8-a532-b9dbe9d65f3e None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:06:20.504227 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-737beb03-6035-43e8-a532-b9dbe9d65f3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:06:20.517351 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2ccad3-bcbc-4383-9465-e1bb1079f500 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:20.529933 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:20.550720 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63a080f-203c-43ad-87c9-8c20ddae32d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:20.551595 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63a080f-203c-43ad-87c9-8c20ddae32d9 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:20.551876 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63a080f-203c-43ad-87c9-8c20ddae32d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:20.552166 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63a080f-203c-43ad-87c9-8c20ddae32d9 None admin] PATH_INFO: `/v3/users/50d9a1642c6d49949ced7754cbb17c79` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:20.566133 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63a080f-203c-43ad-87c9-8c20ddae32d9 None admin] RBAC: Authorizing `identity:get_user(user_id=50d9a1642c6d49949ced7754cbb17c79)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:20.567585 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63a080f-203c-43ad-87c9-8c20ddae32d9 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:20.569279 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 94/188] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jun 16 17:06:20 2022] GET /identity/v3/users/50d9a1642c6d49949ced7754cbb17c79 => generated 283 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:06:20.570058 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63a080f-203c-43ad-87c9-8c20ddae32d9 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:20.574907 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 95/189] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 17:06:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 17:06:20.575736 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737beb03-6035-43e8-a532-b9dbe9d65f3e None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:20.674186 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:20.683714 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737beb03-6035-43e8-a532-b9dbe9d65f3e None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:20.685847 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63a080f-203c-43ad-87c9-8c20ddae32d9 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:20.716490 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec89e3f-d419-4c3f-b004-3012a277f3a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:20.717146 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec89e3f-d419-4c3f-b004-3012a277f3a9 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:20.717438 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec89e3f-d419-4c3f-b004-3012a277f3a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:20.717719 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec89e3f-d419-4c3f-b004-3012a277f3a9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:20.720170 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b39dbe7-fe8c-4939-b55d-2346754a4675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:20.720837 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b39dbe7-fe8c-4939-b55d-2346754a4675 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:20.721111 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b39dbe7-fe8c-4939-b55d-2346754a4675 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:20.721383 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b39dbe7-fe8c-4939-b55d-2346754a4675 None admin] PATH_INFO: `/v3/roles` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:20.722160 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b39dbe7-fe8c-4939-b55d-2346754a4675 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:06:20.722466 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b39dbe7-fe8c-4939-b55d-2346754a4675 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:20.723841 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b39dbe7-fe8c-4939-b55d-2346754a4675 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:20.732181 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 95/190] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 16 17:06:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:06:20.736532 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b39dbe7-fe8c-4939-b55d-2346754a4675 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:20.752772 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:20.789262 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec89e3f-d419-4c3f-b004-3012a277f3a9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:20.790678 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec89e3f-d419-4c3f-b004-3012a277f3a9 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:20.837148 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b39dbe7-fe8c-4939-b55d-2346754a4675 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:20.872864 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9efff3f-8226-446a-9c55-74d90354e982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:20.873662 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9efff3f-8226-446a-9c55-74d90354e982 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:20.873984 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9efff3f-8226-446a-9c55-74d90354e982 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:20.874269 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9efff3f-8226-446a-9c55-74d90354e982 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:20.887635 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9efff3f-8226-446a-9c55-74d90354e982 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 17:06:20.892084 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 96/191] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 16 17:06:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 17:06:20.892934 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec89e3f-d419-4c3f-b004-3012a277f3a9 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:20.896106 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application [None req-d9efff3f-8226-446a-9c55-74d90354e982 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 17:06:20.896106 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:06:20.896106 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:06:20.896106 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:06:20.896106 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:06:20.896106 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:06:20.896106 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:06:20.896106 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:06:20.896106 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:06:20.896106 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:06:20.896106 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:06:20.896106 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:06:20.896106 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 17:06:20.896106 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 17:06:20.896106 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 17:06:20.896106 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 17:06:20.897344 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 17:06:20.897344 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 17:06:20.897344 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 17:06:20.897344 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 17:06:20.897344 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:06:20.897344 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:06:20.897344 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:06:20.897344 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:06:20.897344 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:06:20.897344 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:06:20.897344 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:06:20.897344 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application with Lock( Jun 16 17:06:20.897344 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:06:20.897344 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:06:20.897344 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:06:20.897344 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:06:20.898182 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:06:20.898182 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:06:20.898182 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:06:20.898182 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:06:20.898182 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 17:06:20.898182 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 17:06:20.898182 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 17:06:20.898182 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 17:06:20.898182 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 17:06:20.898182 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 17:06:20.898182 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 17:06:20.898182 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Jun 16 17:06:20.898182 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 96/192] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 16 17:06:20 2022] GET /identity/v3/roles/reader => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:06:20.899345 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9efff3f-8226-446a-9c55-74d90354e982 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:20.911846 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:20.957658 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:20.994900 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec89e3f-d419-4c3f-b004-3012a277f3a9 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:20.998689 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9efff3f-8226-446a-9c55-74d90354e982 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:21.029425 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8015b5f-8a1f-4eb0-beed-bb0821074fbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:21.030124 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8015b5f-8a1f-4eb0-beed-bb0821074fbe None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:21.030413 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8015b5f-8a1f-4eb0-beed-bb0821074fbe None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:21.030694 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8015b5f-8a1f-4eb0-beed-bb0821074fbe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:21.034287 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b6b938-046f-4744-86f1-ebe9ad02a043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:21.035081 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b6b938-046f-4744-86f1-ebe9ad02a043 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:21.035365 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b6b938-046f-4744-86f1-ebe9ad02a043 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:21.035642 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b6b938-046f-4744-86f1-ebe9ad02a043 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:21.036809 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b6b938-046f-4744-86f1-ebe9ad02a043 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:21.038289 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b6b938-046f-4744-86f1-ebe9ad02a043 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:21.040140 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 97/193] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 17:06:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:06:21.040748 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b6b938-046f-4744-86f1-ebe9ad02a043 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:21.102257 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8015b5f-8a1f-4eb0-beed-bb0821074fbe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:21.103963 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8015b5f-8a1f-4eb0-beed-bb0821074fbe None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:21.117782 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:21.140261 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b6b938-046f-4744-86f1-ebe9ad02a043 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:21.165860 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:21.175196 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7235dece-5dd0-4e27-a024-d4ce7b9d032c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:21.176151 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7235dece-5dd0-4e27-a024-d4ce7b9d032c None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:21.176441 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7235dece-5dd0-4e27-a024-d4ce7b9d032c None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:21.179192 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7235dece-5dd0-4e27-a024-d4ce7b9d032c None admin] PATH_INFO: `/v3/users/50d9a1642c6d49949ced7754cbb17c79` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:21.179192 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7235dece-5dd0-4e27-a024-d4ce7b9d032c None admin] RBAC: Authorizing `identity:get_user(user_id=50d9a1642c6d49949ced7754cbb17c79)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:21.179434 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7235dece-5dd0-4e27-a024-d4ce7b9d032c None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:21.181078 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 98/194] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jun 16 17:06:21 2022] GET /identity/v3/users/50d9a1642c6d49949ced7754cbb17c79 => generated 283 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:06:21.181864 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7235dece-5dd0-4e27-a024-d4ce7b9d032c None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:21.206354 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 97/195] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 16 17:06:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 17:06:21.207195 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8015b5f-8a1f-4eb0-beed-bb0821074fbe None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:21.282062 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7235dece-5dd0-4e27-a024-d4ce7b9d032c None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:21.306510 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8015b5f-8a1f-4eb0-beed-bb0821074fbe None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:21.314639 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae89975-525f-4205-a341-965e8ef37d9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:21.315505 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae89975-525f-4205-a341-965e8ef37d9f None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:21.315793 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae89975-525f-4205-a341-965e8ef37d9f None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:21.316072 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae89975-525f-4205-a341-965e8ef37d9f None admin] PATH_INFO: `/v3/projects/590e405fe8a64179bcedf55b5577f0b1` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:21.317278 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae89975-525f-4205-a341-965e8ef37d9f None admin] RBAC: Authorizing `identity:get_project(project_id=590e405fe8a64179bcedf55b5577f0b1)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:21.318751 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae89975-525f-4205-a341-965e8ef37d9f None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:21.320465 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 99/196] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 16 17:06:21 2022] GET /identity/v3/projects/590e405fe8a64179bcedf55b5577f0b1 => generated 312 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:06:21.321214 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae89975-525f-4205-a341-965e8ef37d9f None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:21.337112 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:21.340757 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08755732-1e01-468c-bdc5-ab2282517e5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:21.341426 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08755732-1e01-468c-bdc5-ab2282517e5a None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:21.341714 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08755732-1e01-468c-bdc5-ab2282517e5a None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:21.342043 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08755732-1e01-468c-bdc5-ab2282517e5a None admin] PATH_INFO: `/v3/roles` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:21.342800 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08755732-1e01-468c-bdc5-ab2282517e5a None admin] RBAC: Adding query filter params (name=reader) {{(pid=80873) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:06:21.343113 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08755732-1e01-468c-bdc5-ab2282517e5a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:21.345124 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08755732-1e01-468c-bdc5-ab2282517e5a None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:21.353593 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 98/197] 10.222.0.39 () {56 vars in 1101 bytes} [Thu Jun 16 17:06:21 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:06:21.353593 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08755732-1e01-468c-bdc5-ab2282517e5a None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:21.421063 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:21.463601 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae89975-525f-4205-a341-965e8ef37d9f None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:21.495372 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08755732-1e01-468c-bdc5-ab2282517e5a None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:21.497236 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e57c457-b79b-4255-8227-f6754beab28f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:21.497943 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e57c457-b79b-4255-8227-f6754beab28f None admin] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:21.498234 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e57c457-b79b-4255-8227-f6754beab28f None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:21.498519 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e57c457-b79b-4255-8227-f6754beab28f None admin] PATH_INFO: `/v3/users` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:21.499240 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e57c457-b79b-4255-8227-f6754beab28f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:21.500696 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e57c457-b79b-4255-8227-f6754beab28f None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:21.528081 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7e1663-d0ef-487d-801b-991983c89135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:21.528730 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7e1663-d0ef-487d-801b-991983c89135 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:21.529020 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7e1663-d0ef-487d-801b-991983c89135 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:21.529302 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7e1663-d0ef-487d-801b-991983c89135 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:21.589018 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 100/198] 10.222.0.39 () {60 vars in 1132 bytes} [Thu Jun 16 17:06:21 2022] POST /identity/v3/users => generated 297 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:06:21.589550 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e57c457-b79b-4255-8227-f6754beab28f None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:21.596978 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7e1663-d0ef-487d-801b-991983c89135 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:21.598518 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7e1663-d0ef-487d-801b-991983c89135 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:21.634218 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:21.678690 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:21.716411 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e57c457-b79b-4255-8227-f6754beab28f None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:21.730158 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 99/199] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 16 17:06:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 17:06:21.731118 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7e1663-d0ef-487d-801b-991983c89135 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:21.759263 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38285c22-3fd0-45f4-a81d-a914c621e523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:21.760139 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38285c22-3fd0-45f4-a81d-a914c621e523 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:21.760428 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38285c22-3fd0-45f4-a81d-a914c621e523 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:21.760706 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38285c22-3fd0-45f4-a81d-a914c621e523 None admin] PATH_INFO: `/v3/projects/d38e49d57050488484d9f03fdb7552ee` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:21.762696 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38285c22-3fd0-45f4-a81d-a914c621e523 None admin] RBAC: Authorizing `identity:get_project(project_id=d38e49d57050488484d9f03fdb7552ee)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:21.764038 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38285c22-3fd0-45f4-a81d-a914c621e523 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:21.765101 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 101/200] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 16 17:06:21 2022] GET /identity/v3/projects/d38e49d57050488484d9f03fdb7552ee => generated 302 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:06:21.770642 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38285c22-3fd0-45f4-a81d-a914c621e523 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:21.857783 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7e1663-d0ef-487d-801b-991983c89135 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:21.887599 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38285c22-3fd0-45f4-a81d-a914c621e523 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:21.908401 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:21.917245 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e1f264-02d6-48fc-8b7a-fa460e12f043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:21.918001 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e1f264-02d6-48fc-8b7a-fa460e12f043 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:21.918295 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e1f264-02d6-48fc-8b7a-fa460e12f043 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:21.924156 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e1f264-02d6-48fc-8b7a-fa460e12f043 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:21.924156 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e1f264-02d6-48fc-8b7a-fa460e12f043 None admin] RBAC: Adding query filter params (role.id=896bff49c5d6464eb612a15f4aa9badc, scope.project.id=590e405fe8a64179bcedf55b5577f0b1, user.id=ef9bfbcc66f1498383e8c137bc8a81b7) {{(pid=80873) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:06:21.924156 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e1f264-02d6-48fc-8b7a-fa460e12f043 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:21.924156 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e1f264-02d6-48fc-8b7a-fa460e12f043 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:21.928739 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 100/201] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jun 16 17:06:21 2022] GET /identity/v3/role_assignments?user.id=ef9bfbcc66f1498383e8c137bc8a81b7&scope.project.id=590e405fe8a64179bcedf55b5577f0b1&role.id=896bff49c5d6464eb612a15f4aa9badc => generated 608 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:06:21.930350 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e1f264-02d6-48fc-8b7a-fa460e12f043 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:21.938794 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741a3731-e4e7-482b-aaea-a134424866ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:21.940265 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741a3731-e4e7-482b-aaea-a134424866ab None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:21.940713 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741a3731-e4e7-482b-aaea-a134424866ab None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:21.941167 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741a3731-e4e7-482b-aaea-a134424866ab None admin] PATH_INFO: `/v3/users/1fef9400dc574700a67fee19442404b8` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:21.942999 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741a3731-e4e7-482b-aaea-a134424866ab None admin] RBAC: Authorizing `identity:get_user(user_id=1fef9400dc574700a67fee19442404b8)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:21.944753 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741a3731-e4e7-482b-aaea-a134424866ab None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:21.946851 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 102/202] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jun 16 17:06:21 2022] GET /identity/v3/users/1fef9400dc574700a67fee19442404b8 => generated 289 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:06:21.947905 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741a3731-e4e7-482b-aaea-a134424866ab None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:21.960863 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:22.088898 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e1f264-02d6-48fc-8b7a-fa460e12f043 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:22.131312 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d29499-d0d1-4196-9974-d7b8f56d34ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:22.132227 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d29499-d0d1-4196-9974-d7b8f56d34ef None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:22.132519 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d29499-d0d1-4196-9974-d7b8f56d34ef None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:22.132803 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d29499-d0d1-4196-9974-d7b8f56d34ef None admin] PATH_INFO: `/v3/projects/d38e49d57050488484d9f03fdb7552ee` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:22.134274 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d29499-d0d1-4196-9974-d7b8f56d34ef None admin] RBAC: Authorizing `identity:get_project(project_id=d38e49d57050488484d9f03fdb7552ee)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:22.136040 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d29499-d0d1-4196-9974-d7b8f56d34ef None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:22.137841 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 101/203] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 16 17:06:21 2022] GET /identity/v3/projects/d38e49d57050488484d9f03fdb7552ee => generated 302 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:06:22.139389 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d29499-d0d1-4196-9974-d7b8f56d34ef None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:22.171053 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741a3731-e4e7-482b-aaea-a134424866ab None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:22.216498 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:22.227295 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73de2f7-22cc-4e91-82c4-d122be1e0b45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:22.228229 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73de2f7-22cc-4e91-82c4-d122be1e0b45 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:22.228519 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73de2f7-22cc-4e91-82c4-d122be1e0b45 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:22.228891 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73de2f7-22cc-4e91-82c4-d122be1e0b45 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:22.230542 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73de2f7-22cc-4e91-82c4-d122be1e0b45 None admin] RBAC: Adding query filter params (role.id=9331b396c9894ab88267e7b82ef6f224, scope.project.id=d38e49d57050488484d9f03fdb7552ee, user.id=50d9a1642c6d49949ced7754cbb17c79) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:06:22.230883 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73de2f7-22cc-4e91-82c4-d122be1e0b45 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:22.232365 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73de2f7-22cc-4e91-82c4-d122be1e0b45 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:22.239458 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 103/204] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jun 16 17:06:21 2022] GET /identity/v3/role_assignments?user.id=50d9a1642c6d49949ced7754cbb17c79&scope.project.id=d38e49d57050488484d9f03fdb7552ee&role.id=9331b396c9894ab88267e7b82ef6f224 => generated 259 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:06:22.248079 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73de2f7-22cc-4e91-82c4-d122be1e0b45 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:22.271034 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d29499-d0d1-4196-9974-d7b8f56d34ef None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:22.334024 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f85559-a666-4530-b59b-72750e2154ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:22.338873 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f85559-a666-4530-b59b-72750e2154ad None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:22.339428 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f85559-a666-4530-b59b-72750e2154ad None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:22.339919 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f85559-a666-4530-b59b-72750e2154ad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:22.427042 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:22.486420 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f85559-a666-4530-b59b-72750e2154ad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:22.488783 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f85559-a666-4530-b59b-72750e2154ad None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:22.491525 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73de2f7-22cc-4e91-82c4-d122be1e0b45 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:22.544995 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3aa587b-c475-4334-ace8-e42cd32a936e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:22.550518 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aa587b-c475-4334-ace8-e42cd32a936e None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:22.551036 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aa587b-c475-4334-ace8-e42cd32a936e None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:22.551542 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aa587b-c475-4334-ace8-e42cd32a936e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:22.552601 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3aa587b-c475-4334-ace8-e42cd32a936e None admin] RBAC: Adding query filter params (role.id=dba744f8ab2a4c45b9d3212f8d203aba, scope.project.id=d38e49d57050488484d9f03fdb7552ee, user.id=50d9a1642c6d49949ced7754cbb17c79) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:06:22.553128 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3aa587b-c475-4334-ace8-e42cd32a936e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:22.554842 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3aa587b-c475-4334-ace8-e42cd32a936e None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:22.566356 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 104/205] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jun 16 17:06:22 2022] GET /identity/v3/role_assignments?user.id=50d9a1642c6d49949ced7754cbb17c79&scope.project.id=d38e49d57050488484d9f03fdb7552ee&role.id=dba744f8ab2a4c45b9d3212f8d203aba => generated 259 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:06:22.590395 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:22.650811 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 102/206] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 16 17:06:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 512 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 17:06:22.656599 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3aa587b-c475-4334-ace8-e42cd32a936e None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:22.808558 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3aa587b-c475-4334-ace8-e42cd32a936e None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:22.863081 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef97a0b3-38d4-4753-94cf-5be3a287fe7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:22.863967 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef97a0b3-38d4-4753-94cf-5be3a287fe7e None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:22.864255 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef97a0b3-38d4-4753-94cf-5be3a287fe7e None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:22.864537 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef97a0b3-38d4-4753-94cf-5be3a287fe7e None admin] PATH_INFO: `/v3/projects/ac5b05cf174a49b0aae4343f1ac0f173` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:22.865813 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef97a0b3-38d4-4753-94cf-5be3a287fe7e None admin] RBAC: Authorizing `identity:get_project(project_id=ac5b05cf174a49b0aae4343f1ac0f173)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:22.867282 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef97a0b3-38d4-4753-94cf-5be3a287fe7e None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:22.869029 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 105/207] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 16 17:06:22 2022] GET /identity/v3/projects/ac5b05cf174a49b0aae4343f1ac0f173 => generated 298 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:06:22.874973 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f85559-a666-4530-b59b-72750e2154ad None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:23.047687 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f85559-a666-4530-b59b-72750e2154ad None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:23.093164 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01837d47-3083-41b9-8f44-7d4dad52155d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:23.094797 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01837d47-3083-41b9-8f44-7d4dad52155d None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:23.095281 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01837d47-3083-41b9-8f44-7d4dad52155d None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:23.095757 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01837d47-3083-41b9-8f44-7d4dad52155d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:23.096813 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01837d47-3083-41b9-8f44-7d4dad52155d None admin] RBAC: Adding query filter params (role.id=74b3015ca91b437f8d6ee242563b6547, scope.project.id=ac5b05cf174a49b0aae4343f1ac0f173, user.id=1fef9400dc574700a67fee19442404b8) {{(pid=80873) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:06:23.097332 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01837d47-3083-41b9-8f44-7d4dad52155d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:23.099039 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01837d47-3083-41b9-8f44-7d4dad52155d None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:23.111765 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 103/208] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jun 16 17:06:22 2022] GET /identity/v3/role_assignments?user.id=1fef9400dc574700a67fee19442404b8&scope.project.id=ac5b05cf174a49b0aae4343f1ac0f173&role.id=74b3015ca91b437f8d6ee242563b6547 => generated 608 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:06:24.237146 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de8fa1b-2adb-43df-8ec6-cc06d1f8fde8 None None] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:24.237641 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de8fa1b-2adb-43df-8ec6-cc06d1f8fde8 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:24.237641 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de8fa1b-2adb-43df-8ec6-cc06d1f8fde8 None None] PATH_INFO: `/` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:24.239342 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 106/209] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 17:06:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:06:24.242852 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fb08be-37bd-4297-99af-1e35ac291f0f None None] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:24.244579 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcda2568-4ec9-4f79-9b55-a22b010ff245 None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:24.244873 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcda2568-4ec9-4f79-9b55-a22b010ff245 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:24.245157 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcda2568-4ec9-4f79-9b55-a22b010ff245 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:24.247949 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fb08be-37bd-4297-99af-1e35ac291f0f None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:24.247949 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fb08be-37bd-4297-99af-1e35ac291f0f None None] PATH_INFO: `/` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:24.247949 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 104/210] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 17:06:24 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:06:24.253090 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:24.253684 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41394c3-2cb2-4c0a-b151-d2f5476509c4 None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:24.254233 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41394c3-2cb2-4c0a-b151-d2f5476509c4 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:24.254738 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41394c3-2cb2-4c0a-b151-d2f5476509c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:24.266868 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-fcda2568-4ec9-4f79-9b55-a22b010ff245 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:06:24.270169 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-fcda2568-4ec9-4f79-9b55-a22b010ff245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:06:24.274088 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-f41394c3-2cb2-4c0a-b151-d2f5476509c4 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:06:24.275495 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-f41394c3-2cb2-4c0a-b151-d2f5476509c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:06:24.318809 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:24.349178 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 107/211] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 17:06:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 17:06:24.363912 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 105/212] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 17:06:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 17:06:24.379154 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcda2568-4ec9-4f79-9b55-a22b010ff245 None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:24.391484 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41394c3-2cb2-4c0a-b151-d2f5476509c4 None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:24.501375 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcda2568-4ec9-4f79-9b55-a22b010ff245 None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:24.522591 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41394c3-2cb2-4c0a-b151-d2f5476509c4 None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:24.536415 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:24.542517 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9018cca-b719-4da5-b417-2cc131f2a194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:24.543511 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9018cca-b719-4da5-b417-2cc131f2a194 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:24.544010 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9018cca-b719-4da5-b417-2cc131f2a194 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:24.544502 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9018cca-b719-4da5-b417-2cc131f2a194 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:24.556934 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9018cca-b719-4da5-b417-2cc131f2a194 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 17:06:24.565399 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application [None req-e9018cca-b719-4da5-b417-2cc131f2a194 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 17:06:24.565399 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:06:24.565399 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:06:24.565399 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:06:24.565399 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:06:24.565399 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:06:24.565399 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:06:24.565399 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:06:24.565399 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:06:24.565399 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:06:24.565399 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:06:24.565399 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:06:24.565399 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 17:06:24.565399 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 17:06:24.565399 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 17:06:24.565399 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 17:06:24.566416 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 17:06:24.566416 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 17:06:24.566416 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 17:06:24.566416 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 17:06:24.566416 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:06:24.566416 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:06:24.566416 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:06:24.566416 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:06:24.566416 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:06:24.566416 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:06:24.566416 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:06:24.566416 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application with Lock( Jun 16 17:06:24.566416 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:06:24.566416 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:06:24.566416 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:06:24.566416 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:06:24.567223 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:06:24.567223 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:06:24.567223 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:06:24.567223 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:06:24.567223 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 17:06:24.567223 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 17:06:24.567223 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 17:06:24.567223 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 17:06:24.567223 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 17:06:24.567223 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 17:06:24.567223 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 17:06:24.567223 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Jun 16 17:06:24.567830 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ec07e0-219d-4698-8ce4-d4889edd9021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:24.567830 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ec07e0-219d-4698-8ce4-d4889edd9021 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:24.567830 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ec07e0-219d-4698-8ce4-d4889edd9021 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:24.568335 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ec07e0-219d-4698-8ce4-d4889edd9021 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:24.569949 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ec07e0-219d-4698-8ce4-d4889edd9021 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:24.571082 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 108/213] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 16 17:06:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:06:24.576053 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ec07e0-219d-4698-8ce4-d4889edd9021 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:24.576053 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 106/214] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 17:06:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 17:06:24.580551 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ec07e0-219d-4698-8ce4-d4889edd9021 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:24.582427 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9018cca-b719-4da5-b417-2cc131f2a194 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:24.605302 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:24.700726 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ec07e0-219d-4698-8ce4-d4889edd9021 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:24.711056 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9018cca-b719-4da5-b417-2cc131f2a194 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:24.737581 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec08e7d0-411a-4941-a5df-7f89b4502ea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:24.738406 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec08e7d0-411a-4941-a5df-7f89b4502ea3 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:24.738696 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec08e7d0-411a-4941-a5df-7f89b4502ea3 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:24.738979 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec08e7d0-411a-4941-a5df-7f89b4502ea3 None admin] PATH_INFO: `/v3/roles` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:24.739732 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec08e7d0-411a-4941-a5df-7f89b4502ea3 None admin] RBAC: Adding query filter params (name=member) {{(pid=80873) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:06:24.740045 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec08e7d0-411a-4941-a5df-7f89b4502ea3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:24.741664 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec08e7d0-411a-4941-a5df-7f89b4502ea3 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:24.745859 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddbeb23-cd99-4776-8c0a-75550778312e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:24.746536 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddbeb23-cd99-4776-8c0a-75550778312e None admin] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:24.746835 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddbeb23-cd99-4776-8c0a-75550778312e None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:24.747127 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddbeb23-cd99-4776-8c0a-75550778312e None admin] PATH_INFO: `/v3/users` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:24.747851 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddbeb23-cd99-4776-8c0a-75550778312e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:24.749300 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddbeb23-cd99-4776-8c0a-75550778312e None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:24.752009 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 107/215] 10.222.0.39 () {56 vars in 1101 bytes} [Thu Jun 16 17:06:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:06:24.753583 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d242c6a-e36b-4d8a-9373-1f8271796765 None None] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:24.754061 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d242c6a-e36b-4d8a-9373-1f8271796765 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:24.754526 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d242c6a-e36b-4d8a-9373-1f8271796765 None None] PATH_INFO: `/` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:24.755961 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 108/216] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 17:06:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:06:24.757181 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d242c6a-e36b-4d8a-9373-1f8271796765 None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:24.840578 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:24.850368 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 109/217] 10.222.0.39 () {60 vars in 1132 bytes} [Thu Jun 16 17:06:24 2022] POST /identity/v3/users => generated 297 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 17:06:24.851716 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7977271-5918-471c-87ee-caf8e34843b3 None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:24.852007 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7977271-5918-471c-87ee-caf8e34843b3 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:24.852641 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7977271-5918-471c-87ee-caf8e34843b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:24.869651 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d242c6a-e36b-4d8a-9373-1f8271796765 None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:24.875987 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-d7977271-5918-471c-87ee-caf8e34843b3 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:06:24.877433 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-d7977271-5918-471c-87ee-caf8e34843b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:06:24.922668 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1247a5-80e3-4bfd-be3d-b76f31ca53f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:24.923609 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1247a5-80e3-4bfd-be3d-b76f31ca53f6 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:24.923883 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1247a5-80e3-4bfd-be3d-b76f31ca53f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:24.924158 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1247a5-80e3-4bfd-be3d-b76f31ca53f6 None admin] PATH_INFO: `/v3/users/c98b4d2469814aff8ed4d2597015a003` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:24.944041 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1247a5-80e3-4bfd-be3d-b76f31ca53f6 None admin] RBAC: Authorizing `identity:get_user(user_id=c98b4d2469814aff8ed4d2597015a003)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:24.946041 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1247a5-80e3-4bfd-be3d-b76f31ca53f6 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:24.950190 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:24.953857 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 109/218] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jun 16 17:06:24 2022] GET /identity/v3/users/c98b4d2469814aff8ed4d2597015a003 => generated 297 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 17:06:24.955126 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1247a5-80e3-4bfd-be3d-b76f31ca53f6 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:24.980230 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 110/219] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 17:06:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 17:06:25.005490 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7977271-5918-471c-87ee-caf8e34843b3 None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:25.089211 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1247a5-80e3-4bfd-be3d-b76f31ca53f6 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:25.113914 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7977271-5918-471c-87ee-caf8e34843b3 None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:25.131898 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb992d47-51ec-4c52-9988-3bc749013a03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:25.133020 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb992d47-51ec-4c52-9988-3bc749013a03 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:25.133020 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb992d47-51ec-4c52-9988-3bc749013a03 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:25.133193 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb992d47-51ec-4c52-9988-3bc749013a03 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:25.147385 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:25.160819 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c49dfb0-cf2d-4579-9ec6-a1d7ce9283ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:25.168007 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c49dfb0-cf2d-4579-9ec6-a1d7ce9283ca None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:25.168007 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c49dfb0-cf2d-4579-9ec6-a1d7ce9283ca None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:25.168007 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c49dfb0-cf2d-4579-9ec6-a1d7ce9283ca None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:25.176090 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c49dfb0-cf2d-4579-9ec6-a1d7ce9283ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 17:06:25.185681 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application [None req-4c49dfb0-cf2d-4579-9ec6-a1d7ce9283ca None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 17:06:25.185681 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:06:25.185681 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:06:25.185681 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:06:25.185681 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:06:25.185681 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:06:25.185681 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:06:25.185681 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:06:25.185681 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:06:25.185681 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:06:25.185681 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:06:25.185681 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:06:25.185681 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 17:06:25.185681 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 17:06:25.185681 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 17:06:25.185681 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 17:06:25.186695 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 17:06:25.186695 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 17:06:25.186695 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 17:06:25.186695 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 17:06:25.186695 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:06:25.186695 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:06:25.186695 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:06:25.186695 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:06:25.186695 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:06:25.186695 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:06:25.186695 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:06:25.186695 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application with Lock( Jun 16 17:06:25.186695 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:06:25.186695 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:06:25.186695 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:06:25.186695 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:06:25.188278 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:06:25.188278 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:06:25.188278 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:06:25.188278 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:06:25.188278 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 17:06:25.188278 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 17:06:25.188278 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 17:06:25.188278 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 17:06:25.188278 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 17:06:25.188278 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 17:06:25.188278 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 17:06:25.188278 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Jun 16 17:06:25.188278 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 111/220] 10.222.0.39 () {56 vars in 1114 bytes} [Thu Jun 16 17:06:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 17:06:25.191291 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c890e72-f38c-404c-b7b3-b95850f11839 None None] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:25.191585 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c890e72-f38c-404c-b7b3-b95850f11839 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:25.191868 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c890e72-f38c-404c-b7b3-b95850f11839 None None] PATH_INFO: `/` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:25.193331 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 112/221] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 17:06:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:06:25.197508 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c890e72-f38c-404c-b7b3-b95850f11839 None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:25.220673 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb992d47-51ec-4c52-9988-3bc749013a03 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:25.222905 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb992d47-51ec-4c52-9988-3bc749013a03 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:25.244778 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:25.329689 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c890e72-f38c-404c-b7b3-b95850f11839 None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:25.349668 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 110/222] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 16 17:06:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 17:06:25.351616 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e42485c-55eb-45d3-95aa-47b245e70d20 None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:25.352077 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e42485c-55eb-45d3-95aa-47b245e70d20 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:25.352762 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e42485c-55eb-45d3-95aa-47b245e70d20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:25.371370 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e4f30c-c95d-4b66-98e9-f5bceb5a94ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:25.372188 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e4f30c-c95d-4b66-98e9-f5bceb5a94ea None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:25.372600 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e4f30c-c95d-4b66-98e9-f5bceb5a94ea None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:25.372989 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e4f30c-c95d-4b66-98e9-f5bceb5a94ea None admin] PATH_INFO: `/v3/roles` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:25.373871 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e4f30c-c95d-4b66-98e9-f5bceb5a94ea None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:06:25.374267 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e4f30c-c95d-4b66-98e9-f5bceb5a94ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:25.376323 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e4f30c-c95d-4b66-98e9-f5bceb5a94ea None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:25.378083 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-5e42485c-55eb-45d3-95aa-47b245e70d20 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:06:25.379867 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-5e42485c-55eb-45d3-95aa-47b245e70d20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:06:25.385732 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 113/223] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 16 17:06:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:06:25.386924 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e4f30c-c95d-4b66-98e9-f5bceb5a94ea None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:25.426649 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:25.475057 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 111/224] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 17:06:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 17:06:25.475057 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e42485c-55eb-45d3-95aa-47b245e70d20 None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:25.537356 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:25.542086 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e4f30c-c95d-4b66-98e9-f5bceb5a94ea None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:25.582546 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9022b0a7-d6f4-4813-93c4-08cb136a376f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:25.583345 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9022b0a7-d6f4-4813-93c4-08cb136a376f None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:25.583635 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9022b0a7-d6f4-4813-93c4-08cb136a376f None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:25.583919 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9022b0a7-d6f4-4813-93c4-08cb136a376f None admin] PATH_INFO: `/v3/projects/d38e49d57050488484d9f03fdb7552ee` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:25.585803 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9022b0a7-d6f4-4813-93c4-08cb136a376f None admin] RBAC: Authorizing `identity:get_project(project_id=d38e49d57050488484d9f03fdb7552ee)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:25.587423 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9022b0a7-d6f4-4813-93c4-08cb136a376f None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:25.589462 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 114/225] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 16 17:06:25 2022] GET /identity/v3/projects/d38e49d57050488484d9f03fdb7552ee => generated 302 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:06:25.590262 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9022b0a7-d6f4-4813-93c4-08cb136a376f None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:25.605790 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e42485c-55eb-45d3-95aa-47b245e70d20 None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:25.649439 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6318cab-70ba-4b4d-9155-268a68ab8370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:25.651106 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6318cab-70ba-4b4d-9155-268a68ab8370 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:25.651964 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6318cab-70ba-4b4d-9155-268a68ab8370 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:25.652449 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6318cab-70ba-4b4d-9155-268a68ab8370 None admin] PATH_INFO: `/v3/users/50d9a1642c6d49949ced7754cbb17c79` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:25.654193 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6318cab-70ba-4b4d-9155-268a68ab8370 None admin] RBAC: Authorizing `identity:get_user(user_id=50d9a1642c6d49949ced7754cbb17c79)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:25.657197 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6318cab-70ba-4b4d-9155-268a68ab8370 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:25.659754 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 112/226] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jun 16 17:06:25 2022] GET /identity/v3/users/50d9a1642c6d49949ced7754cbb17c79 => generated 283 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:06:25.665703 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6318cab-70ba-4b4d-9155-268a68ab8370 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:25.726594 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9022b0a7-d6f4-4813-93c4-08cb136a376f None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:25.742216 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:25.771210 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58b94d9-caaa-48cf-87f6-2c111ab8c1cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:25.772422 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58b94d9-caaa-48cf-87f6-2c111ab8c1cf None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:25.772764 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58b94d9-caaa-48cf-87f6-2c111ab8c1cf None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:25.773048 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58b94d9-caaa-48cf-87f6-2c111ab8c1cf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:25.786645 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58b94d9-caaa-48cf-87f6-2c111ab8c1cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 17:06:25.795148 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6318cab-70ba-4b4d-9155-268a68ab8370 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:25.795681 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application [None req-d58b94d9-caaa-48cf-87f6-2c111ab8c1cf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 17:06:25.795681 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:06:25.795681 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:06:25.795681 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:06:25.795681 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:06:25.795681 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:06:25.795681 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:06:25.795681 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:06:25.795681 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:06:25.795681 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:06:25.795681 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:06:25.795681 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:06:25.795681 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 17:06:25.795681 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 17:06:25.795681 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 17:06:25.795681 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 17:06:25.796548 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 17:06:25.796548 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 17:06:25.796548 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 17:06:25.796548 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 17:06:25.796548 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:06:25.796548 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:06:25.796548 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:06:25.796548 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:06:25.796548 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:06:25.796548 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:06:25.796548 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:06:25.796548 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application with Lock( Jun 16 17:06:25.796548 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:06:25.796548 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:06:25.796548 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:06:25.796548 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:06:25.798294 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:06:25.798294 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:06:25.798294 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:06:25.798294 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:06:25.798294 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 17:06:25.798294 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 17:06:25.798294 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 17:06:25.798294 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 17:06:25.798294 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 17:06:25.798294 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 17:06:25.798294 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 17:06:25.798294 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Jun 16 17:06:25.805476 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 115/227] 10.222.0.39 () {56 vars in 1096 bytes} [Thu Jun 16 17:06:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:06:25.806646 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58b94d9-caaa-48cf-87f6-2c111ab8c1cf None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:25.831917 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9859e864-e671-4287-b488-9e60f8596c61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:25.832687 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9859e864-e671-4287-b488-9e60f8596c61 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:25.832907 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9859e864-e671-4287-b488-9e60f8596c61 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:25.833228 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9859e864-e671-4287-b488-9e60f8596c61 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:25.834119 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9859e864-e671-4287-b488-9e60f8596c61 None admin] RBAC: Adding query filter params (role.id=896bff49c5d6464eb612a15f4aa9badc, scope.project.id=d38e49d57050488484d9f03fdb7552ee, user.id=c98b4d2469814aff8ed4d2597015a003) {{(pid=80873) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:06:25.834432 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9859e864-e671-4287-b488-9e60f8596c61 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:25.836142 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9859e864-e671-4287-b488-9e60f8596c61 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:25.839369 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:25.842664 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 113/228] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jun 16 17:06:25 2022] GET /identity/v3/role_assignments?user.id=c98b4d2469814aff8ed4d2597015a003&scope.project.id=d38e49d57050488484d9f03fdb7552ee&role.id=896bff49c5d6464eb612a15f4aa9badc => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:06:25.843651 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9859e864-e671-4287-b488-9e60f8596c61 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:25.941439 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58b94d9-caaa-48cf-87f6-2c111ab8c1cf None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:25.960465 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9859e864-e671-4287-b488-9e60f8596c61 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:25.974221 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:25.988078 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d149806-261e-495f-b364-a2787037f304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:25.989312 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d149806-261e-495f-b364-a2787037f304 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:25.989825 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d149806-261e-495f-b364-a2787037f304 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:25.990309 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d149806-261e-495f-b364-a2787037f304 None admin] PATH_INFO: `/v3/projects/d38e49d57050488484d9f03fdb7552ee` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:25.995935 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d149806-261e-495f-b364-a2787037f304 None admin] RBAC: Authorizing `identity:get_project(project_id=d38e49d57050488484d9f03fdb7552ee)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:25.997682 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d149806-261e-495f-b364-a2787037f304 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:25.999785 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 116/229] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 16 17:06:25 2022] GET /identity/v3/projects/d38e49d57050488484d9f03fdb7552ee => generated 302 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:06:26.004513 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec48ff8-8c2c-4a9c-a30e-0bd0b3a65de0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:26.004513 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec48ff8-8c2c-4a9c-a30e-0bd0b3a65de0 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:26.004513 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec48ff8-8c2c-4a9c-a30e-0bd0b3a65de0 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:26.004513 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec48ff8-8c2c-4a9c-a30e-0bd0b3a65de0 None admin] PATH_INFO: `/v3/roles` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:26.004863 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec48ff8-8c2c-4a9c-a30e-0bd0b3a65de0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80873) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:06:26.004863 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec48ff8-8c2c-4a9c-a30e-0bd0b3a65de0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:26.004981 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec48ff8-8c2c-4a9c-a30e-0bd0b3a65de0 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:26.006020 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d149806-261e-495f-b364-a2787037f304 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:26.015171 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 114/230] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 16 17:06:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:06:26.029796 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec48ff8-8c2c-4a9c-a30e-0bd0b3a65de0 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:26.123484 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:26.130696 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d149806-261e-495f-b364-a2787037f304 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:26.182545 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d873d1b-def6-42fe-acdc-8724d5a47aa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:26.183835 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d873d1b-def6-42fe-acdc-8724d5a47aa4 None admin] REQUEST_METHOD: `PUT` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:26.184308 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d873d1b-def6-42fe-acdc-8724d5a47aa4 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:26.186222 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d873d1b-def6-42fe-acdc-8724d5a47aa4 None admin] PATH_INFO: `/v3/projects/d38e49d57050488484d9f03fdb7552ee/users/50d9a1642c6d49949ced7754cbb17c79/roles/9331b396c9894ab88267e7b82ef6f224` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:26.198745 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d873d1b-def6-42fe-acdc-8724d5a47aa4 None admin] RBAC: Authorizing `identity:create_grant(project_id=d38e49d57050488484d9f03fdb7552ee, user_id=50d9a1642c6d49949ced7754cbb17c79, role_id=9331b396c9894ab88267e7b82ef6f224)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:26.200214 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d873d1b-def6-42fe-acdc-8724d5a47aa4 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:26.204332 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec48ff8-8c2c-4a9c-a30e-0bd0b3a65de0 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:26.240216 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca0e7d6-cb89-4c3b-b838-9a5a88c2df0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:26.241117 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca0e7d6-cb89-4c3b-b838-9a5a88c2df0b None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:26.241399 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca0e7d6-cb89-4c3b-b838-9a5a88c2df0b None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:26.241696 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca0e7d6-cb89-4c3b-b838-9a5a88c2df0b None admin] PATH_INFO: `/v3/users/50d9a1642c6d49949ced7754cbb17c79` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:26.242972 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca0e7d6-cb89-4c3b-b838-9a5a88c2df0b None admin] RBAC: Authorizing `identity:get_user(user_id=50d9a1642c6d49949ced7754cbb17c79)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:26.244432 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca0e7d6-cb89-4c3b-b838-9a5a88c2df0b None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:26.250754 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 115/231] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jun 16 17:06:26 2022] GET /identity/v3/users/50d9a1642c6d49949ced7754cbb17c79 => generated 283 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 17:06:26.252838 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca0e7d6-cb89-4c3b-b838-9a5a88c2df0b None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:26.290179 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:26.296521 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 117/232] 10.222.0.39 () {58 vars in 1439 bytes} [Thu Jun 16 17:06:26 2022] PUT /identity/v3/projects/d38e49d57050488484d9f03fdb7552ee/users/50d9a1642c6d49949ced7754cbb17c79/roles/9331b396c9894ab88267e7b82ef6f224 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:06:26.368829 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca0e7d6-cb89-4c3b-b838-9a5a88c2df0b None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:26.431011 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b16983c-cb16-462d-b79a-4a1e373f34ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:26.431814 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b16983c-cb16-462d-b79a-4a1e373f34ff None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:26.432091 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b16983c-cb16-462d-b79a-4a1e373f34ff None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:26.432365 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b16983c-cb16-462d-b79a-4a1e373f34ff None admin] PATH_INFO: `/v3/projects/d38e49d57050488484d9f03fdb7552ee` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:26.433663 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b16983c-cb16-462d-b79a-4a1e373f34ff None admin] RBAC: Authorizing `identity:get_project(project_id=d38e49d57050488484d9f03fdb7552ee)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:26.435191 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b16983c-cb16-462d-b79a-4a1e373f34ff None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:26.437204 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 116/233] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 16 17:06:26 2022] GET /identity/v3/projects/d38e49d57050488484d9f03fdb7552ee => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 17:06:26.443652 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d873d1b-def6-42fe-acdc-8724d5a47aa4 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:26.575311 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d873d1b-def6-42fe-acdc-8724d5a47aa4 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:26.626509 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44098611-b7cf-4e26-944e-a3573e1e50ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:26.627417 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44098611-b7cf-4e26-944e-a3573e1e50ae None admin] REQUEST_METHOD: `PUT` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:26.627704 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44098611-b7cf-4e26-944e-a3573e1e50ae None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:26.627982 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44098611-b7cf-4e26-944e-a3573e1e50ae None admin] PATH_INFO: `/v3/projects/d38e49d57050488484d9f03fdb7552ee/users/50d9a1642c6d49949ced7754cbb17c79/roles/dba744f8ab2a4c45b9d3212f8d203aba` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:26.630116 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44098611-b7cf-4e26-944e-a3573e1e50ae None admin] RBAC: Authorizing `identity:create_grant(project_id=d38e49d57050488484d9f03fdb7552ee, user_id=50d9a1642c6d49949ced7754cbb17c79, role_id=dba744f8ab2a4c45b9d3212f8d203aba)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:26.631686 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44098611-b7cf-4e26-944e-a3573e1e50ae None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:26.753266 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 118/234] 10.222.0.39 () {58 vars in 1439 bytes} [Thu Jun 16 17:06:26 2022] PUT /identity/v3/projects/d38e49d57050488484d9f03fdb7552ee/users/50d9a1642c6d49949ced7754cbb17c79/roles/dba744f8ab2a4c45b9d3212f8d203aba => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:06:27.426173 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a266c54d-699b-4436-9462-e6abc08e6b03 None None] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:27.426722 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a266c54d-699b-4436-9462-e6abc08e6b03 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:27.426722 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a266c54d-699b-4436-9462-e6abc08e6b03 None None] PATH_INFO: `/` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:27.428109 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 117/235] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 17:06:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:06:27.447733 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981eb4c0-18ad-4b87-be93-03514e926a1c None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:27.448226 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981eb4c0-18ad-4b87-be93-03514e926a1c None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:27.448303 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981eb4c0-18ad-4b87-be93-03514e926a1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:27.470040 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-981eb4c0-18ad-4b87-be93-03514e926a1c None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:06:27.471293 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-981eb4c0-18ad-4b87-be93-03514e926a1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:06:27.489715 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:27.546136 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1088e63f-32e8-44f4-a168-29c9ae1dd6be None None] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:27.546463 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1088e63f-32e8-44f4-a168-29c9ae1dd6be None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:27.546786 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1088e63f-32e8-44f4-a168-29c9ae1dd6be None None] PATH_INFO: `/` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:27.548402 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 118/236] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 17:06:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 17:06:27.554052 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bb755a-aaaa-4dc3-a96b-9e362fe3eb37 None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:27.554349 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bb755a-aaaa-4dc3-a96b-9e362fe3eb37 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:27.554636 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bb755a-aaaa-4dc3-a96b-9e362fe3eb37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:27.568481 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 119/237] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 17:06:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 17:06:27.586784 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-b8bb755a-aaaa-4dc3-a96b-9e362fe3eb37 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:06:27.587975 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-b8bb755a-aaaa-4dc3-a96b-9e362fe3eb37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:06:27.591801 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981eb4c0-18ad-4b87-be93-03514e926a1c None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:27.691510 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 119/238] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 17:06:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 17:06:27.761076 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bb755a-aaaa-4dc3-a96b-9e362fe3eb37 None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:27.773288 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981eb4c0-18ad-4b87-be93-03514e926a1c None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:27.809000 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:27.827562 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6c4f11-fa51-4867-9749-9765a8ac90c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:27.828408 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6c4f11-fa51-4867-9749-9765a8ac90c9 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:27.828699 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6c4f11-fa51-4867-9749-9765a8ac90c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:27.828984 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6c4f11-fa51-4867-9749-9765a8ac90c9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:27.840031 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6c4f11-fa51-4867-9749-9765a8ac90c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 17:06:27.848986 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application [None req-5a6c4f11-fa51-4867-9749-9765a8ac90c9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 17:06:27.848986 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:06:27.848986 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:06:27.848986 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:06:27.848986 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:06:27.848986 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:06:27.848986 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:06:27.848986 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:06:27.848986 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:06:27.848986 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:06:27.848986 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:06:27.848986 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:06:27.848986 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 17:06:27.848986 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 17:06:27.848986 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 17:06:27.848986 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 17:06:27.851437 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 17:06:27.851437 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 17:06:27.851437 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 17:06:27.851437 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 17:06:27.851437 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:06:27.851437 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:06:27.851437 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:06:27.851437 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:06:27.851437 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:06:27.851437 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:06:27.851437 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:06:27.851437 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application with Lock( Jun 16 17:06:27.851437 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:06:27.851437 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:06:27.851437 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:06:27.851437 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:06:27.853660 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:06:27.853660 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:06:27.853660 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:06:27.853660 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:06:27.853660 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 17:06:27.853660 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 17:06:27.853660 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 17:06:27.853660 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 17:06:27.853660 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 17:06:27.853660 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 17:06:27.853660 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 17:06:27.853660 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Jun 16 17:06:27.853660 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 120/239] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 16 17:06:27 2022] GET /identity/v3/roles/reader => generated 84 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 17:06:27.857871 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6c4f11-fa51-4867-9749-9765a8ac90c9 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:27.871176 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:27.966947 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bb755a-aaaa-4dc3-a96b-9e362fe3eb37 None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:28.018050 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad84874-4ecd-45a8-a146-5bfaf443303c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:28.018866 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad84874-4ecd-45a8-a146-5bfaf443303c None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:28.019207 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad84874-4ecd-45a8-a146-5bfaf443303c None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:28.019492 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad84874-4ecd-45a8-a146-5bfaf443303c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:28.020704 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad84874-4ecd-45a8-a146-5bfaf443303c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:28.022188 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad84874-4ecd-45a8-a146-5bfaf443303c None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:28.023829 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 120/240] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 17:06:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 17:06:28.030980 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad84874-4ecd-45a8-a146-5bfaf443303c None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:28.062040 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6c4f11-fa51-4867-9749-9765a8ac90c9 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:28.127319 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de7a2c2-38fb-4177-a7a7-7f01d6d917df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:28.129489 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de7a2c2-38fb-4177-a7a7-7f01d6d917df None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:28.129489 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de7a2c2-38fb-4177-a7a7-7f01d6d917df None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:28.129489 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de7a2c2-38fb-4177-a7a7-7f01d6d917df None admin] PATH_INFO: `/v3/roles` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:28.130401 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de7a2c2-38fb-4177-a7a7-7f01d6d917df None admin] RBAC: Adding query filter params (name=reader) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:06:28.130962 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de7a2c2-38fb-4177-a7a7-7f01d6d917df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:28.133101 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de7a2c2-38fb-4177-a7a7-7f01d6d917df None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:28.161671 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 121/241] 10.222.0.39 () {56 vars in 1101 bytes} [Thu Jun 16 17:06:27 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 17:06:28.179483 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de7a2c2-38fb-4177-a7a7-7f01d6d917df None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:28.236337 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:28.241371 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad84874-4ecd-45a8-a146-5bfaf443303c None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:28.288974 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47da488-3646-44f5-84f3-f0f8371cb7a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:28.290195 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47da488-3646-44f5-84f3-f0f8371cb7a3 None admin] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:28.291381 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47da488-3646-44f5-84f3-f0f8371cb7a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:28.293198 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47da488-3646-44f5-84f3-f0f8371cb7a3 None admin] PATH_INFO: `/v3/users` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:28.295546 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47da488-3646-44f5-84f3-f0f8371cb7a3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:28.297245 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47da488-3646-44f5-84f3-f0f8371cb7a3 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:28.328938 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:28.365224 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de7a2c2-38fb-4177-a7a7-7f01d6d917df None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:28.402901 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4d2227-4879-4424-a8ef-fe77135e0be6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:28.404147 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4d2227-4879-4424-a8ef-fe77135e0be6 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:28.404699 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4d2227-4879-4424-a8ef-fe77135e0be6 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:28.405163 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4d2227-4879-4424-a8ef-fe77135e0be6 None admin] PATH_INFO: `/v3/users/e70c4b129921444a830bd8b96a0e8249` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:28.420104 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4d2227-4879-4424-a8ef-fe77135e0be6 None admin] RBAC: Authorizing `identity:get_user(user_id=e70c4b129921444a830bd8b96a0e8249)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:28.422037 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4d2227-4879-4424-a8ef-fe77135e0be6 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:28.423968 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 122/242] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jun 16 17:06:28 2022] GET /identity/v3/users/e70c4b129921444a830bd8b96a0e8249 => generated 297 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 17:06:28.429373 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4d2227-4879-4424-a8ef-fe77135e0be6 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:28.514259 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 121/243] 10.222.0.39 () {60 vars in 1132 bytes} [Thu Jun 16 17:06:28 2022] POST /identity/v3/users => generated 293 bytes in 484 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:06:28.556267 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4d2227-4879-4424-a8ef-fe77135e0be6 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:28.601703 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:28.612940 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b9079b-a4ad-435a-aaa0-8f2170b064f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:28.613997 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b9079b-a4ad-435a-aaa0-8f2170b064f4 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:28.614482 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b9079b-a4ad-435a-aaa0-8f2170b064f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:28.614928 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b9079b-a4ad-435a-aaa0-8f2170b064f4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:28.684996 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e4faaa-b7c0-4978-bb0c-e0a16a5a7e75 None None] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:28.685622 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e4faaa-b7c0-4978-bb0c-e0a16a5a7e75 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:28.686102 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e4faaa-b7c0-4978-bb0c-e0a16a5a7e75 None None] PATH_INFO: `/` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:28.688343 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 122/244] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 17:06:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:06:28.694095 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ad474c-781d-4136-81d1-ad40a71c1ca9 None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:28.694338 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ad474c-781d-4136-81d1-ad40a71c1ca9 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:28.694719 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ad474c-781d-4136-81d1-ad40a71c1ca9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:28.701162 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b9079b-a4ad-435a-aaa0-8f2170b064f4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:28.703560 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b9079b-a4ad-435a-aaa0-8f2170b064f4 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:28.730605 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-e7ad474c-781d-4136-81d1-ad40a71c1ca9 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:06:28.732034 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-e7ad474c-781d-4136-81d1-ad40a71c1ca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:06:28.815602 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 123/245] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 16 17:06:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 16 17:06:28.822391 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b9079b-a4ad-435a-aaa0-8f2170b064f4 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:28.827571 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 123/246] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 17:06:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 17:06:28.851620 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:28.867674 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ad474c-781d-4136-81d1-ad40a71c1ca9 None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:28.954836 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b9079b-a4ad-435a-aaa0-8f2170b064f4 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:28.991733 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:29.002152 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06610338-f472-44dd-9b6d-b9451a802105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:29.003029 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06610338-f472-44dd-9b6d-b9451a802105 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:29.003320 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06610338-f472-44dd-9b6d-b9451a802105 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:29.003611 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06610338-f472-44dd-9b6d-b9451a802105 None admin] PATH_INFO: `/v3/projects/d38e49d57050488484d9f03fdb7552ee` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:29.004818 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06610338-f472-44dd-9b6d-b9451a802105 None admin] RBAC: Authorizing `identity:get_project(project_id=d38e49d57050488484d9f03fdb7552ee)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:29.006436 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06610338-f472-44dd-9b6d-b9451a802105 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:29.008169 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 124/247] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 16 17:06:28 2022] GET /identity/v3/projects/d38e49d57050488484d9f03fdb7552ee => generated 302 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:06:29.009429 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f953306c-d480-43f8-af93-873c922f23a4 None None] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:29.009726 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f953306c-d480-43f8-af93-873c922f23a4 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:29.010035 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f953306c-d480-43f8-af93-873c922f23a4 None None] PATH_INFO: `/` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:29.011284 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 125/248] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 17:06:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:06:29.013918 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f953306c-d480-43f8-af93-873c922f23a4 None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:29.016824 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ad474c-781d-4136-81d1-ad40a71c1ca9 None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:29.070136 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653fdc18-9d63-4a47-a81d-18df840bd82b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:29.070884 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653fdc18-9d63-4a47-a81d-18df840bd82b None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:29.071175 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653fdc18-9d63-4a47-a81d-18df840bd82b None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:29.071457 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653fdc18-9d63-4a47-a81d-18df840bd82b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:29.089633 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653fdc18-9d63-4a47-a81d-18df840bd82b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 17:06:29.097599 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application [None req-653fdc18-9d63-4a47-a81d-18df840bd82b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 17:06:29.097599 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:06:29.097599 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:06:29.097599 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:06:29.097599 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:06:29.097599 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:06:29.097599 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:06:29.097599 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:06:29.097599 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:06:29.097599 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:06:29.097599 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:06:29.097599 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:06:29.097599 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 17:06:29.097599 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 17:06:29.097599 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 17:06:29.097599 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 17:06:29.098535 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 17:06:29.098535 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 17:06:29.098535 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 17:06:29.098535 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 17:06:29.098535 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:06:29.098535 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:06:29.098535 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:06:29.098535 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:06:29.098535 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:06:29.098535 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:06:29.098535 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:06:29.098535 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application with Lock( Jun 16 17:06:29.098535 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:06:29.098535 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:06:29.098535 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:06:29.098535 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:06:29.099322 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:06:29.099322 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:06:29.099322 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:06:29.099322 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:06:29.099322 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 17:06:29.099322 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 17:06:29.099322 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 17:06:29.099322 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 17:06:29.099322 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 17:06:29.099322 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 17:06:29.099322 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 17:06:29.099322 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Jun 16 17:06:29.101845 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 124/249] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 16 17:06:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:06:29.103483 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ffb58b-4980-4bcf-b8d1-2ae11c4ab74b None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:29.103844 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ffb58b-4980-4bcf-b8d1-2ae11c4ab74b None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:29.104193 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ffb58b-4980-4bcf-b8d1-2ae11c4ab74b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:29.123315 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-05ffb58b-4980-4bcf-b8d1-2ae11c4ab74b None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:06:29.125147 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-05ffb58b-4980-4bcf-b8d1-2ae11c4ab74b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:06:29.134390 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:29.145265 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f953306c-d480-43f8-af93-873c922f23a4 None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:29.186895 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66a202e-420e-4203-8454-a59afa587861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:29.188524 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66a202e-420e-4203-8454-a59afa587861 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:29.189036 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66a202e-420e-4203-8454-a59afa587861 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:29.189523 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66a202e-420e-4203-8454-a59afa587861 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:29.190622 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66a202e-420e-4203-8454-a59afa587861 None admin] RBAC: Adding query filter params (role.id=74b3015ca91b437f8d6ee242563b6547, scope.project.id=d38e49d57050488484d9f03fdb7552ee, user.id=e70c4b129921444a830bd8b96a0e8249) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:06:29.191145 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66a202e-420e-4203-8454-a59afa587861 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:29.192804 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66a202e-420e-4203-8454-a59afa587861 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:29.201002 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 126/250] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jun 16 17:06:29 2022] GET /identity/v3/role_assignments?user.id=e70c4b129921444a830bd8b96a0e8249&scope.project.id=d38e49d57050488484d9f03fdb7552ee&role.id=74b3015ca91b437f8d6ee242563b6547 => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 17:06:29.202647 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66a202e-420e-4203-8454-a59afa587861 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:29.249339 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 125/251] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 17:06:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 17:06:29.304298 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ffb58b-4980-4bcf-b8d1-2ae11c4ab74b None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:29.371649 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66a202e-420e-4203-8454-a59afa587861 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:29.467687 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:29.483623 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1a9310-1e82-4f0b-b5dc-6af916b19a16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:29.484938 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1a9310-1e82-4f0b-b5dc-6af916b19a16 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:29.485228 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1a9310-1e82-4f0b-b5dc-6af916b19a16 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:29.485511 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1a9310-1e82-4f0b-b5dc-6af916b19a16 None admin] PATH_INFO: `/v3/roles` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:29.486324 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1a9310-1e82-4f0b-b5dc-6af916b19a16 None admin] RBAC: Adding query filter params (name=member) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:06:29.486634 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1a9310-1e82-4f0b-b5dc-6af916b19a16 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:29.488071 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1a9310-1e82-4f0b-b5dc-6af916b19a16 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:29.509306 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 127/252] 10.222.0.39 () {56 vars in 1101 bytes} [Thu Jun 16 17:06:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:06:29.515870 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1a9310-1e82-4f0b-b5dc-6af916b19a16 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:29.525548 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ffb58b-4980-4bcf-b8d1-2ae11c4ab74b None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:29.586132 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:29.603659 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238f16bd-1ac5-4346-87a3-5ec1179f030e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:29.604493 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238f16bd-1ac5-4346-87a3-5ec1179f030e None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:29.604780 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238f16bd-1ac5-4346-87a3-5ec1179f030e None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:29.605061 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238f16bd-1ac5-4346-87a3-5ec1179f030e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:29.634922 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238f16bd-1ac5-4346-87a3-5ec1179f030e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 17:06:29.643787 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application [None req-238f16bd-1ac5-4346-87a3-5ec1179f030e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 17:06:29.643787 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:06:29.643787 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:06:29.643787 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:06:29.643787 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:06:29.643787 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:06:29.643787 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:06:29.643787 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:06:29.643787 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:06:29.643787 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:06:29.643787 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:06:29.643787 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:06:29.643787 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 17:06:29.643787 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 17:06:29.643787 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 17:06:29.643787 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 17:06:29.644748 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 17:06:29.644748 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 17:06:29.644748 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 17:06:29.644748 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 17:06:29.644748 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:06:29.644748 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:06:29.644748 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:06:29.644748 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:06:29.644748 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:06:29.644748 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:06:29.644748 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:06:29.644748 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application with Lock( Jun 16 17:06:29.644748 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:06:29.644748 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:06:29.644748 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:06:29.644748 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:06:29.645537 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:06:29.645537 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:06:29.645537 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:06:29.645537 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:06:29.645537 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 17:06:29.645537 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 17:06:29.645537 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 17:06:29.645537 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 17:06:29.645537 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 17:06:29.645537 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 17:06:29.645537 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 17:06:29.645537 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Jun 16 17:06:29.645537 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 126/253] 10.222.0.39 () {56 vars in 1114 bytes} [Thu Jun 16 17:06:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 341 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 17:06:29.677886 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238f16bd-1ac5-4346-87a3-5ec1179f030e None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:29.692690 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1a9310-1e82-4f0b-b5dc-6af916b19a16 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:29.732198 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53665fb-5e39-46e0-a087-0fc87ab6f046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:29.733435 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53665fb-5e39-46e0-a087-0fc87ab6f046 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:29.734531 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53665fb-5e39-46e0-a087-0fc87ab6f046 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:29.736018 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53665fb-5e39-46e0-a087-0fc87ab6f046 None admin] PATH_INFO: `/v3/users/c98b4d2469814aff8ed4d2597015a003` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:29.737653 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53665fb-5e39-46e0-a087-0fc87ab6f046 None admin] RBAC: Authorizing `identity:get_user(user_id=c98b4d2469814aff8ed4d2597015a003)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:29.741339 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53665fb-5e39-46e0-a087-0fc87ab6f046 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:29.744576 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 128/254] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jun 16 17:06:29 2022] GET /identity/v3/users/c98b4d2469814aff8ed4d2597015a003 => generated 297 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 17:06:29.747209 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a47aa7a-df86-4cc0-8c74-28def60e8497 None None] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:29.748424 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a47aa7a-df86-4cc0-8c74-28def60e8497 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:29.750136 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a47aa7a-df86-4cc0-8c74-28def60e8497 None None] PATH_INFO: `/` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:29.751990 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 129/255] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 17:06:29 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:06:29.754212 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a47aa7a-df86-4cc0-8c74-28def60e8497 None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:29.886676 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238f16bd-1ac5-4346-87a3-5ec1179f030e None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:29.928874 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af62b8b4-f573-4a94-9daa-d0ae8ba086f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:29.929558 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af62b8b4-f573-4a94-9daa-d0ae8ba086f0 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:29.929874 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af62b8b4-f573-4a94-9daa-d0ae8ba086f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:29.930167 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af62b8b4-f573-4a94-9daa-d0ae8ba086f0 None admin] PATH_INFO: `/v3/roles` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:29.930935 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af62b8b4-f573-4a94-9daa-d0ae8ba086f0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80873) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:06:29.931250 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af62b8b4-f573-4a94-9daa-d0ae8ba086f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:29.933372 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af62b8b4-f573-4a94-9daa-d0ae8ba086f0 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:29.935112 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:29.953268 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 127/256] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 16 17:06:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 17:06:29.955951 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46748345-857d-4023-89b9-e673d0049c86 None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:29.956244 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46748345-857d-4023-89b9-e673d0049c86 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:29.956527 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46748345-857d-4023-89b9-e673d0049c86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:29.989243 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-46748345-857d-4023-89b9-e673d0049c86 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:06:29.991522 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-46748345-857d-4023-89b9-e673d0049c86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:06:30.005391 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:30.028038 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a47aa7a-df86-4cc0-8c74-28def60e8497 None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:30.110778 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 128/257] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 17:06:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 17:06:30.111646 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46748345-857d-4023-89b9-e673d0049c86 None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:30.134869 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4603839f-1782-447a-b756-66500d1fc0f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:30.136898 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4603839f-1782-447a-b756-66500d1fc0f4 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:30.137654 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4603839f-1782-447a-b756-66500d1fc0f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:30.138470 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4603839f-1782-447a-b756-66500d1fc0f4 None admin] PATH_INFO: `/v3/projects/d38e49d57050488484d9f03fdb7552ee` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:30.147001 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4603839f-1782-447a-b756-66500d1fc0f4 None admin] RBAC: Authorizing `identity:get_project(project_id=d38e49d57050488484d9f03fdb7552ee)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:30.150142 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4603839f-1782-447a-b756-66500d1fc0f4 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:30.154038 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 130/258] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 16 17:06:29 2022] GET /identity/v3/projects/d38e49d57050488484d9f03fdb7552ee => generated 302 bytes in 400 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:06:30.175833 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4603839f-1782-447a-b756-66500d1fc0f4 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:30.231896 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46748345-857d-4023-89b9-e673d0049c86 None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:30.263766 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:30.273397 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7b8e41-a7f6-4ae1-9720-9cc86b4a8793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:30.274831 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7b8e41-a7f6-4ae1-9720-9cc86b4a8793 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:30.275414 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7b8e41-a7f6-4ae1-9720-9cc86b4a8793 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:30.275977 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7b8e41-a7f6-4ae1-9720-9cc86b4a8793 None admin] PATH_INFO: `/v3/users/50d9a1642c6d49949ced7754cbb17c79` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:30.277382 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7b8e41-a7f6-4ae1-9720-9cc86b4a8793 None admin] RBAC: Authorizing `identity:get_user(user_id=50d9a1642c6d49949ced7754cbb17c79)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:30.279163 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7b8e41-a7f6-4ae1-9720-9cc86b4a8793 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:30.281843 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 129/259] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jun 16 17:06:30 2022] GET /identity/v3/users/50d9a1642c6d49949ced7754cbb17c79 => generated 283 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:06:30.282900 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7b8e41-a7f6-4ae1-9720-9cc86b4a8793 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:30.395277 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7b8e41-a7f6-4ae1-9720-9cc86b4a8793 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:30.430349 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c831ce2-b67c-484e-9395-b49fc3d5329a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:30.431543 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c831ce2-b67c-484e-9395-b49fc3d5329a None admin] REQUEST_METHOD: `PUT` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:30.432048 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c831ce2-b67c-484e-9395-b49fc3d5329a None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:30.432511 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c831ce2-b67c-484e-9395-b49fc3d5329a None admin] PATH_INFO: `/v3/projects/d38e49d57050488484d9f03fdb7552ee/users/c98b4d2469814aff8ed4d2597015a003/roles/896bff49c5d6464eb612a15f4aa9badc` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:30.435304 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c831ce2-b67c-484e-9395-b49fc3d5329a None admin] RBAC: Authorizing `identity:create_grant(project_id=d38e49d57050488484d9f03fdb7552ee, user_id=c98b4d2469814aff8ed4d2597015a003, role_id=896bff49c5d6464eb612a15f4aa9badc)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:30.437839 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c831ce2-b67c-484e-9395-b49fc3d5329a None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:30.443728 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4603839f-1782-447a-b756-66500d1fc0f4 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:30.482251 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a509f5-401b-4253-ab2e-23d58c9a496d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:30.483355 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a509f5-401b-4253-ab2e-23d58c9a496d None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:30.483874 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a509f5-401b-4253-ab2e-23d58c9a496d None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:30.484340 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a509f5-401b-4253-ab2e-23d58c9a496d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:30.495698 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a509f5-401b-4253-ab2e-23d58c9a496d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 17:06:30.506680 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 130/260] 10.222.0.39 () {58 vars in 1439 bytes} [Thu Jun 16 17:06:30 2022] PUT /identity/v3/projects/d38e49d57050488484d9f03fdb7552ee/users/c98b4d2469814aff8ed4d2597015a003/roles/896bff49c5d6464eb612a15f4aa9badc => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:06:30.507953 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c831ce2-b67c-484e-9395-b49fc3d5329a None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:30.516548 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application [None req-12a509f5-401b-4253-ab2e-23d58c9a496d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 17:06:30.516548 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:06:30.516548 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:06:30.516548 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:06:30.516548 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:06:30.516548 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:06:30.516548 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:06:30.516548 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:06:30.516548 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:06:30.516548 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:06:30.516548 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:06:30.516548 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:06:30.516548 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 17:06:30.516548 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 17:06:30.516548 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 17:06:30.516548 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 17:06:30.517575 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 17:06:30.517575 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 17:06:30.517575 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 17:06:30.517575 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 17:06:30.517575 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:06:30.517575 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:06:30.517575 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:06:30.517575 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:06:30.517575 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:06:30.517575 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:06:30.517575 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:06:30.517575 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application with Lock( Jun 16 17:06:30.517575 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:06:30.517575 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:06:30.517575 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:06:30.517575 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:06:30.518795 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:06:30.518795 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:06:30.518795 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:06:30.518795 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:06:30.518795 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 17:06:30.518795 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 17:06:30.518795 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 17:06:30.518795 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 17:06:30.518795 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 17:06:30.518795 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 17:06:30.518795 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 17:06:30.518795 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Jun 16 17:06:30.518795 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 131/261] 10.222.0.39 () {56 vars in 1096 bytes} [Thu Jun 16 17:06:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 343 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:06:30.524471 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a509f5-401b-4253-ab2e-23d58c9a496d None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:30.568309 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:30.610833 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:30.712843 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c831ce2-b67c-484e-9395-b49fc3d5329a None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:30.745415 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a509f5-401b-4253-ab2e-23d58c9a496d None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:30.751646 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8018cc-d388-45de-9cfd-40f40fa1ee66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:30.752300 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8018cc-d388-45de-9cfd-40f40fa1ee66 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:30.752589 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8018cc-d388-45de-9cfd-40f40fa1ee66 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:30.752932 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8018cc-d388-45de-9cfd-40f40fa1ee66 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:30.812662 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db0d100-27b7-45dc-8275-c2ce3173f4de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:30.813342 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db0d100-27b7-45dc-8275-c2ce3173f4de None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:30.813637 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db0d100-27b7-45dc-8275-c2ce3173f4de None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:30.813948 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db0d100-27b7-45dc-8275-c2ce3173f4de None admin] PATH_INFO: `/v3/roles` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:30.814849 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db0d100-27b7-45dc-8275-c2ce3173f4de None admin] RBAC: Adding query filter params (name=admin) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:06:30.815182 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db0d100-27b7-45dc-8275-c2ce3173f4de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:30.816644 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db0d100-27b7-45dc-8275-c2ce3173f4de None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:30.824904 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8018cc-d388-45de-9cfd-40f40fa1ee66 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:30.826748 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8018cc-d388-45de-9cfd-40f40fa1ee66 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:30.832100 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 132/262] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 16 17:06:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 17:06:30.837711 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db0d100-27b7-45dc-8275-c2ce3173f4de None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:30.892453 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:30.936179 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 131/263] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 16 17:06:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 17:06:30.941690 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8018cc-d388-45de-9cfd-40f40fa1ee66 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:31.045489 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8018cc-d388-45de-9cfd-40f40fa1ee66 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:31.064277 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:31.083989 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566bf79f-c528-4dd4-90fc-e4c015673d7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:31.085030 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566bf79f-c528-4dd4-90fc-e4c015673d7e None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:31.085423 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566bf79f-c528-4dd4-90fc-e4c015673d7e None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:31.085898 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566bf79f-c528-4dd4-90fc-e4c015673d7e None admin] PATH_INFO: `/v3/projects/d38e49d57050488484d9f03fdb7552ee` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:31.087216 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566bf79f-c528-4dd4-90fc-e4c015673d7e None admin] RBAC: Authorizing `identity:get_project(project_id=d38e49d57050488484d9f03fdb7552ee)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:31.089033 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566bf79f-c528-4dd4-90fc-e4c015673d7e None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:31.091233 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 132/264] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 16 17:06:30 2022] GET /identity/v3/projects/d38e49d57050488484d9f03fdb7552ee => generated 302 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 17:06:31.098003 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566bf79f-c528-4dd4-90fc-e4c015673d7e None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:31.101712 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db0d100-27b7-45dc-8275-c2ce3173f4de None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:31.127538 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:31.166482 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e287fb-0b70-414a-ac82-6188ade120ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:31.167384 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e287fb-0b70-414a-ac82-6188ade120ef None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:31.167671 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e287fb-0b70-414a-ac82-6188ade120ef None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:31.167957 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e287fb-0b70-414a-ac82-6188ade120ef None admin] PATH_INFO: `/v3/users/50d9a1642c6d49949ced7754cbb17c79` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:31.169235 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e287fb-0b70-414a-ac82-6188ade120ef None admin] RBAC: Authorizing `identity:get_user(user_id=50d9a1642c6d49949ced7754cbb17c79)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:31.170730 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e287fb-0b70-414a-ac82-6188ade120ef None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:31.172470 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 133/265] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jun 16 17:06:30 2022] GET /identity/v3/users/50d9a1642c6d49949ced7754cbb17c79 => generated 283 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 17:06:31.182749 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e287fb-0b70-414a-ac82-6188ade120ef None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:31.230918 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566bf79f-c528-4dd4-90fc-e4c015673d7e None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:31.268272 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234d9f91-9170-4b3c-8065-133afbe60f81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:31.268964 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234d9f91-9170-4b3c-8065-133afbe60f81 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:31.269252 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234d9f91-9170-4b3c-8065-133afbe60f81 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:31.269533 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234d9f91-9170-4b3c-8065-133afbe60f81 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:31.270422 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234d9f91-9170-4b3c-8065-133afbe60f81 None admin] RBAC: Adding query filter params (role.id=9331b396c9894ab88267e7b82ef6f224, scope.project.id=d38e49d57050488484d9f03fdb7552ee, user.id=50d9a1642c6d49949ced7754cbb17c79) {{(pid=80873) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:06:31.270716 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234d9f91-9170-4b3c-8065-133afbe60f81 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:31.272154 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234d9f91-9170-4b3c-8065-133afbe60f81 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:31.283372 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 133/266] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jun 16 17:06:31 2022] GET /identity/v3/role_assignments?user.id=50d9a1642c6d49949ced7754cbb17c79&scope.project.id=d38e49d57050488484d9f03fdb7552ee&role.id=9331b396c9894ab88267e7b82ef6f224 => generated 608 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 17:06:31.445744 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e287fb-0b70-414a-ac82-6188ade120ef None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:31.519673 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2a539d-09e4-45b5-aa04-298199a681ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:31.520725 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2a539d-09e4-45b5-aa04-298199a681ad None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:31.521221 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2a539d-09e4-45b5-aa04-298199a681ad None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:31.521727 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2a539d-09e4-45b5-aa04-298199a681ad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:31.549088 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:31.645567 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2a539d-09e4-45b5-aa04-298199a681ad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:31.647102 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2a539d-09e4-45b5-aa04-298199a681ad None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:31.866200 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 134/267] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 16 17:06:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 684 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 17:06:31.872023 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234d9f91-9170-4b3c-8065-133afbe60f81 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:31.920863 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ab16f1-51ae-4fee-b4ae-3c427e8daaff None None] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:31.922145 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ab16f1-51ae-4fee-b4ae-3c427e8daaff None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:31.922750 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ab16f1-51ae-4fee-b4ae-3c427e8daaff None None] PATH_INFO: `/` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:31.925689 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 135/268] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 17:06:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:06:31.930449 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404ef5aa-d8ca-4769-a0ca-5d7a229d631d None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:31.931110 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404ef5aa-d8ca-4769-a0ca-5d7a229d631d None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:31.931598 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404ef5aa-d8ca-4769-a0ca-5d7a229d631d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:31.949697 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-404ef5aa-d8ca-4769-a0ca-5d7a229d631d None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:06:31.951283 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-404ef5aa-d8ca-4769-a0ca-5d7a229d631d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:06:32.006142 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:32.034121 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:32.053702 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 136/269] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 17:06:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 17:06:32.065114 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234d9f91-9170-4b3c-8065-133afbe60f81 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:32.090828 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404ef5aa-d8ca-4769-a0ca-5d7a229d631d None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:32.129826 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2048bb99-00a3-4ac5-b0aa-3d6dd525895d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:32.131120 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2048bb99-00a3-4ac5-b0aa-3d6dd525895d None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:32.131633 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2048bb99-00a3-4ac5-b0aa-3d6dd525895d None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:32.132108 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2048bb99-00a3-4ac5-b0aa-3d6dd525895d None admin] PATH_INFO: `/v3/projects/d38e49d57050488484d9f03fdb7552ee` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:32.133636 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2048bb99-00a3-4ac5-b0aa-3d6dd525895d None admin] RBAC: Authorizing `identity:get_project(project_id=d38e49d57050488484d9f03fdb7552ee)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:32.135399 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2048bb99-00a3-4ac5-b0aa-3d6dd525895d None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:32.137754 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 134/270] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 16 17:06:31 2022] GET /identity/v3/projects/d38e49d57050488484d9f03fdb7552ee => generated 302 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:06:32.146253 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2048bb99-00a3-4ac5-b0aa-3d6dd525895d None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:32.236089 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404ef5aa-d8ca-4769-a0ca-5d7a229d631d None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:32.266057 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2048bb99-00a3-4ac5-b0aa-3d6dd525895d None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:32.271788 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e24f69-d838-41ba-bd77-8e14db4e10ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:32.272610 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e24f69-d838-41ba-bd77-8e14db4e10ae None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:32.272923 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e24f69-d838-41ba-bd77-8e14db4e10ae None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:32.273248 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e24f69-d838-41ba-bd77-8e14db4e10ae None admin] PATH_INFO: `/v3/roles/member` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:32.283884 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e24f69-d838-41ba-bd77-8e14db4e10ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 17:06:32.291786 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application [None req-43e24f69-d838-41ba-bd77-8e14db4e10ae None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 17:06:32.291786 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:06:32.291786 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:06:32.291786 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:06:32.291786 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:06:32.291786 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:06:32.291786 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:06:32.291786 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:06:32.291786 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:06:32.291786 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:06:32.291786 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:06:32.291786 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:06:32.291786 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 17:06:32.291786 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 17:06:32.291786 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 17:06:32.291786 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 17:06:32.292677 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 17:06:32.292677 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 17:06:32.292677 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 17:06:32.292677 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 17:06:32.292677 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:06:32.292677 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:06:32.292677 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:06:32.292677 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:06:32.292677 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:06:32.292677 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:06:32.292677 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:06:32.292677 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application with Lock( Jun 16 17:06:32.292677 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:06:32.292677 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:06:32.292677 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:06:32.292677 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:06:32.293462 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:06:32.293462 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:06:32.293462 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:06:32.293462 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:06:32.293462 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 17:06:32.293462 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 17:06:32.293462 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 17:06:32.293462 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 17:06:32.293462 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 17:06:32.293462 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 17:06:32.293462 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 17:06:32.293462 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Jun 16 17:06:32.293462 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 137/271] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 16 17:06:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 17:06:32.294638 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325d5e6f-0436-47bf-b4c3-55cbc44460de None None] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:32.295170 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325d5e6f-0436-47bf-b4c3-55cbc44460de None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:32.295170 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325d5e6f-0436-47bf-b4c3-55cbc44460de None None] PATH_INFO: `/` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:32.297284 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 138/272] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 17:06:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:06:32.302789 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325d5e6f-0436-47bf-b4c3-55cbc44460de None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:32.307438 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a73c737-345e-4526-b4e4-034346cca0e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:32.308265 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a73c737-345e-4526-b4e4-034346cca0e9 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:32.308689 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a73c737-345e-4526-b4e4-034346cca0e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:32.309107 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a73c737-345e-4526-b4e4-034346cca0e9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:32.310138 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a73c737-345e-4526-b4e4-034346cca0e9 None admin] RBAC: Adding query filter params (role.id=dba744f8ab2a4c45b9d3212f8d203aba, scope.project.id=d38e49d57050488484d9f03fdb7552ee, user.id=50d9a1642c6d49949ced7754cbb17c79) {{(pid=80873) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:06:32.310593 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a73c737-345e-4526-b4e4-034346cca0e9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:32.312909 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a73c737-345e-4526-b4e4-034346cca0e9 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:32.320202 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 135/273] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jun 16 17:06:32 2022] GET /identity/v3/role_assignments?user.id=50d9a1642c6d49949ced7754cbb17c79&scope.project.id=d38e49d57050488484d9f03fdb7552ee&role.id=dba744f8ab2a4c45b9d3212f8d203aba => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 17:06:32.321710 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1971b3-a03c-4b9c-a4ef-5d06f849528d None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:32.322234 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1971b3-a03c-4b9c-a4ef-5d06f849528d None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:32.322803 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1971b3-a03c-4b9c-a4ef-5d06f849528d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:32.341082 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-1d1971b3-a03c-4b9c-a4ef-5d06f849528d None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:06:32.342603 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:32.344037 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-1d1971b3-a03c-4b9c-a4ef-5d06f849528d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:06:32.360234 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:32.429266 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 136/274] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 17:06:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 17:06:32.472842 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325d5e6f-0436-47bf-b4c3-55cbc44460de None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:32.508802 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1971b3-a03c-4b9c-a4ef-5d06f849528d None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:32.518473 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee2b99e-1336-434a-939a-010a41802acb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:32.519165 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee2b99e-1336-434a-939a-010a41802acb None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:32.519449 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee2b99e-1336-434a-939a-010a41802acb None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:32.519731 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee2b99e-1336-434a-939a-010a41802acb None admin] PATH_INFO: `/v3/roles` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:32.520496 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee2b99e-1336-434a-939a-010a41802acb None admin] RBAC: Adding query filter params (name=member) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:06:32.520809 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee2b99e-1336-434a-939a-010a41802acb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:32.522257 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee2b99e-1336-434a-939a-010a41802acb None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:32.534629 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 139/275] 10.222.0.39 () {56 vars in 1101 bytes} [Thu Jun 16 17:06:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:06:32.539878 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee2b99e-1336-434a-939a-010a41802acb None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:32.650733 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1971b3-a03c-4b9c-a4ef-5d06f849528d None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:32.660296 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:32.663738 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee2b99e-1336-434a-939a-010a41802acb None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:32.696452 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f67b49-651d-4af9-9cc0-8ea52cb16ff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:32.697533 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f67b49-651d-4af9-9cc0-8ea52cb16ff6 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:32.698077 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f67b49-651d-4af9-9cc0-8ea52cb16ff6 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:32.698644 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f67b49-651d-4af9-9cc0-8ea52cb16ff6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:32.700405 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f67b49-651d-4af9-9cc0-8ea52cb16ff6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:32.702054 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f67b49-651d-4af9-9cc0-8ea52cb16ff6 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:32.704303 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 137/276] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 17:06:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 17:06:32.705562 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02515eb-305f-4eee-8462-a4f959824424 None None] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:32.706280 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02515eb-305f-4eee-8462-a4f959824424 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:32.706280 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02515eb-305f-4eee-8462-a4f959824424 None None] PATH_INFO: `/` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:32.707524 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 138/277] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 17:06:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:06:32.712798 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8185be-16cc-4431-9933-45d66d307272 None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:32.713097 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8185be-16cc-4431-9933-45d66d307272 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:32.713383 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8185be-16cc-4431-9933-45d66d307272 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:32.716457 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4623f7-47b1-4e16-9311-f61aa5125c62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:32.717584 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4623f7-47b1-4e16-9311-f61aa5125c62 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:32.718287 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4623f7-47b1-4e16-9311-f61aa5125c62 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:32.718790 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4623f7-47b1-4e16-9311-f61aa5125c62 None admin] PATH_INFO: `/v3/users/44c6e1641237410b9a64d242475895b4` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:32.730967 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-1a8185be-16cc-4431-9933-45d66d307272 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:06:32.732177 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-1a8185be-16cc-4431-9933-45d66d307272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:06:32.733904 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4623f7-47b1-4e16-9311-f61aa5125c62 None admin] RBAC: Authorizing `identity:get_user(user_id=44c6e1641237410b9a64d242475895b4)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:32.735561 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4623f7-47b1-4e16-9311-f61aa5125c62 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:32.737289 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 140/278] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jun 16 17:06:32 2022] GET /identity/v3/users/44c6e1641237410b9a64d242475895b4 => generated 293 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 17:06:32.738117 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4623f7-47b1-4e16-9311-f61aa5125c62 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:32.744028 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:32.803835 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 139/279] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 17:06:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 17:06:32.814010 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8185be-16cc-4431-9933-45d66d307272 None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:32.861412 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4623f7-47b1-4e16-9311-f61aa5125c62 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:32.900479 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86302c4e-4017-4b24-a49d-ff8ced4481f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:32.901149 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86302c4e-4017-4b24-a49d-ff8ced4481f3 None admin] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:32.901443 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86302c4e-4017-4b24-a49d-ff8ced4481f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:32.901727 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86302c4e-4017-4b24-a49d-ff8ced4481f3 None admin] PATH_INFO: `/v3/users` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:32.902484 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86302c4e-4017-4b24-a49d-ff8ced4481f3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:32.903921 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86302c4e-4017-4b24-a49d-ff8ced4481f3 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:32.924213 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8185be-16cc-4431-9933-45d66d307272 None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:32.959537 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ece53d-2e98-4286-b4ab-4cb8a1a57013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:32.960116 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ece53d-2e98-4286-b4ab-4cb8a1a57013 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:32.960402 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ece53d-2e98-4286-b4ab-4cb8a1a57013 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:32.960684 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ece53d-2e98-4286-b4ab-4cb8a1a57013 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:32.961514 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ece53d-2e98-4286-b4ab-4cb8a1a57013 None admin] RBAC: Adding query filter params (role.id=896bff49c5d6464eb612a15f4aa9badc, user.id=44c6e1641237410b9a64d242475895b4, scope.system=all) {{(pid=80873) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:06:32.961862 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ece53d-2e98-4286-b4ab-4cb8a1a57013 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:32.963426 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ece53d-2e98-4286-b4ab-4cb8a1a57013 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:32.968985 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 140/280] 10.222.0.39 () {56 vars in 1308 bytes} [Thu Jun 16 17:06:32 2022] GET /identity/v3/role_assignments?user.id=44c6e1641237410b9a64d242475895b4&scope.system=all&role.id=896bff49c5d6464eb612a15f4aa9badc => generated 226 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:06:32.970608 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ece53d-2e98-4286-b4ab-4cb8a1a57013 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:32.985105 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:33.019952 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 141/281] 10.222.0.39 () {60 vars in 1132 bytes} [Thu Jun 16 17:06:32 2022] POST /identity/v3/users => generated 293 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:06:33.104580 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ece53d-2e98-4286-b4ab-4cb8a1a57013 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:33.148829 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975dcb9d-30c8-4846-a824-1eb4e6a55116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:33.150024 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975dcb9d-30c8-4846-a824-1eb4e6a55116 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:33.150537 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975dcb9d-30c8-4846-a824-1eb4e6a55116 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:33.151066 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975dcb9d-30c8-4846-a824-1eb4e6a55116 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:33.165020 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975dcb9d-30c8-4846-a824-1eb4e6a55116 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 17:06:33.174344 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application [None req-975dcb9d-30c8-4846-a824-1eb4e6a55116 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 17:06:33.174344 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:06:33.174344 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:06:33.174344 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:06:33.174344 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:06:33.174344 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:06:33.174344 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:06:33.174344 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:06:33.174344 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:06:33.174344 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:06:33.174344 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:06:33.174344 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:06:33.174344 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 17:06:33.174344 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 17:06:33.174344 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 17:06:33.174344 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 17:06:33.175346 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 17:06:33.175346 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 17:06:33.175346 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 17:06:33.175346 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 17:06:33.175346 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:06:33.175346 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:06:33.175346 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:06:33.175346 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:06:33.175346 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:06:33.175346 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:06:33.175346 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:06:33.175346 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application with Lock( Jun 16 17:06:33.175346 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:06:33.175346 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:06:33.175346 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:06:33.175346 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:06:33.176141 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:06:33.176141 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:06:33.176141 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:06:33.176141 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:06:33.176141 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 17:06:33.176141 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 17:06:33.176141 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 17:06:33.176141 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 17:06:33.176141 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 17:06:33.176141 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 17:06:33.176141 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 17:06:33.176141 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Jun 16 17:06:33.178783 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 141/282] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 16 17:06:32 2022] GET /identity/v3/roles/reader => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:06:33.185169 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86302c4e-4017-4b24-a49d-ff8ced4481f3 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:33.204245 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:33.297861 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86302c4e-4017-4b24-a49d-ff8ced4481f3 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:33.336450 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851061fa-71c1-47fd-a71a-30480d409df1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:33.337369 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851061fa-71c1-47fd-a71a-30480d409df1 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:33.337836 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851061fa-71c1-47fd-a71a-30480d409df1 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:33.338291 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851061fa-71c1-47fd-a71a-30480d409df1 None admin] PATH_INFO: `/v3/roles` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:33.339205 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851061fa-71c1-47fd-a71a-30480d409df1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:06:33.339668 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851061fa-71c1-47fd-a71a-30480d409df1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:33.341207 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851061fa-71c1-47fd-a71a-30480d409df1 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:33.351184 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 142/283] 10.222.0.39 () {56 vars in 1101 bytes} [Thu Jun 16 17:06:33 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:06:33.357033 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975dcb9d-30c8-4846-a824-1eb4e6a55116 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:33.457041 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:33.490313 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975dcb9d-30c8-4846-a824-1eb4e6a55116 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:33.509099 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7300de08-ccc6-4412-826d-89e63e21f361 None None] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:33.509403 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7300de08-ccc6-4412-826d-89e63e21f361 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:33.509668 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7300de08-ccc6-4412-826d-89e63e21f361 None None] PATH_INFO: `/` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:33.511345 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 143/284] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 17:06:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:06:33.517048 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17515b3-4830-4720-80dd-47f6f59f9bd2 None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:33.517350 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17515b3-4830-4720-80dd-47f6f59f9bd2 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:33.517638 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17515b3-4830-4720-80dd-47f6f59f9bd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:33.537991 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4b1553-051d-4404-bfa8-d26476ca827e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:33.539271 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4b1553-051d-4404-bfa8-d26476ca827e None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:33.544631 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4b1553-051d-4404-bfa8-d26476ca827e None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:33.545144 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4b1553-051d-4404-bfa8-d26476ca827e None admin] PATH_INFO: `/v3/users/e70c4b129921444a830bd8b96a0e8249` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:33.547011 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4b1553-051d-4404-bfa8-d26476ca827e None admin] RBAC: Authorizing `identity:get_user(user_id=e70c4b129921444a830bd8b96a0e8249)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:33.548821 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4b1553-051d-4404-bfa8-d26476ca827e None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:33.550736 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 142/285] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jun 16 17:06:33 2022] GET /identity/v3/users/e70c4b129921444a830bd8b96a0e8249 => generated 297 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:06:33.556184 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4b1553-051d-4404-bfa8-d26476ca827e None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:33.557635 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-b17515b3-4830-4720-80dd-47f6f59f9bd2 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:06:33.559378 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-b17515b3-4830-4720-80dd-47f6f59f9bd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:06:33.677422 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4b1553-051d-4404-bfa8-d26476ca827e None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:33.693383 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 144/286] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 17:06:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 17:06:33.721178 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b602013-3cd4-4163-8493-3c9974697239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:33.722161 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b602013-3cd4-4163-8493-3c9974697239 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:33.722451 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b602013-3cd4-4163-8493-3c9974697239 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:33.722733 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b602013-3cd4-4163-8493-3c9974697239 None admin] PATH_INFO: `/v3/projects/d38e49d57050488484d9f03fdb7552ee` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:33.724003 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b602013-3cd4-4163-8493-3c9974697239 None admin] RBAC: Authorizing `identity:get_project(project_id=d38e49d57050488484d9f03fdb7552ee)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:33.725444 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b602013-3cd4-4163-8493-3c9974697239 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:33.727817 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 143/287] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 16 17:06:33 2022] GET /identity/v3/projects/d38e49d57050488484d9f03fdb7552ee => generated 302 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:06:33.733552 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17515b3-4830-4720-80dd-47f6f59f9bd2 None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:33.737973 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:33.751405 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b602013-3cd4-4163-8493-3c9974697239 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:33.765937 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:33.914141 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17515b3-4830-4720-80dd-47f6f59f9bd2 None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:33.955240 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6abadfa-1601-4c1d-940e-69145f50c719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:33.956181 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6abadfa-1601-4c1d-940e-69145f50c719 None admin] REQUEST_METHOD: `PUT` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:33.956605 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6abadfa-1601-4c1d-940e-69145f50c719 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:33.956901 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6abadfa-1601-4c1d-940e-69145f50c719 None admin] PATH_INFO: `/v3/projects/d38e49d57050488484d9f03fdb7552ee/users/e70c4b129921444a830bd8b96a0e8249/roles/74b3015ca91b437f8d6ee242563b6547` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:33.959350 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6abadfa-1601-4c1d-940e-69145f50c719 None admin] RBAC: Authorizing `identity:create_grant(project_id=d38e49d57050488484d9f03fdb7552ee, user_id=e70c4b129921444a830bd8b96a0e8249, role_id=74b3015ca91b437f8d6ee242563b6547)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:33.961238 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6abadfa-1601-4c1d-940e-69145f50c719 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:33.983300 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b602013-3cd4-4163-8493-3c9974697239 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:34.021806 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 145/288] 10.222.0.39 () {58 vars in 1439 bytes} [Thu Jun 16 17:06:33 2022] PUT /identity/v3/projects/d38e49d57050488484d9f03fdb7552ee/users/e70c4b129921444a830bd8b96a0e8249/roles/74b3015ca91b437f8d6ee242563b6547 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:06:34.025636 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118d68c0-4124-469b-b5db-aa3b6588bed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:34.026974 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118d68c0-4124-469b-b5db-aa3b6588bed7 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:34.027414 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118d68c0-4124-469b-b5db-aa3b6588bed7 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:34.027864 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118d68c0-4124-469b-b5db-aa3b6588bed7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:34.045229 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118d68c0-4124-469b-b5db-aa3b6588bed7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 17:06:34.054299 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application [None req-118d68c0-4124-469b-b5db-aa3b6588bed7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 17:06:34.054299 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:06:34.054299 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:06:34.054299 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:06:34.054299 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:06:34.054299 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:06:34.054299 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:06:34.054299 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:06:34.054299 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:06:34.054299 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:06:34.054299 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:06:34.054299 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:06:34.054299 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 17:06:34.054299 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 17:06:34.054299 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 17:06:34.054299 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 17:06:34.055479 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 17:06:34.055479 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 17:06:34.055479 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 17:06:34.055479 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 17:06:34.055479 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:06:34.055479 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:06:34.055479 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:06:34.055479 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:06:34.055479 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:06:34.055479 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:06:34.055479 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:06:34.055479 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application with Lock( Jun 16 17:06:34.055479 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:06:34.055479 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:06:34.055479 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:06:34.055479 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:06:34.056465 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:06:34.056465 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:06:34.056465 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:06:34.056465 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:06:34.056465 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 17:06:34.056465 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 17:06:34.056465 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 17:06:34.056465 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 17:06:34.056465 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 17:06:34.056465 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 17:06:34.056465 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 17:06:34.056465 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Jun 16 17:06:34.058695 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 144/289] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 16 17:06:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:06:34.066102 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6abadfa-1601-4c1d-940e-69145f50c719 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:34.162513 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:34.218899 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6abadfa-1601-4c1d-940e-69145f50c719 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:34.279905 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6ae767-4682-4d1e-bc97-ed4a04708162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:34.281192 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6ae767-4682-4d1e-bc97-ed4a04708162 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:34.281476 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6ae767-4682-4d1e-bc97-ed4a04708162 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:34.281748 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6ae767-4682-4d1e-bc97-ed4a04708162 None admin] PATH_INFO: `/v3/roles` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:34.282955 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6ae767-4682-4d1e-bc97-ed4a04708162 None admin] RBAC: Adding query filter params (name=member) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:06:34.283320 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6ae767-4682-4d1e-bc97-ed4a04708162 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:34.284752 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6ae767-4682-4d1e-bc97-ed4a04708162 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:34.299051 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 146/290] 10.222.0.39 () {56 vars in 1101 bytes} [Thu Jun 16 17:06:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:06:34.304628 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118d68c0-4124-469b-b5db-aa3b6588bed7 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:34.382517 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:34.419525 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118d68c0-4124-469b-b5db-aa3b6588bed7 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:34.465159 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad49170-3ec8-4d91-9230-19dce830d336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:34.466072 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad49170-3ec8-4d91-9230-19dce830d336 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:34.466348 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad49170-3ec8-4d91-9230-19dce830d336 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:34.466628 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad49170-3ec8-4d91-9230-19dce830d336 None admin] PATH_INFO: `/v3/users/c98b4d2469814aff8ed4d2597015a003` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:34.467827 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad49170-3ec8-4d91-9230-19dce830d336 None admin] RBAC: Authorizing `identity:get_user(user_id=c98b4d2469814aff8ed4d2597015a003)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:34.469998 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad49170-3ec8-4d91-9230-19dce830d336 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:34.471944 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 145/291] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jun 16 17:06:34 2022] GET /identity/v3/users/c98b4d2469814aff8ed4d2597015a003 => generated 297 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:06:34.477698 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6ae767-4682-4d1e-bc97-ed4a04708162 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:34.621096 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6ae767-4682-4d1e-bc97-ed4a04708162 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:34.649530 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:34.659947 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697dcb72-801b-4102-a175-95459c643d42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:34.660916 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697dcb72-801b-4102-a175-95459c643d42 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:34.661429 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697dcb72-801b-4102-a175-95459c643d42 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:34.661938 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697dcb72-801b-4102-a175-95459c643d42 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:34.756783 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697dcb72-801b-4102-a175-95459c643d42 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:34.758618 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697dcb72-801b-4102-a175-95459c643d42 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:34.905401 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 147/292] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 16 17:06:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 17:06:34.911384 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad49170-3ec8-4d91-9230-19dce830d336 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:35.048130 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad49170-3ec8-4d91-9230-19dce830d336 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:35.089249 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6434caa6-8bf6-42f9-9262-573ca1f380da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:35.090148 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6434caa6-8bf6-42f9-9262-573ca1f380da None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:35.090432 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6434caa6-8bf6-42f9-9262-573ca1f380da None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:35.090755 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6434caa6-8bf6-42f9-9262-573ca1f380da None admin] PATH_INFO: `/v3/projects/d38e49d57050488484d9f03fdb7552ee` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:35.091953 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6434caa6-8bf6-42f9-9262-573ca1f380da None admin] RBAC: Authorizing `identity:get_project(project_id=d38e49d57050488484d9f03fdb7552ee)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:35.093978 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6434caa6-8bf6-42f9-9262-573ca1f380da None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:35.095986 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 146/293] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 16 17:06:34 2022] GET /identity/v3/projects/d38e49d57050488484d9f03fdb7552ee => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:06:35.102129 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697dcb72-801b-4102-a175-95459c643d42 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:35.152222 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:35.240821 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697dcb72-801b-4102-a175-95459c643d42 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:35.284437 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d09acc-a387-4fec-9240-b0665162aabd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:35.285106 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d09acc-a387-4fec-9240-b0665162aabd None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:35.285396 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d09acc-a387-4fec-9240-b0665162aabd None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:35.285678 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d09acc-a387-4fec-9240-b0665162aabd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:35.286553 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d09acc-a387-4fec-9240-b0665162aabd None admin] RBAC: Adding query filter params (role.id=896bff49c5d6464eb612a15f4aa9badc, scope.project.id=d38e49d57050488484d9f03fdb7552ee, user.id=c98b4d2469814aff8ed4d2597015a003) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:06:35.286878 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d09acc-a387-4fec-9240-b0665162aabd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:35.288322 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d09acc-a387-4fec-9240-b0665162aabd None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:35.294728 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 148/294] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jun 16 17:06:35 2022] GET /identity/v3/role_assignments?user.id=c98b4d2469814aff8ed4d2597015a003&scope.project.id=d38e49d57050488484d9f03fdb7552ee&role.id=896bff49c5d6464eb612a15f4aa9badc => generated 608 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:06:35.635569 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eff873-3aaa-4e96-87b7-ce2a8050a9b8 None None] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:35.635569 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eff873-3aaa-4e96-87b7-ce2a8050a9b8 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:35.635569 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eff873-3aaa-4e96-87b7-ce2a8050a9b8 None None] PATH_INFO: `/` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:35.637188 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 147/295] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 17:06:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:06:35.644115 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a27a89-fb6c-4fcd-89cf-c9910b34e5fa None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:35.644420 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a27a89-fb6c-4fcd-89cf-c9910b34e5fa None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:35.644690 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a27a89-fb6c-4fcd-89cf-c9910b34e5fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:35.667461 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-86a27a89-fb6c-4fcd-89cf-c9910b34e5fa None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:06:35.669116 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-86a27a89-fb6c-4fcd-89cf-c9910b34e5fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:06:35.731334 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9581f8ca-40b1-436a-b374-e88754157168 None None] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:35.731626 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9581f8ca-40b1-436a-b374-e88754157168 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:35.732032 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9581f8ca-40b1-436a-b374-e88754157168 None None] PATH_INFO: `/` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:35.737993 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 148/296] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 17:06:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:06:35.743753 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740095e2-79e9-45cb-8e50-270abd388166 None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:35.744047 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740095e2-79e9-45cb-8e50-270abd388166 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:35.744329 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740095e2-79e9-45cb-8e50-270abd388166 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:35.751406 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 149/297] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 17:06:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 17:06:35.751859 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:35.763580 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-740095e2-79e9-45cb-8e50-270abd388166 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:06:35.764756 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-740095e2-79e9-45cb-8e50-270abd388166 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:06:35.774146 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a27a89-fb6c-4fcd-89cf-c9910b34e5fa None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:35.803791 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:35.856156 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 149/298] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 17:06:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 17:06:35.894918 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740095e2-79e9-45cb-8e50-270abd388166 None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:35.895949 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a27a89-fb6c-4fcd-89cf-c9910b34e5fa None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:35.932205 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66344522-01c4-4f06-b10c-09cd86a1e61d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:35.933030 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66344522-01c4-4f06-b10c-09cd86a1e61d None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:35.934107 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66344522-01c4-4f06-b10c-09cd86a1e61d None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:35.934107 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66344522-01c4-4f06-b10c-09cd86a1e61d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:35.944905 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66344522-01c4-4f06-b10c-09cd86a1e61d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 17:06:35.953353 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application [None req-66344522-01c4-4f06-b10c-09cd86a1e61d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 17:06:35.953353 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:06:35.953353 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:06:35.953353 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:06:35.953353 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:06:35.953353 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:06:35.953353 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:06:35.953353 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:06:35.953353 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:06:35.953353 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:06:35.953353 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:06:35.953353 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:06:35.953353 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 17:06:35.953353 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 17:06:35.953353 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 17:06:35.953353 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 17:06:35.966005 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 17:06:35.966005 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 17:06:35.966005 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 17:06:35.966005 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 17:06:35.966005 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:06:35.966005 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:06:35.966005 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:06:35.966005 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:06:35.966005 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:06:35.966005 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:06:35.966005 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:06:35.966005 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application with Lock( Jun 16 17:06:35.966005 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:06:35.966005 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:06:35.966005 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:06:35.966005 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:06:35.969018 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:06:35.969018 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:06:35.969018 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:06:35.969018 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:06:35.969018 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 17:06:35.969018 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 17:06:35.969018 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 17:06:35.969018 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 17:06:35.969018 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 17:06:35.969018 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 17:06:35.969018 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 17:06:35.969018 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Jun 16 17:06:35.969018 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 150/299] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 16 17:06:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:06:35.969018 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66344522-01c4-4f06-b10c-09cd86a1e61d None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:36.039631 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740095e2-79e9-45cb-8e50-270abd388166 None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:36.065149 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:36.086213 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:36.092071 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66344522-01c4-4f06-b10c-09cd86a1e61d None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:36.092258 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffdba11-ac64-4d22-b47f-970971b948ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:36.093066 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffdba11-ac64-4d22-b47f-970971b948ea None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:36.093353 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffdba11-ac64-4d22-b47f-970971b948ea None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:36.093636 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffdba11-ac64-4d22-b47f-970971b948ea None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:36.106945 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffdba11-ac64-4d22-b47f-970971b948ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 17:06:36.116564 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application [None req-fffdba11-ac64-4d22-b47f-970971b948ea None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 17:06:36.116564 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:06:36.116564 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:06:36.116564 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:06:36.116564 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:06:36.116564 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:06:36.116564 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:06:36.116564 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:06:36.116564 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:06:36.116564 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:06:36.116564 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:06:36.116564 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:06:36.116564 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 17:06:36.116564 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 17:06:36.116564 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 17:06:36.116564 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 17:06:36.117467 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 17:06:36.117467 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 17:06:36.117467 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 17:06:36.117467 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 17:06:36.117467 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:06:36.117467 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:06:36.117467 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:06:36.117467 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:06:36.117467 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:06:36.117467 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:06:36.117467 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:06:36.117467 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application with Lock( Jun 16 17:06:36.117467 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:06:36.117467 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:06:36.117467 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:06:36.117467 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:06:36.118291 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:06:36.118291 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:06:36.118291 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:06:36.118291 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:06:36.118291 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 17:06:36.118291 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 17:06:36.118291 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 17:06:36.118291 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 17:06:36.118291 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 17:06:36.118291 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 17:06:36.118291 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 17:06:36.118291 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Jun 16 17:06:36.126490 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 150/300] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 16 17:06:35 2022] GET /identity/v3/roles/reader => generated 84 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 17:06:36.127750 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffdba11-ac64-4d22-b47f-970971b948ea None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:36.134296 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73987f0a-2f4b-415a-b27c-8fec6d2ffe5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:36.134977 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73987f0a-2f4b-415a-b27c-8fec6d2ffe5d None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:36.135267 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73987f0a-2f4b-415a-b27c-8fec6d2ffe5d None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:36.135547 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73987f0a-2f4b-415a-b27c-8fec6d2ffe5d None admin] PATH_INFO: `/v3/roles` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:36.136307 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73987f0a-2f4b-415a-b27c-8fec6d2ffe5d None admin] RBAC: Adding query filter params (name=member) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:06:36.136622 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73987f0a-2f4b-415a-b27c-8fec6d2ffe5d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:36.138037 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73987f0a-2f4b-415a-b27c-8fec6d2ffe5d None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:36.147528 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 151/301] 10.222.0.39 () {56 vars in 1101 bytes} [Thu Jun 16 17:06:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 17:06:36.148733 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee46896-2954-4127-9058-bc4e0466e4ba None None] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:36.149026 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee46896-2954-4127-9058-bc4e0466e4ba None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:36.149305 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee46896-2954-4127-9058-bc4e0466e4ba None None] PATH_INFO: `/` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:36.150566 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 152/302] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 17:06:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:06:36.154740 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee46896-2954-4127-9058-bc4e0466e4ba None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:36.252229 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffdba11-ac64-4d22-b47f-970971b948ea None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:36.272084 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee46896-2954-4127-9058-bc4e0466e4ba None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:36.290021 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a9c7a6-564a-40cb-a31f-c052f7fae381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:36.290697 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a9c7a6-564a-40cb-a31f-c052f7fae381 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:36.291203 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a9c7a6-564a-40cb-a31f-c052f7fae381 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:36.291320 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a9c7a6-564a-40cb-a31f-c052f7fae381 None admin] PATH_INFO: `/v3/roles` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:36.292002 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a9c7a6-564a-40cb-a31f-c052f7fae381 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80873) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:06:36.292313 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a9c7a6-564a-40cb-a31f-c052f7fae381 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:36.293681 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a9c7a6-564a-40cb-a31f-c052f7fae381 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:36.302573 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 151/303] 10.222.0.39 () {56 vars in 1101 bytes} [Thu Jun 16 17:06:36 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:06:36.303591 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e55c98-5f98-4777-9781-22f372cb109e None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:36.303881 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e55c98-5f98-4777-9781-22f372cb109e None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:36.304161 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e55c98-5f98-4777-9781-22f372cb109e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:36.315604 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f7a3fa-e837-4007-895e-3b4fc0f6ae31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:36.316484 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f7a3fa-e837-4007-895e-3b4fc0f6ae31 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:36.316778 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f7a3fa-e837-4007-895e-3b4fc0f6ae31 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:36.317058 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f7a3fa-e837-4007-895e-3b4fc0f6ae31 None admin] PATH_INFO: `/v3/users/44c6e1641237410b9a64d242475895b4` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:36.318322 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f7a3fa-e837-4007-895e-3b4fc0f6ae31 None admin] RBAC: Authorizing `identity:get_user(user_id=44c6e1641237410b9a64d242475895b4)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:36.319761 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f7a3fa-e837-4007-895e-3b4fc0f6ae31 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:36.321227 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-41e55c98-5f98-4777-9781-22f372cb109e None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:06:36.326043 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 153/304] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jun 16 17:06:36 2022] GET /identity/v3/users/44c6e1641237410b9a64d242475895b4 => generated 293 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:06:36.326911 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-41e55c98-5f98-4777-9781-22f372cb109e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:06:36.327011 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f7a3fa-e837-4007-895e-3b4fc0f6ae31 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:36.338828 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:36.387575 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:36.412965 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 152/305] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 17:06:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 17:06:36.413734 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e55c98-5f98-4777-9781-22f372cb109e None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:36.461953 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f7a3fa-e837-4007-895e-3b4fc0f6ae31 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:36.497285 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89fdf36-3272-4241-8da7-1d38c09b6fb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:36.498183 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89fdf36-3272-4241-8da7-1d38c09b6fb2 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:36.498467 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89fdf36-3272-4241-8da7-1d38c09b6fb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:36.498752 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89fdf36-3272-4241-8da7-1d38c09b6fb2 None admin] PATH_INFO: `/v3/users/ac3dc2e5a9b24a4fa24a6ceacbb9eb6d` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:36.512567 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89fdf36-3272-4241-8da7-1d38c09b6fb2 None admin] RBAC: Authorizing `identity:get_user(user_id=ac3dc2e5a9b24a4fa24a6ceacbb9eb6d)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:36.514044 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89fdf36-3272-4241-8da7-1d38c09b6fb2 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:36.515820 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 154/306] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jun 16 17:06:36 2022] GET /identity/v3/users/ac3dc2e5a9b24a4fa24a6ceacbb9eb6d => generated 293 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:06:36.516581 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89fdf36-3272-4241-8da7-1d38c09b6fb2 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:36.531598 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e55c98-5f98-4777-9781-22f372cb109e None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:36.568891 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e67ee3-45cd-4cd0-894b-73468efc4736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:36.570172 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e67ee3-45cd-4cd0-894b-73468efc4736 None admin] REQUEST_METHOD: `PUT` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:36.570640 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e67ee3-45cd-4cd0-894b-73468efc4736 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:36.571198 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e67ee3-45cd-4cd0-894b-73468efc4736 None admin] PATH_INFO: `/v3/system/users/44c6e1641237410b9a64d242475895b4/roles/896bff49c5d6464eb612a15f4aa9badc` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:36.572838 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e67ee3-45cd-4cd0-894b-73468efc4736 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=44c6e1641237410b9a64d242475895b4, role_id=896bff49c5d6464eb612a15f4aa9badc)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:36.574638 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e67ee3-45cd-4cd0-894b-73468efc4736 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:36.585568 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:36.618883 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89fdf36-3272-4241-8da7-1d38c09b6fb2 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:36.654666 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d498692a-5a08-4347-9127-1eadf5ed7da6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:36.655999 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d498692a-5a08-4347-9127-1eadf5ed7da6 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:36.656285 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d498692a-5a08-4347-9127-1eadf5ed7da6 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:36.656559 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d498692a-5a08-4347-9127-1eadf5ed7da6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:36.657916 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d498692a-5a08-4347-9127-1eadf5ed7da6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:36.659510 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d498692a-5a08-4347-9127-1eadf5ed7da6 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:36.661232 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 155/307] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 17:06:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:06:36.666200 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d498692a-5a08-4347-9127-1eadf5ed7da6 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:36.683483 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 153/308] 10.222.0.39 () {58 vars in 1334 bytes} [Thu Jun 16 17:06:36 2022] PUT /identity/v3/system/users/44c6e1641237410b9a64d242475895b4/roles/896bff49c5d6464eb612a15f4aa9badc => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:06:36.694804 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e67ee3-45cd-4cd0-894b-73468efc4736 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:36.763995 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:36.788594 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d498692a-5a08-4347-9127-1eadf5ed7da6 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:36.821517 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e67ee3-45cd-4cd0-894b-73468efc4736 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:36.828903 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f403ad-7f91-4911-94b5-136ca71ceb19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:36.829612 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f403ad-7f91-4911-94b5-136ca71ceb19 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:36.829920 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f403ad-7f91-4911-94b5-136ca71ceb19 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:36.830199 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f403ad-7f91-4911-94b5-136ca71ceb19 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:36.831219 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f403ad-7f91-4911-94b5-136ca71ceb19 None admin] RBAC: Adding query filter params (role.id=74b3015ca91b437f8d6ee242563b6547, user.id=ac3dc2e5a9b24a4fa24a6ceacbb9eb6d, scope.system=all) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:06:36.831541 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f403ad-7f91-4911-94b5-136ca71ceb19 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:36.833000 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f403ad-7f91-4911-94b5-136ca71ceb19 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:36.836029 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:36.839248 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 156/309] 10.222.0.39 () {56 vars in 1308 bytes} [Thu Jun 16 17:06:36 2022] GET /identity/v3/role_assignments?user.id=ac3dc2e5a9b24a4fa24a6ceacbb9eb6d&scope.system=all&role.id=74b3015ca91b437f8d6ee242563b6547 => generated 226 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:06:36.839248 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093b4eb3-2c1f-4318-a5a1-eed733f41de4 None None] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:36.839248 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093b4eb3-2c1f-4318-a5a1-eed733f41de4 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:36.839248 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093b4eb3-2c1f-4318-a5a1-eed733f41de4 None None] PATH_INFO: `/` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:36.839248 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 157/310] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 17:06:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:06:36.852776 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5070910-a3d8-42e9-818f-b4b27c23d543 None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:36.853070 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5070910-a3d8-42e9-818f-b4b27c23d543 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:36.853348 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5070910-a3d8-42e9-818f-b4b27c23d543 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:36.872555 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-d5070910-a3d8-42e9-818f-b4b27c23d543 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:06:36.873845 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-d5070910-a3d8-42e9-818f-b4b27c23d543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:06:36.889241 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa7503e-4993-43ca-8630-4194827adfb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:36.889572 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa7503e-4993-43ca-8630-4194827adfb5 None admin] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:36.890652 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa7503e-4993-43ca-8630-4194827adfb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:36.890996 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa7503e-4993-43ca-8630-4194827adfb5 None admin] PATH_INFO: `/v3/groups` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:36.893710 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa7503e-4993-43ca-8630-4194827adfb5 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:36.893710 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa7503e-4993-43ca-8630-4194827adfb5 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:36.968867 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 158/311] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 17:06:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 17:06:36.989328 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 154/312] 10.222.0.39 () {60 vars in 1134 bytes} [Thu Jun 16 17:06:36 2022] POST /identity/v3/groups => generated 229 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:06:36.992227 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5070910-a3d8-42e9-818f-b4b27c23d543 None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:37.114658 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5070910-a3d8-42e9-818f-b4b27c23d543 None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:37.151996 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:37.153804 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567cf04e-59bf-4f7b-8a77-3d04211b83b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:37.154610 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567cf04e-59bf-4f7b-8a77-3d04211b83b4 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:37.154892 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567cf04e-59bf-4f7b-8a77-3d04211b83b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:37.155169 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567cf04e-59bf-4f7b-8a77-3d04211b83b4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:37.167058 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567cf04e-59bf-4f7b-8a77-3d04211b83b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 17:06:37.175518 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application [None req-567cf04e-59bf-4f7b-8a77-3d04211b83b4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 17:06:37.175518 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:06:37.175518 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:06:37.175518 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:06:37.175518 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:06:37.175518 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:06:37.175518 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:06:37.175518 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:06:37.175518 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:06:37.175518 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:06:37.175518 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:06:37.175518 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:06:37.175518 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 17:06:37.175518 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 17:06:37.175518 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 17:06:37.175518 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 17:06:37.176437 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 17:06:37.176437 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 17:06:37.176437 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 17:06:37.176437 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 17:06:37.176437 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:06:37.176437 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:06:37.176437 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:06:37.176437 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:06:37.176437 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:06:37.176437 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:06:37.176437 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:06:37.176437 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application with Lock( Jun 16 17:06:37.176437 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:06:37.176437 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:06:37.176437 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:06:37.176437 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:06:37.177633 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:06:37.177633 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:06:37.177633 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:06:37.177633 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:06:37.177633 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 17:06:37.177633 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 17:06:37.177633 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 17:06:37.177633 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 17:06:37.177633 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 17:06:37.177633 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 17:06:37.177633 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 17:06:37.177633 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Jun 16 17:06:37.177633 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 159/313] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 16 17:06:36 2022] GET /identity/v3/roles/reader => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 17:06:37.182562 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa7503e-4993-43ca-8630-4194827adfb5 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:37.301253 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa7503e-4993-43ca-8630-4194827adfb5 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:37.310892 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:37.338179 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd24b58e-231d-4ad6-be72-8e62efbcc62d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:37.339037 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd24b58e-231d-4ad6-be72-8e62efbcc62d None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:37.339284 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd24b58e-231d-4ad6-be72-8e62efbcc62d None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:37.339531 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd24b58e-231d-4ad6-be72-8e62efbcc62d None admin] PATH_INFO: `/v3/roles` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:37.340297 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd24b58e-231d-4ad6-be72-8e62efbcc62d None admin] RBAC: Adding query filter params (name=reader) {{(pid=80873) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:06:37.341004 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd24b58e-231d-4ad6-be72-8e62efbcc62d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:37.342815 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd24b58e-231d-4ad6-be72-8e62efbcc62d None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:37.354798 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 155/314] 10.222.0.39 () {56 vars in 1101 bytes} [Thu Jun 16 17:06:37 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:06:37.361174 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567cf04e-59bf-4f7b-8a77-3d04211b83b4 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:37.473369 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567cf04e-59bf-4f7b-8a77-3d04211b83b4 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:37.510341 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8929efb4-db3c-4e2a-a146-49a527623ac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:37.511577 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8929efb4-db3c-4e2a-a146-49a527623ac6 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:37.512064 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8929efb4-db3c-4e2a-a146-49a527623ac6 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:37.512539 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8929efb4-db3c-4e2a-a146-49a527623ac6 None admin] PATH_INFO: `/v3/users/e70c4b129921444a830bd8b96a0e8249` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:37.514000 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8929efb4-db3c-4e2a-a146-49a527623ac6 None admin] RBAC: Authorizing `identity:get_user(user_id=e70c4b129921444a830bd8b96a0e8249)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:37.516258 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8929efb4-db3c-4e2a-a146-49a527623ac6 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:37.518450 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 160/315] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jun 16 17:06:37 2022] GET /identity/v3/users/e70c4b129921444a830bd8b96a0e8249 => generated 297 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:06:37.526238 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd24b58e-231d-4ad6-be72-8e62efbcc62d None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:37.628488 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd24b58e-231d-4ad6-be72-8e62efbcc62d None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:37.662886 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559127ee-4340-47f1-abce-2ba421925948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:37.663536 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559127ee-4340-47f1-abce-2ba421925948 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:37.663884 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559127ee-4340-47f1-abce-2ba421925948 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:37.664164 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559127ee-4340-47f1-abce-2ba421925948 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:37.705791 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:37.735360 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559127ee-4340-47f1-abce-2ba421925948 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:37.736866 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559127ee-4340-47f1-abce-2ba421925948 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:37.844233 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 156/316] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 16 17:06:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 17:06:37.849798 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8929efb4-db3c-4e2a-a146-49a527623ac6 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:37.916173 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:37.960894 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8929efb4-db3c-4e2a-a146-49a527623ac6 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:37.997869 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5222fe3-ed34-4820-8fce-91c43810ab31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:37.998977 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5222fe3-ed34-4820-8fce-91c43810ab31 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:38.000072 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5222fe3-ed34-4820-8fce-91c43810ab31 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:38.000502 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5222fe3-ed34-4820-8fce-91c43810ab31 None admin] PATH_INFO: `/v3/projects/d38e49d57050488484d9f03fdb7552ee` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:38.002645 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5222fe3-ed34-4820-8fce-91c43810ab31 None admin] RBAC: Authorizing `identity:get_project(project_id=d38e49d57050488484d9f03fdb7552ee)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:38.004287 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5222fe3-ed34-4820-8fce-91c43810ab31 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:38.006179 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 161/317] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 16 17:06:37 2022] GET /identity/v3/projects/d38e49d57050488484d9f03fdb7552ee => generated 302 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:06:38.014259 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559127ee-4340-47f1-abce-2ba421925948 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:38.084195 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:38.116739 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559127ee-4340-47f1-abce-2ba421925948 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:38.151181 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce4f820-916a-4afd-9eda-a18a9a157e98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:38.151773 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce4f820-916a-4afd-9eda-a18a9a157e98 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:38.152056 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce4f820-916a-4afd-9eda-a18a9a157e98 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:38.152330 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce4f820-916a-4afd-9eda-a18a9a157e98 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:38.153184 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce4f820-916a-4afd-9eda-a18a9a157e98 None admin] RBAC: Adding query filter params (role.id=74b3015ca91b437f8d6ee242563b6547, scope.project.id=d38e49d57050488484d9f03fdb7552ee, user.id=e70c4b129921444a830bd8b96a0e8249) {{(pid=80873) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:06:38.153498 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce4f820-916a-4afd-9eda-a18a9a157e98 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:38.155020 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce4f820-916a-4afd-9eda-a18a9a157e98 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:38.163101 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 157/318] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jun 16 17:06:38 2022] GET /identity/v3/role_assignments?user.id=e70c4b129921444a830bd8b96a0e8249&scope.project.id=d38e49d57050488484d9f03fdb7552ee&role.id=74b3015ca91b437f8d6ee242563b6547 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:06:38.944326 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2043a43-6973-4310-b336-72e705a6e136 None None] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:38.944860 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2043a43-6973-4310-b336-72e705a6e136 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:38.944860 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2043a43-6973-4310-b336-72e705a6e136 None None] PATH_INFO: `/` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:38.946304 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 162/319] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 17:06:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:06:38.951480 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c894c2-fd71-41b6-8cee-9d8e4d6d1979 None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:38.951853 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c894c2-fd71-41b6-8cee-9d8e4d6d1979 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:38.952214 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c894c2-fd71-41b6-8cee-9d8e4d6d1979 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:38.972397 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-48c894c2-fd71-41b6-8cee-9d8e4d6d1979 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:06:38.973599 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-48c894c2-fd71-41b6-8cee-9d8e4d6d1979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:06:39.044148 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 158/320] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 17:06:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 17:06:39.067818 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2043a43-6973-4310-b336-72e705a6e136 None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:39.175614 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd7e6c5-d424-400b-9fb0-e7a2cc8b7cbf None None] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:39.175814 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd7e6c5-d424-400b-9fb0-e7a2cc8b7cbf None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:39.176097 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd7e6c5-d424-400b-9fb0-e7a2cc8b7cbf None None] PATH_INFO: `/` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:39.177526 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 159/321] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 17:06:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:06:39.183298 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036cd99a-ffe6-4b86-8e6b-f5c32bb0b671 None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:39.183592 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036cd99a-ffe6-4b86-8e6b-f5c32bb0b671 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:39.184073 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036cd99a-ffe6-4b86-8e6b-f5c32bb0b671 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:39.189082 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2043a43-6973-4310-b336-72e705a6e136 None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:39.204690 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-036cd99a-ffe6-4b86-8e6b-f5c32bb0b671 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:06:39.205964 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-036cd99a-ffe6-4b86-8e6b-f5c32bb0b671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:06:39.219439 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:39.230343 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282db77e-58ee-4691-b859-ce75a9a7595c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:39.231148 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282db77e-58ee-4691-b859-ce75a9a7595c None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:39.231439 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282db77e-58ee-4691-b859-ce75a9a7595c None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:39.231724 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282db77e-58ee-4691-b859-ce75a9a7595c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:39.242971 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282db77e-58ee-4691-b859-ce75a9a7595c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 17:06:39.250794 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application [None req-282db77e-58ee-4691-b859-ce75a9a7595c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 17:06:39.250794 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:06:39.250794 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:06:39.250794 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:06:39.250794 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:06:39.250794 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:06:39.250794 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:06:39.250794 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:06:39.250794 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:06:39.250794 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:06:39.250794 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:06:39.250794 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:06:39.250794 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 17:06:39.250794 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 17:06:39.250794 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 17:06:39.250794 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 17:06:39.251722 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 17:06:39.251722 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 17:06:39.251722 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 17:06:39.251722 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 17:06:39.251722 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:06:39.251722 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:06:39.251722 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:06:39.251722 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:06:39.251722 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:06:39.251722 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:06:39.251722 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:06:39.251722 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application with Lock( Jun 16 17:06:39.251722 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:06:39.251722 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:06:39.251722 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:06:39.251722 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:06:39.252558 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:06:39.252558 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:06:39.252558 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:06:39.252558 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:06:39.252558 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 17:06:39.252558 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 17:06:39.252558 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 17:06:39.252558 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 17:06:39.252558 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 17:06:39.252558 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 17:06:39.252558 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 17:06:39.252558 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Jun 16 17:06:39.252558 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 163/322] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 16 17:06:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:06:39.253666 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3ea77b-fa49-4b40-a2d4-90507a43030e None None] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:39.253990 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3ea77b-fa49-4b40-a2d4-90507a43030e None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:39.254276 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3ea77b-fa49-4b40-a2d4-90507a43030e None None] PATH_INFO: `/` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:39.255556 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 164/323] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 17:06:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 17:06:39.260348 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbcba84-fb0a-4582-8c2b-038bdea154d9 None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:39.260835 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbcba84-fb0a-4582-8c2b-038bdea154d9 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:39.261431 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbcba84-fb0a-4582-8c2b-038bdea154d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:39.274826 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:39.278044 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-bbbcba84-fb0a-4582-8c2b-038bdea154d9 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:06:39.279246 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-bbbcba84-fb0a-4582-8c2b-038bdea154d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:06:39.283518 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 160/324] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 17:06:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 17:06:39.284312 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036cd99a-ffe6-4b86-8e6b-f5c32bb0b671 None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:39.352369 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 165/325] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 17:06:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 17:06:39.353208 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbcba84-fb0a-4582-8c2b-038bdea154d9 None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:39.389128 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036cd99a-ffe6-4b86-8e6b-f5c32bb0b671 None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:39.423034 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6708a357-36c9-457b-b6df-7db118ea6a23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:39.423701 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6708a357-36c9-457b-b6df-7db118ea6a23 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:39.423985 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6708a357-36c9-457b-b6df-7db118ea6a23 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:39.424263 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6708a357-36c9-457b-b6df-7db118ea6a23 None admin] PATH_INFO: `/v3/roles` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:39.425007 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6708a357-36c9-457b-b6df-7db118ea6a23 None admin] RBAC: Adding query filter params (name=member) {{(pid=80873) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:06:39.425311 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6708a357-36c9-457b-b6df-7db118ea6a23 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:39.426757 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6708a357-36c9-457b-b6df-7db118ea6a23 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:39.434630 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 161/326] 10.222.0.39 () {56 vars in 1101 bytes} [Thu Jun 16 17:06:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:06:39.439252 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6708a357-36c9-457b-b6df-7db118ea6a23 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:39.456169 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbcba84-fb0a-4582-8c2b-038bdea154d9 None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:39.472787 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:39.491476 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c839b8-1e84-4d5b-bf24-734d7429df96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:39.491853 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:39.492279 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c839b8-1e84-4d5b-bf24-734d7429df96 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:39.492570 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c839b8-1e84-4d5b-bf24-734d7429df96 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:39.492852 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c839b8-1e84-4d5b-bf24-734d7429df96 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:39.503706 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c839b8-1e84-4d5b-bf24-734d7429df96 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 17:06:39.511842 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application [None req-b0c839b8-1e84-4d5b-bf24-734d7429df96 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 17:06:39.511842 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:06:39.511842 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:06:39.511842 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:06:39.511842 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:06:39.511842 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:06:39.511842 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:06:39.511842 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:06:39.511842 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:06:39.511842 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:06:39.511842 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:06:39.511842 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:06:39.511842 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 17:06:39.511842 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 17:06:39.511842 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 17:06:39.511842 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 17:06:39.512980 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 17:06:39.512980 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 17:06:39.512980 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 17:06:39.512980 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 17:06:39.512980 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:06:39.512980 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:06:39.512980 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:06:39.512980 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:06:39.512980 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:06:39.512980 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:06:39.512980 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:06:39.512980 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application with Lock( Jun 16 17:06:39.512980 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:06:39.512980 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:06:39.512980 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:06:39.512980 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:06:39.514010 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:06:39.514010 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:06:39.514010 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:06:39.514010 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:06:39.514010 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 17:06:39.514010 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 17:06:39.514010 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 17:06:39.514010 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 17:06:39.514010 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 17:06:39.514010 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 17:06:39.514010 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 17:06:39.514010 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Jun 16 17:06:39.514010 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 166/327] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 16 17:06:39 2022] GET /identity/v3/roles/reader => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:06:39.515350 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c839b8-1e84-4d5b-bf24-734d7429df96 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:39.539125 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6708a357-36c9-457b-b6df-7db118ea6a23 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:39.574236 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac91a9c-faa0-4b88-9fd7-c1ccea8d55c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:39.575047 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac91a9c-faa0-4b88-9fd7-c1ccea8d55c3 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:39.575331 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac91a9c-faa0-4b88-9fd7-c1ccea8d55c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:39.575608 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac91a9c-faa0-4b88-9fd7-c1ccea8d55c3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:39.576764 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac91a9c-faa0-4b88-9fd7-c1ccea8d55c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:39.578330 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac91a9c-faa0-4b88-9fd7-c1ccea8d55c3 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:39.579946 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 162/328] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 17:06:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:06:39.580698 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac91a9c-faa0-4b88-9fd7-c1ccea8d55c3 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:39.614870 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c839b8-1e84-4d5b-bf24-734d7429df96 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:39.648028 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1765f7e9-712e-4e98-80e6-f3b37922f550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:39.648906 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1765f7e9-712e-4e98-80e6-f3b37922f550 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:39.649195 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1765f7e9-712e-4e98-80e6-f3b37922f550 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:39.649481 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1765f7e9-712e-4e98-80e6-f3b37922f550 None admin] PATH_INFO: `/v3/users/44c6e1641237410b9a64d242475895b4` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:39.650711 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1765f7e9-712e-4e98-80e6-f3b37922f550 None admin] RBAC: Authorizing `identity:get_user(user_id=44c6e1641237410b9a64d242475895b4)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:39.652204 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1765f7e9-712e-4e98-80e6-f3b37922f550 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:39.653877 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 167/329] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jun 16 17:06:39 2022] GET /identity/v3/users/44c6e1641237410b9a64d242475895b4 => generated 293 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:06:39.654625 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1765f7e9-712e-4e98-80e6-f3b37922f550 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:39.681153 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac91a9c-faa0-4b88-9fd7-c1ccea8d55c3 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:39.699612 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:39.703952 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:39.714641 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2916c08f-896c-42f3-a6e7-0730fca7b6ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:39.715366 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2916c08f-896c-42f3-a6e7-0730fca7b6ed None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:39.715657 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2916c08f-896c-42f3-a6e7-0730fca7b6ed None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:39.715966 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2916c08f-896c-42f3-a6e7-0730fca7b6ed None admin] PATH_INFO: `/v3/roles` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:39.716715 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2916c08f-896c-42f3-a6e7-0730fca7b6ed None admin] RBAC: Adding query filter params (name=reader) {{(pid=80873) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:06:39.717029 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2916c08f-896c-42f3-a6e7-0730fca7b6ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:39.719188 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2916c08f-896c-42f3-a6e7-0730fca7b6ed None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:39.728441 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 163/330] 10.222.0.39 () {56 vars in 1101 bytes} [Thu Jun 16 17:06:39 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:06:39.729021 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2916c08f-896c-42f3-a6e7-0730fca7b6ed None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:39.758751 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1765f7e9-712e-4e98-80e6-f3b37922f550 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:39.792221 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6beee660-3248-497a-9743-7527b2e7b2c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:39.792882 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beee660-3248-497a-9743-7527b2e7b2c1 None admin] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:39.793165 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beee660-3248-497a-9743-7527b2e7b2c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:39.793449 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beee660-3248-497a-9743-7527b2e7b2c1 None admin] PATH_INFO: `/v3/groups` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:39.794164 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6beee660-3248-497a-9743-7527b2e7b2c1 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:39.795594 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6beee660-3248-497a-9743-7527b2e7b2c1 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:39.827375 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2916c08f-896c-42f3-a6e7-0730fca7b6ed None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:39.860173 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab0ad0c-b28f-4346-8298-5af7918e01ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:39.860814 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab0ad0c-b28f-4346-8298-5af7918e01ec None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:39.861198 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab0ad0c-b28f-4346-8298-5af7918e01ec None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:39.861383 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab0ad0c-b28f-4346-8298-5af7918e01ec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:39.862258 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab0ad0c-b28f-4346-8298-5af7918e01ec None admin] RBAC: Adding query filter params (role.id=896bff49c5d6464eb612a15f4aa9badc, user.id=44c6e1641237410b9a64d242475895b4, scope.system=all) {{(pid=80873) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:06:39.862576 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab0ad0c-b28f-4346-8298-5af7918e01ec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:39.863987 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab0ad0c-b28f-4346-8298-5af7918e01ec None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:39.875817 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 164/331] 10.222.0.39 () {56 vars in 1308 bytes} [Thu Jun 16 17:06:39 2022] GET /identity/v3/role_assignments?user.id=44c6e1641237410b9a64d242475895b4&scope.system=all&role.id=896bff49c5d6464eb612a15f4aa9badc => generated 510 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:06:39.876595 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab0ad0c-b28f-4346-8298-5af7918e01ec None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:39.892968 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 168/332] 10.222.0.39 () {60 vars in 1134 bytes} [Thu Jun 16 17:06:39 2022] POST /identity/v3/groups => generated 226 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:06:39.931096 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:40.000311 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab0ad0c-b28f-4346-8298-5af7918e01ec None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:40.040286 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44085a60-b6b3-4e18-b148-17fa752148b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:40.041209 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44085a60-b6b3-4e18-b148-17fa752148b6 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:40.041501 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44085a60-b6b3-4e18-b148-17fa752148b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:40.041819 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44085a60-b6b3-4e18-b148-17fa752148b6 None admin] PATH_INFO: `/v3/users/ac3dc2e5a9b24a4fa24a6ceacbb9eb6d` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:40.043184 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44085a60-b6b3-4e18-b148-17fa752148b6 None admin] RBAC: Authorizing `identity:get_user(user_id=ac3dc2e5a9b24a4fa24a6ceacbb9eb6d)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:40.044689 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44085a60-b6b3-4e18-b148-17fa752148b6 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:40.047379 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 165/333] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jun 16 17:06:39 2022] GET /identity/v3/users/ac3dc2e5a9b24a4fa24a6ceacbb9eb6d => generated 293 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:06:40.053277 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6beee660-3248-497a-9743-7527b2e7b2c1 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:40.165430 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6beee660-3248-497a-9743-7527b2e7b2c1 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:40.170192 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:40.206694 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71fa5fd-3241-4bde-890b-8cef7c358c03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:40.207651 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71fa5fd-3241-4bde-890b-8cef7c358c03 None admin] REQUEST_METHOD: `PUT` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:40.208169 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71fa5fd-3241-4bde-890b-8cef7c358c03 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:40.208737 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71fa5fd-3241-4bde-890b-8cef7c358c03 None admin] PATH_INFO: `/v3/system/users/ac3dc2e5a9b24a4fa24a6ceacbb9eb6d/roles/74b3015ca91b437f8d6ee242563b6547` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:40.210709 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71fa5fd-3241-4bde-890b-8cef7c358c03 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=ac3dc2e5a9b24a4fa24a6ceacbb9eb6d, role_id=74b3015ca91b437f8d6ee242563b6547)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:40.212122 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71fa5fd-3241-4bde-890b-8cef7c358c03 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:40.312720 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 169/334] 10.222.0.39 () {58 vars in 1334 bytes} [Thu Jun 16 17:06:40 2022] PUT /identity/v3/system/users/ac3dc2e5a9b24a4fa24a6ceacbb9eb6d/roles/74b3015ca91b437f8d6ee242563b6547 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:06:42.835908 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be6c475-08dc-4f42-8b99-4c59450d4e44 None None] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:42.836495 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be6c475-08dc-4f42-8b99-4c59450d4e44 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:42.836495 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be6c475-08dc-4f42-8b99-4c59450d4e44 None None] PATH_INFO: `/` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:42.838117 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 166/335] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 17:06:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:06:42.844020 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c47984-8fde-4c91-9813-2127e4eea9d4 None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:42.844565 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c47984-8fde-4c91-9813-2127e4eea9d4 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:42.844565 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c47984-8fde-4c91-9813-2127e4eea9d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:42.866847 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-37c47984-8fde-4c91-9813-2127e4eea9d4 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:06:42.868083 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-37c47984-8fde-4c91-9813-2127e4eea9d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:06:42.942504 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397fbddd-5817-4f35-9cb9-b8540ad69832 None None] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:42.942838 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397fbddd-5817-4f35-9cb9-b8540ad69832 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:42.943136 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397fbddd-5817-4f35-9cb9-b8540ad69832 None None] PATH_INFO: `/` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:42.944790 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 167/336] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 17:06:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:06:42.949838 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5591ce-4812-4b54-8196-cd29a246ce09 None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:42.950141 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5591ce-4812-4b54-8196-cd29a246ce09 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:42.950430 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5591ce-4812-4b54-8196-cd29a246ce09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:42.967852 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 170/337] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 17:06:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 17:06:42.976210 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-5b5591ce-4812-4b54-8196-cd29a246ce09 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:06:42.977704 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-5b5591ce-4812-4b54-8196-cd29a246ce09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:06:43.007947 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c47984-8fde-4c91-9813-2127e4eea9d4 None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:43.119565 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 168/338] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 17:06:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 17:06:43.156894 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5591ce-4812-4b54-8196-cd29a246ce09 None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:43.161819 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:43.167740 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c47984-8fde-4c91-9813-2127e4eea9d4 None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:43.236573 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bc4ddb-03b4-43b1-9f33-63ceae59eed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:43.237544 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bc4ddb-03b4-43b1-9f33-63ceae59eed2 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:43.237867 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bc4ddb-03b4-43b1-9f33-63ceae59eed2 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:43.238299 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bc4ddb-03b4-43b1-9f33-63ceae59eed2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:43.257287 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:43.258641 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bc4ddb-03b4-43b1-9f33-63ceae59eed2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 17:06:43.267265 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application [None req-93bc4ddb-03b4-43b1-9f33-63ceae59eed2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 17:06:43.267265 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:06:43.267265 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:06:43.267265 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:06:43.267265 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:06:43.267265 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:06:43.267265 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:06:43.267265 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:06:43.267265 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:06:43.267265 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:06:43.267265 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:06:43.267265 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:06:43.267265 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 17:06:43.267265 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 17:06:43.267265 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 17:06:43.267265 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 17:06:43.269895 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 17:06:43.269895 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 17:06:43.269895 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 17:06:43.269895 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 17:06:43.269895 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:06:43.269895 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:06:43.269895 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:06:43.269895 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:06:43.269895 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:06:43.269895 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:06:43.269895 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:06:43.269895 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application with Lock( Jun 16 17:06:43.269895 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:06:43.269895 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:06:43.269895 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:06:43.269895 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:06:43.270734 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:06:43.270734 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:06:43.270734 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:06:43.270734 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:06:43.270734 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 17:06:43.270734 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 17:06:43.270734 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 17:06:43.270734 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 17:06:43.270734 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 17:06:43.270734 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 17:06:43.270734 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 17:06:43.270734 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Jun 16 17:06:43.273303 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 171/339] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 16 17:06:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 17:06:43.274749 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c409e3d-786f-4c47-950f-23390fff9da7 None None] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:43.275034 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c409e3d-786f-4c47-950f-23390fff9da7 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:43.275321 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c409e3d-786f-4c47-950f-23390fff9da7 None None] PATH_INFO: `/` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:43.276968 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 172/340] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 17:06:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:06:43.278113 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4c422e-edca-4a8c-9744-fb055c21e970 None None] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:43.278414 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4c422e-edca-4a8c-9744-fb055c21e970 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:43.278704 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4c422e-edca-4a8c-9744-fb055c21e970 None None] PATH_INFO: `/` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:43.279961 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 173/341] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 17:06:43 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:06:43.281334 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4c422e-edca-4a8c-9744-fb055c21e970 None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:43.339421 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5591ce-4812-4b54-8196-cd29a246ce09 None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:43.386416 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80590ff-dc0e-4594-ab2e-ab4f51ba9d26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:43.387159 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80590ff-dc0e-4594-ab2e-ab4f51ba9d26 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:43.387441 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80590ff-dc0e-4594-ab2e-ab4f51ba9d26 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:43.387717 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80590ff-dc0e-4594-ab2e-ab4f51ba9d26 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:43.402831 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80590ff-dc0e-4594-ab2e-ab4f51ba9d26 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 17:06:43.414211 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application [None req-d80590ff-dc0e-4594-ab2e-ab4f51ba9d26 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 17:06:43.414211 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:06:43.414211 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:06:43.414211 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:06:43.414211 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:06:43.414211 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:06:43.414211 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:06:43.414211 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:06:43.414211 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:06:43.414211 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:06:43.414211 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:06:43.414211 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:06:43.414211 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 17:06:43.414211 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 17:06:43.414211 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 17:06:43.414211 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 17:06:43.415166 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 17:06:43.415166 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 17:06:43.415166 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 17:06:43.415166 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 17:06:43.415166 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:06:43.415166 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:06:43.415166 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:06:43.415166 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:06:43.415166 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:06:43.415166 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:06:43.415166 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:06:43.415166 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application with Lock( Jun 16 17:06:43.415166 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:06:43.415166 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:06:43.415166 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:06:43.415166 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:06:43.415957 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:06:43.415957 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:06:43.415957 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:06:43.415957 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:06:43.415957 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 17:06:43.415957 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 17:06:43.415957 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 17:06:43.415957 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 17:06:43.415957 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 17:06:43.415957 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 17:06:43.415957 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 17:06:43.415957 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Jun 16 17:06:43.415957 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 169/342] 10.222.0.39 () {56 vars in 1114 bytes} [Thu Jun 16 17:06:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 17:06:43.417146 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f66767-2755-4b82-b24f-f0831ea73157 None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:43.417319 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f66767-2755-4b82-b24f-f0831ea73157 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:43.417576 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f66767-2755-4b82-b24f-f0831ea73157 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:43.420486 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4c422e-edca-4a8c-9744-fb055c21e970 None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:43.438783 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-56f66767-2755-4b82-b24f-f0831ea73157 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:06:43.441467 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-56f66767-2755-4b82-b24f-f0831ea73157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:06:43.466448 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a772b883-6433-4310-be45-43f9bd2f8552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:43.467602 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a772b883-6433-4310-be45-43f9bd2f8552 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:43.467831 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a772b883-6433-4310-be45-43f9bd2f8552 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:43.468068 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a772b883-6433-4310-be45-43f9bd2f8552 None admin] PATH_INFO: `/v3/roles` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:43.468834 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a772b883-6433-4310-be45-43f9bd2f8552 None admin] RBAC: Adding query filter params (name=member) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:06:43.469150 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a772b883-6433-4310-be45-43f9bd2f8552 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:43.470701 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a772b883-6433-4310-be45-43f9bd2f8552 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:43.480937 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 174/343] 10.222.0.39 () {56 vars in 1101 bytes} [Thu Jun 16 17:06:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:06:43.482071 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167e6f19-03f8-4562-a79d-dd1c7925c45b None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:43.482365 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167e6f19-03f8-4562-a79d-dd1c7925c45b None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:43.482649 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167e6f19-03f8-4562-a79d-dd1c7925c45b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:43.511990 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-167e6f19-03f8-4562-a79d-dd1c7925c45b None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:06:43.513191 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-167e6f19-03f8-4562-a79d-dd1c7925c45b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:06:43.531377 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:43.548152 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 170/344] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 17:06:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 17:06:43.554151 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f66767-2755-4b82-b24f-f0831ea73157 None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:43.591280 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:43.619681 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 175/345] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 17:06:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 17:06:43.620544 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167e6f19-03f8-4562-a79d-dd1c7925c45b None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:43.700515 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f66767-2755-4b82-b24f-f0831ea73157 None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:43.737732 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650d0789-2d9b-4d4c-873c-f76420e6c201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:43.737732 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650d0789-2d9b-4d4c-873c-f76420e6c201 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:43.737732 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650d0789-2d9b-4d4c-873c-f76420e6c201 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:43.737732 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650d0789-2d9b-4d4c-873c-f76420e6c201 None admin] PATH_INFO: `/v3/roles` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:43.740492 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650d0789-2d9b-4d4c-873c-f76420e6c201 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80873) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:06:43.740492 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650d0789-2d9b-4d4c-873c-f76420e6c201 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:43.741414 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650d0789-2d9b-4d4c-873c-f76420e6c201 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:43.750933 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 171/346] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 16 17:06:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:06:43.751813 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650d0789-2d9b-4d4c-873c-f76420e6c201 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:43.757137 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167e6f19-03f8-4562-a79d-dd1c7925c45b None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:43.796691 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e1f626-c610-4789-b38f-5907c07a3556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:43.797714 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e1f626-c610-4789-b38f-5907c07a3556 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:43.798313 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e1f626-c610-4789-b38f-5907c07a3556 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:43.798786 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e1f626-c610-4789-b38f-5907c07a3556 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:43.820273 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:43.855299 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:43.862552 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650d0789-2d9b-4d4c-873c-f76420e6c201 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:43.884725 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e1f626-c610-4789-b38f-5907c07a3556 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:43.886928 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e1f626-c610-4789-b38f-5907c07a3556 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:43.907267 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6c868a-04ce-435e-bfa4-055faa5cb049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:43.908072 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6c868a-04ce-435e-bfa4-055faa5cb049 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:43.908562 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6c868a-04ce-435e-bfa4-055faa5cb049 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:43.909027 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6c868a-04ce-435e-bfa4-055faa5cb049 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:43.922096 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6c868a-04ce-435e-bfa4-055faa5cb049 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 17:06:43.930344 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application [None req-7e6c868a-04ce-435e-bfa4-055faa5cb049 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 17:06:43.930344 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:06:43.930344 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:06:43.930344 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:06:43.930344 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:06:43.930344 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:06:43.930344 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:06:43.930344 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:06:43.930344 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:06:43.930344 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:06:43.930344 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:06:43.930344 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:06:43.930344 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 17:06:43.930344 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 17:06:43.930344 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 17:06:43.930344 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 17:06:43.931371 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 17:06:43.931371 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 17:06:43.931371 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 17:06:43.931371 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 17:06:43.931371 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:06:43.931371 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:06:43.931371 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:06:43.931371 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:06:43.931371 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:06:43.931371 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:06:43.931371 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:06:43.931371 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application with Lock( Jun 16 17:06:43.931371 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:06:43.931371 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:06:43.931371 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:06:43.931371 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:06:43.932269 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:06:43.932269 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:06:43.932269 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:06:43.932269 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:06:43.932269 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 17:06:43.932269 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 17:06:43.932269 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 17:06:43.932269 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 17:06:43.932269 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 17:06:43.932269 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 17:06:43.932269 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 17:06:43.932269 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Jun 16 17:06:43.935458 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 172/347] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 16 17:06:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:06:43.937161 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6c868a-04ce-435e-bfa4-055faa5cb049 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:44.003093 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 176/348] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 16 17:06:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 17:06:44.003756 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e1f626-c610-4789-b38f-5907c07a3556 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:44.058492 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:44.066420 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6c868a-04ce-435e-bfa4-055faa5cb049 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:44.107749 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e879af-a23a-41fc-a98e-d729c04cd2c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:44.108815 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e879af-a23a-41fc-a98e-d729c04cd2c6 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:44.109116 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e879af-a23a-41fc-a98e-d729c04cd2c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:44.109382 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e879af-a23a-41fc-a98e-d729c04cd2c6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:44.120602 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e879af-a23a-41fc-a98e-d729c04cd2c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 17:06:44.123038 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e1f626-c610-4789-b38f-5907c07a3556 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:44.131758 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application [None req-40e879af-a23a-41fc-a98e-d729c04cd2c6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 17:06:44.131758 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:06:44.131758 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:06:44.131758 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:06:44.131758 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:06:44.131758 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:06:44.131758 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:06:44.131758 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:06:44.131758 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:06:44.131758 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:06:44.131758 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:06:44.131758 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:06:44.131758 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 17:06:44.131758 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 17:06:44.131758 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 17:06:44.131758 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 17:06:44.132668 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 17:06:44.132668 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 17:06:44.132668 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 17:06:44.132668 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 17:06:44.132668 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:06:44.132668 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:06:44.132668 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:06:44.132668 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:06:44.132668 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:06:44.132668 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:06:44.132668 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:06:44.132668 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application with Lock( Jun 16 17:06:44.132668 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:06:44.132668 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:06:44.132668 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:06:44.132668 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:06:44.133467 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:06:44.133467 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:06:44.133467 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:06:44.133467 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:06:44.133467 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 17:06:44.133467 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 17:06:44.133467 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 17:06:44.133467 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 17:06:44.133467 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 17:06:44.133467 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 17:06:44.133467 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 17:06:44.133467 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Jun 16 17:06:44.134107 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 173/349] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 16 17:06:43 2022] GET /identity/v3/roles/reader => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:06:44.136437 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e879af-a23a-41fc-a98e-d729c04cd2c6 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:44.155935 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:44.184842 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbc9502-ef3a-4229-96cd-6cafb41a4dd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:44.185507 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbc9502-ef3a-4229-96cd-6cafb41a4dd3 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:44.185871 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbc9502-ef3a-4229-96cd-6cafb41a4dd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:44.186925 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbc9502-ef3a-4229-96cd-6cafb41a4dd3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:44.267743 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e879af-a23a-41fc-a98e-d729c04cd2c6 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:44.280810 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbc9502-ef3a-4229-96cd-6cafb41a4dd3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:44.282696 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbc9502-ef3a-4229-96cd-6cafb41a4dd3 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:44.313342 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0762d069-c378-4703-b1a5-c1b6f27f0fbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:44.314079 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0762d069-c378-4703-b1a5-c1b6f27f0fbc None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:44.314699 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0762d069-c378-4703-b1a5-c1b6f27f0fbc None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:44.314699 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0762d069-c378-4703-b1a5-c1b6f27f0fbc None admin] PATH_INFO: `/v3/roles` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:44.315538 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0762d069-c378-4703-b1a5-c1b6f27f0fbc None admin] RBAC: Adding query filter params (name=member) {{(pid=80873) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:06:44.315721 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0762d069-c378-4703-b1a5-c1b6f27f0fbc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:44.317100 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0762d069-c378-4703-b1a5-c1b6f27f0fbc None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:44.326486 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 174/350] 10.222.0.39 () {56 vars in 1101 bytes} [Thu Jun 16 17:06:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:06:44.331734 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0762d069-c378-4703-b1a5-c1b6f27f0fbc None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:44.364975 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:44.418662 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 177/351] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 16 17:06:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 17:06:44.420253 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f226a61-c2d3-4ef7-bdfd-369670295244 None None] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:44.420727 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f226a61-c2d3-4ef7-bdfd-369670295244 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:44.421034 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f226a61-c2d3-4ef7-bdfd-369670295244 None None] PATH_INFO: `/` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:44.422627 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 178/352] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 17:06:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:06:44.423371 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f226a61-c2d3-4ef7-bdfd-369670295244 None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:44.432833 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:44.463487 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0762d069-c378-4703-b1a5-c1b6f27f0fbc None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:44.503550 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1baab49-2d9a-48cb-94de-db42bb2e3cb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:44.505894 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1baab49-2d9a-48cb-94de-db42bb2e3cb9 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:44.507127 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1baab49-2d9a-48cb-94de-db42bb2e3cb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:44.508375 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1baab49-2d9a-48cb-94de-db42bb2e3cb9 None admin] PATH_INFO: `/v3/projects/ac5b05cf174a49b0aae4343f1ac0f173` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:44.509678 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1baab49-2d9a-48cb-94de-db42bb2e3cb9 None admin] RBAC: Authorizing `identity:get_project(project_id=ac5b05cf174a49b0aae4343f1ac0f173)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:44.511185 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1baab49-2d9a-48cb-94de-db42bb2e3cb9 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:44.512918 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 175/353] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 16 17:06:44 2022] GET /identity/v3/projects/ac5b05cf174a49b0aae4343f1ac0f173 => generated 298 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:06:44.513818 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1baab49-2d9a-48cb-94de-db42bb2e3cb9 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:44.562294 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f226a61-c2d3-4ef7-bdfd-369670295244 None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:44.601655 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1132a46-0b07-4349-8a14-5f5d1213779f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:44.602634 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1132a46-0b07-4349-8a14-5f5d1213779f None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:44.602923 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1132a46-0b07-4349-8a14-5f5d1213779f None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:44.603202 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1132a46-0b07-4349-8a14-5f5d1213779f None admin] PATH_INFO: `/v3/roles` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:44.603956 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1132a46-0b07-4349-8a14-5f5d1213779f None admin] RBAC: Adding query filter params (name=reader) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:06:44.604270 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1132a46-0b07-4349-8a14-5f5d1213779f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:44.605640 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1132a46-0b07-4349-8a14-5f5d1213779f None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:44.614187 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 179/354] 10.222.0.39 () {56 vars in 1101 bytes} [Thu Jun 16 17:06:44 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:06:44.615527 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4be935-2b1e-40d5-a5ad-f1758cf78a75 None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:44.615893 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4be935-2b1e-40d5-a5ad-f1758cf78a75 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:44.616182 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4be935-2b1e-40d5-a5ad-f1758cf78a75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:44.633461 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1baab49-2d9a-48cb-94de-db42bb2e3cb9 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:44.635988 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-0d4be935-2b1e-40d5-a5ad-f1758cf78a75 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:06:44.637171 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-0d4be935-2b1e-40d5-a5ad-f1758cf78a75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:06:44.645726 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:44.681547 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c2ebc0-7407-48e3-b16c-58827d510ae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:44.682911 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c2ebc0-7407-48e3-b16c-58827d510ae1 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:44.683370 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c2ebc0-7407-48e3-b16c-58827d510ae1 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:44.683827 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c2ebc0-7407-48e3-b16c-58827d510ae1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:44.709186 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:44.723879 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 180/355] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 17:06:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 17:06:44.724746 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4be935-2b1e-40d5-a5ad-f1758cf78a75 None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:44.776788 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c2ebc0-7407-48e3-b16c-58827d510ae1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:44.778625 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c2ebc0-7407-48e3-b16c-58827d510ae1 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:44.838311 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4be935-2b1e-40d5-a5ad-f1758cf78a75 None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:44.884197 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b310973-1612-490c-883f-29f6a7f0d5e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:44.885805 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b310973-1612-490c-883f-29f6a7f0d5e1 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:44.886787 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b310973-1612-490c-883f-29f6a7f0d5e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:44.887540 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b310973-1612-490c-883f-29f6a7f0d5e1 None admin] PATH_INFO: `/v3/projects/ac5b05cf174a49b0aae4343f1ac0f173` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:44.888822 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b310973-1612-490c-883f-29f6a7f0d5e1 None admin] RBAC: Authorizing `identity:get_project(project_id=ac5b05cf174a49b0aae4343f1ac0f173)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:44.891090 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b310973-1612-490c-883f-29f6a7f0d5e1 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:44.892857 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 181/356] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 16 17:06:44 2022] GET /identity/v3/projects/ac5b05cf174a49b0aae4343f1ac0f173 => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:06:44.895073 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb5ffc0-fb7f-44e1-956f-dea01cc59493 None None] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:44.895368 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb5ffc0-fb7f-44e1-956f-dea01cc59493 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:44.895648 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb5ffc0-fb7f-44e1-956f-dea01cc59493 None None] PATH_INFO: `/` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:44.897057 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 182/357] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 17:06:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:06:44.897621 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb5ffc0-fb7f-44e1-956f-dea01cc59493 None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:44.904779 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 176/358] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 16 17:06:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 17:06:44.906877 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c2ebc0-7407-48e3-b16c-58827d510ae1 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:44.910077 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:44.967076 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:45.026405 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb5ffc0-fb7f-44e1-956f-dea01cc59493 None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:45.031919 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c2ebc0-7407-48e3-b16c-58827d510ae1 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:45.068221 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce13656-4ccf-435c-91fa-7c12fd516993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:45.069098 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce13656-4ccf-435c-91fa-7c12fd516993 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:45.069714 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce13656-4ccf-435c-91fa-7c12fd516993 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:45.070140 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce13656-4ccf-435c-91fa-7c12fd516993 None admin] PATH_INFO: `/v3/groups/c7805c4fc1db4d578b2a0e603b56bf39` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:45.078903 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71d8d86-f984-4bf7-bed9-a466c338eb8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:45.079100 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce13656-4ccf-435c-91fa-7c12fd516993 None admin] RBAC: Authorizing `identity:get_group(group_id=c7805c4fc1db4d578b2a0e603b56bf39)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:45.079784 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71d8d86-f984-4bf7-bed9-a466c338eb8e None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:45.080075 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71d8d86-f984-4bf7-bed9-a466c338eb8e None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:45.080351 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71d8d86-f984-4bf7-bed9-a466c338eb8e None admin] PATH_INFO: `/v3/users/ac3dc2e5a9b24a4fa24a6ceacbb9eb6d` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:45.080546 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce13656-4ccf-435c-91fa-7c12fd516993 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:45.081696 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71d8d86-f984-4bf7-bed9-a466c338eb8e None admin] RBAC: Authorizing `identity:get_user(user_id=ac3dc2e5a9b24a4fa24a6ceacbb9eb6d)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:45.082490 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 183/359] 10.222.0.39 () {56 vars in 1180 bytes} [Thu Jun 16 17:06:44 2022] GET /identity/v3/groups/c7805c4fc1db4d578b2a0e603b56bf39 => generated 226 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:06:45.083921 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71d8d86-f984-4bf7-bed9-a466c338eb8e None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:45.085604 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 177/360] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jun 16 17:06:44 2022] GET /identity/v3/users/ac3dc2e5a9b24a4fa24a6ceacbb9eb6d => generated 293 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:06:45.086420 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce13656-4ccf-435c-91fa-7c12fd516993 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:45.086982 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfbeb9e-b399-4146-846f-b19a7000e694 None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:45.087282 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfbeb9e-b399-4146-846f-b19a7000e694 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:45.087569 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfbeb9e-b399-4146-846f-b19a7000e694 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:45.105234 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-9cfbeb9e-b399-4146-846f-b19a7000e694 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:06:45.106421 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-9cfbeb9e-b399-4146-846f-b19a7000e694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:06:45.176967 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:45.185927 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 178/361] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 17:06:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 17:06:45.187455 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfbeb9e-b399-4146-846f-b19a7000e694 None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:45.217531 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce13656-4ccf-435c-91fa-7c12fd516993 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:45.251776 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:45.257937 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edda771-3d40-4391-aa5c-3719e770d7f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:45.259113 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edda771-3d40-4391-aa5c-3719e770d7f6 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:45.259400 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edda771-3d40-4391-aa5c-3719e770d7f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:45.259682 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edda771-3d40-4391-aa5c-3719e770d7f6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:45.272080 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edda771-3d40-4391-aa5c-3719e770d7f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 17:06:45.281206 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application [None req-7edda771-3d40-4391-aa5c-3719e770d7f6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 17:06:45.281206 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:06:45.281206 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:06:45.281206 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:06:45.281206 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:06:45.281206 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:06:45.281206 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:06:45.281206 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:06:45.281206 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:06:45.281206 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:06:45.281206 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:06:45.281206 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:06:45.281206 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 17:06:45.281206 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 17:06:45.281206 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 17:06:45.281206 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 17:06:45.282466 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 17:06:45.282466 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 17:06:45.282466 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 17:06:45.282466 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 17:06:45.282466 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:06:45.282466 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:06:45.282466 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:06:45.282466 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:06:45.282466 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:06:45.282466 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:06:45.282466 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:06:45.282466 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application with Lock( Jun 16 17:06:45.282466 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:06:45.282466 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:06:45.282466 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:06:45.282466 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:06:45.283301 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:06:45.283301 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:06:45.283301 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:06:45.283301 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:06:45.283301 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 17:06:45.283301 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 17:06:45.283301 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 17:06:45.283301 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 17:06:45.283301 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 17:06:45.283301 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 17:06:45.283301 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 17:06:45.283301 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Jun 16 17:06:45.283301 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 184/362] 10.222.0.39 () {56 vars in 1114 bytes} [Thu Jun 16 17:06:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:06:45.283986 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edda771-3d40-4391-aa5c-3719e770d7f6 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:45.317261 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfbeb9e-b399-4146-846f-b19a7000e694 None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:45.356955 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a62acde-93c4-43f4-8961-688b6c8d3a20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:45.358210 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a62acde-93c4-43f4-8961-688b6c8d3a20 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:45.358497 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a62acde-93c4-43f4-8961-688b6c8d3a20 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:45.358780 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a62acde-93c4-43f4-8961-688b6c8d3a20 None admin] PATH_INFO: `/v3/groups/c7805c4fc1db4d578b2a0e603b56bf39` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:45.359990 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a62acde-93c4-43f4-8961-688b6c8d3a20 None admin] RBAC: Authorizing `identity:get_group(group_id=c7805c4fc1db4d578b2a0e603b56bf39)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:45.361452 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a62acde-93c4-43f4-8961-688b6c8d3a20 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:45.363447 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 179/363] 10.222.0.39 () {56 vars in 1180 bytes} [Thu Jun 16 17:06:45 2022] GET /identity/v3/groups/c7805c4fc1db4d578b2a0e603b56bf39 => generated 226 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:06:45.364228 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a62acde-93c4-43f4-8961-688b6c8d3a20 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:45.396506 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edda771-3d40-4391-aa5c-3719e770d7f6 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:45.435075 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722102f6-f93e-4cd6-9789-5bfcedf78232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:45.437089 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722102f6-f93e-4cd6-9789-5bfcedf78232 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:45.437281 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722102f6-f93e-4cd6-9789-5bfcedf78232 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:45.437573 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722102f6-f93e-4cd6-9789-5bfcedf78232 None admin] PATH_INFO: `/v3/projects/d38e49d57050488484d9f03fdb7552ee` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:45.438970 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722102f6-f93e-4cd6-9789-5bfcedf78232 None admin] RBAC: Authorizing `identity:get_project(project_id=d38e49d57050488484d9f03fdb7552ee)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:45.440432 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722102f6-f93e-4cd6-9789-5bfcedf78232 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:45.442369 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 185/364] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 16 17:06:45 2022] GET /identity/v3/projects/d38e49d57050488484d9f03fdb7552ee => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:06:45.442984 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722102f6-f93e-4cd6-9789-5bfcedf78232 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:45.450958 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:45.486892 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a62acde-93c4-43f4-8961-688b6c8d3a20 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:45.499276 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:45.526655 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bcea96-2a8f-4057-a66c-283e8ced355e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:45.527357 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bcea96-2a8f-4057-a66c-283e8ced355e None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:45.527849 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bcea96-2a8f-4057-a66c-283e8ced355e None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:45.528296 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bcea96-2a8f-4057-a66c-283e8ced355e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:45.529635 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bcea96-2a8f-4057-a66c-283e8ced355e None admin] RBAC: Adding query filter params (group.id=c7805c4fc1db4d578b2a0e603b56bf39, role.id=896bff49c5d6464eb612a15f4aa9badc, scope.project.id=ac5b05cf174a49b0aae4343f1ac0f173) {{(pid=80873) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:06:45.530573 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bcea96-2a8f-4057-a66c-283e8ced355e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:45.532378 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bcea96-2a8f-4057-a66c-283e8ced355e None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:45.538315 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 180/365] 10.222.0.39 () {56 vars in 1376 bytes} [Thu Jun 16 17:06:45 2022] GET /identity/v3/role_assignments?group.id=c7805c4fc1db4d578b2a0e603b56bf39&scope.project.id=ac5b05cf174a49b0aae4343f1ac0f173&role.id=896bff49c5d6464eb612a15f4aa9badc => generated 260 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:06:45.539101 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bcea96-2a8f-4057-a66c-283e8ced355e None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:45.584329 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722102f6-f93e-4cd6-9789-5bfcedf78232 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:45.623987 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ece06c1-0421-44c5-a19b-fc5250706afb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:45.625104 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ece06c1-0421-44c5-a19b-fc5250706afb None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:45.625474 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ece06c1-0421-44c5-a19b-fc5250706afb None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:45.625798 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ece06c1-0421-44c5-a19b-fc5250706afb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:45.626669 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ece06c1-0421-44c5-a19b-fc5250706afb None admin] RBAC: Adding query filter params (role.id=74b3015ca91b437f8d6ee242563b6547, user.id=ac3dc2e5a9b24a4fa24a6ceacbb9eb6d, scope.system=all) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:06:45.626998 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ece06c1-0421-44c5-a19b-fc5250706afb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:45.628675 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ece06c1-0421-44c5-a19b-fc5250706afb None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:45.653796 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 186/366] 10.222.0.39 () {56 vars in 1308 bytes} [Thu Jun 16 17:06:45 2022] GET /identity/v3/role_assignments?user.id=ac3dc2e5a9b24a4fa24a6ceacbb9eb6d&scope.system=all&role.id=74b3015ca91b437f8d6ee242563b6547 => generated 510 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:06:45.653796 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ece06c1-0421-44c5-a19b-fc5250706afb None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:45.670946 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bcea96-2a8f-4057-a66c-283e8ced355e None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:45.723564 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:45.741088 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feac5030-b6ef-437b-8dde-bc7488a795ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:45.741946 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feac5030-b6ef-437b-8dde-bc7488a795ee None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:45.742237 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feac5030-b6ef-437b-8dde-bc7488a795ee None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:45.742521 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feac5030-b6ef-437b-8dde-bc7488a795ee None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:45.755650 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feac5030-b6ef-437b-8dde-bc7488a795ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 17:06:45.763597 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application [None req-feac5030-b6ef-437b-8dde-bc7488a795ee None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 17:06:45.763597 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:06:45.763597 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:06:45.763597 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:06:45.763597 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:06:45.763597 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:06:45.763597 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:06:45.763597 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:06:45.763597 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:06:45.763597 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:06:45.763597 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:06:45.763597 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:06:45.763597 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 17:06:45.763597 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 17:06:45.763597 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 17:06:45.763597 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 17:06:45.765237 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 17:06:45.765237 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 17:06:45.765237 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 17:06:45.765237 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 17:06:45.765237 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:06:45.765237 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:06:45.765237 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:06:45.765237 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:06:45.765237 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:06:45.765237 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:06:45.765237 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:06:45.765237 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application with Lock( Jun 16 17:06:45.765237 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:06:45.765237 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:06:45.765237 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:06:45.765237 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:06:45.766085 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:06:45.766085 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:06:45.766085 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:06:45.766085 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:06:45.766085 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 17:06:45.766085 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 17:06:45.766085 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 17:06:45.766085 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 17:06:45.766085 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 17:06:45.766085 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 17:06:45.766085 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 17:06:45.766085 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Jun 16 17:06:45.766085 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 181/367] 10.222.0.39 () {56 vars in 1096 bytes} [Thu Jun 16 17:06:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:06:45.767560 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feac5030-b6ef-437b-8dde-bc7488a795ee None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:45.792093 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ece06c1-0421-44c5-a19b-fc5250706afb None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:45.807384 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:45.838750 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dc545b-00da-4273-8890-f85b7440d347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:45.839789 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dc545b-00da-4273-8890-f85b7440d347 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:45.840305 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dc545b-00da-4273-8890-f85b7440d347 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:45.840585 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dc545b-00da-4273-8890-f85b7440d347 None admin] PATH_INFO: `/v3/roles` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:45.841418 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7dc545b-00da-4273-8890-f85b7440d347 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:06:45.841647 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7dc545b-00da-4273-8890-f85b7440d347 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:45.843172 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7dc545b-00da-4273-8890-f85b7440d347 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:45.852276 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 187/368] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 16 17:06:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:06:45.853114 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dc545b-00da-4273-8890-f85b7440d347 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:45.895454 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feac5030-b6ef-437b-8dde-bc7488a795ee None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:45.937060 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d2ce7f-970e-4ae6-b2fb-d63c5ac5c567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:45.937913 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d2ce7f-970e-4ae6-b2fb-d63c5ac5c567 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:45.938230 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d2ce7f-970e-4ae6-b2fb-d63c5ac5c567 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:45.938517 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d2ce7f-970e-4ae6-b2fb-d63c5ac5c567 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:45.939366 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d2ce7f-970e-4ae6-b2fb-d63c5ac5c567 None admin] RBAC: Adding query filter params (group.id=c7805c4fc1db4d578b2a0e603b56bf39, role.id=9331b396c9894ab88267e7b82ef6f224, scope.project.id=ac5b05cf174a49b0aae4343f1ac0f173) {{(pid=80873) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:06:45.939689 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d2ce7f-970e-4ae6-b2fb-d63c5ac5c567 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:45.941239 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d2ce7f-970e-4ae6-b2fb-d63c5ac5c567 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:45.948866 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 182/369] 10.222.0.39 () {56 vars in 1376 bytes} [Thu Jun 16 17:06:45 2022] GET /identity/v3/role_assignments?group.id=c7805c4fc1db4d578b2a0e603b56bf39&scope.project.id=ac5b05cf174a49b0aae4343f1ac0f173&role.id=9331b396c9894ab88267e7b82ef6f224 => generated 260 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:06:45.949472 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d2ce7f-970e-4ae6-b2fb-d63c5ac5c567 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:45.988366 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dc545b-00da-4273-8890-f85b7440d347 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:46.014654 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:46.026866 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0db249-b9a8-4ca5-8f7e-b651f04a2314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:46.027835 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0db249-b9a8-4ca5-8f7e-b651f04a2314 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:46.028125 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0db249-b9a8-4ca5-8f7e-b651f04a2314 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:46.031759 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0db249-b9a8-4ca5-8f7e-b651f04a2314 None admin] PATH_INFO: `/v3/groups/c7805c4fc1db4d578b2a0e603b56bf39` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:46.031759 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0db249-b9a8-4ca5-8f7e-b651f04a2314 None admin] RBAC: Authorizing `identity:get_group(group_id=c7805c4fc1db4d578b2a0e603b56bf39)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:46.031759 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0db249-b9a8-4ca5-8f7e-b651f04a2314 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:46.033554 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 188/370] 10.222.0.39 () {56 vars in 1180 bytes} [Thu Jun 16 17:06:45 2022] GET /identity/v3/groups/c7805c4fc1db4d578b2a0e603b56bf39 => generated 226 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:06:46.034478 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0db249-b9a8-4ca5-8f7e-b651f04a2314 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:46.095682 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:46.100263 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d2ce7f-970e-4ae6-b2fb-d63c5ac5c567 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:46.147446 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b0b41b-3b93-47e9-9702-d8ee61fba0f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:46.148249 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b0b41b-3b93-47e9-9702-d8ee61fba0f3 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:46.148710 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b0b41b-3b93-47e9-9702-d8ee61fba0f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:46.149095 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b0b41b-3b93-47e9-9702-d8ee61fba0f3 None admin] PATH_INFO: `/v3/roles` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:46.150234 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b0b41b-3b93-47e9-9702-d8ee61fba0f3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80873) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:06:46.150554 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b0b41b-3b93-47e9-9702-d8ee61fba0f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:46.151942 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b0b41b-3b93-47e9-9702-d8ee61fba0f3 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:46.162360 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 183/371] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 16 17:06:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:06:46.163335 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b0b41b-3b93-47e9-9702-d8ee61fba0f3 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:46.171430 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0db249-b9a8-4ca5-8f7e-b651f04a2314 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:46.219024 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef62ec16-0a21-45c3-a82c-de7d8ebbe43b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:46.220146 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef62ec16-0a21-45c3-a82c-de7d8ebbe43b None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:46.220443 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef62ec16-0a21-45c3-a82c-de7d8ebbe43b None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:46.220729 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef62ec16-0a21-45c3-a82c-de7d8ebbe43b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:46.302194 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:46.314264 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b0b41b-3b93-47e9-9702-d8ee61fba0f3 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:46.316057 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef62ec16-0a21-45c3-a82c-de7d8ebbe43b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:46.318811 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef62ec16-0a21-45c3-a82c-de7d8ebbe43b None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:46.361406 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9edaf96-8071-4e86-bdd1-3fad490a77d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:46.362171 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9edaf96-8071-4e86-bdd1-3fad490a77d8 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:46.362402 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9edaf96-8071-4e86-bdd1-3fad490a77d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:46.363567 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9edaf96-8071-4e86-bdd1-3fad490a77d8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:46.363678 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9edaf96-8071-4e86-bdd1-3fad490a77d8 None admin] RBAC: Adding query filter params (group.id=c7805c4fc1db4d578b2a0e603b56bf39, role.id=896bff49c5d6464eb612a15f4aa9badc, scope.project.id=d38e49d57050488484d9f03fdb7552ee) {{(pid=80873) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:06:46.364409 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9edaf96-8071-4e86-bdd1-3fad490a77d8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:46.365409 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9edaf96-8071-4e86-bdd1-3fad490a77d8 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:46.371841 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 184/372] 10.222.0.39 () {56 vars in 1376 bytes} [Thu Jun 16 17:06:46 2022] GET /identity/v3/role_assignments?group.id=c7805c4fc1db4d578b2a0e603b56bf39&scope.project.id=d38e49d57050488484d9f03fdb7552ee&role.id=896bff49c5d6464eb612a15f4aa9badc => generated 260 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:06:46.373014 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9edaf96-8071-4e86-bdd1-3fad490a77d8 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:46.409366 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:46.554655 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9edaf96-8071-4e86-bdd1-3fad490a77d8 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:46.569014 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 189/373] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 16 17:06:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 535 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 17:06:46.578904 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef62ec16-0a21-45c3-a82c-de7d8ebbe43b None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:46.621789 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21bc597-5db3-4f31-bc08-edfda1431a0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:46.622456 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21bc597-5db3-4f31-bc08-edfda1431a0d None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:46.624499 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21bc597-5db3-4f31-bc08-edfda1431a0d None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:46.624499 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21bc597-5db3-4f31-bc08-edfda1431a0d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:46.698428 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21bc597-5db3-4f31-bc08-edfda1431a0d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:46.699843 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21bc597-5db3-4f31-bc08-edfda1431a0d None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:46.701331 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:46.713621 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef62ec16-0a21-45c3-a82c-de7d8ebbe43b None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:46.726598 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:46.755425 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e708a687-6954-4992-880f-05c8ab1f5591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:46.756753 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e708a687-6954-4992-880f-05c8ab1f5591 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:46.757258 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e708a687-6954-4992-880f-05c8ab1f5591 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:46.757743 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e708a687-6954-4992-880f-05c8ab1f5591 None admin] PATH_INFO: `/v3/projects/d38e49d57050488484d9f03fdb7552ee` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:46.759256 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e708a687-6954-4992-880f-05c8ab1f5591 None admin] RBAC: Authorizing `identity:get_project(project_id=d38e49d57050488484d9f03fdb7552ee)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:46.760980 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e708a687-6954-4992-880f-05c8ab1f5591 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:46.763257 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 190/374] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 16 17:06:46 2022] GET /identity/v3/projects/d38e49d57050488484d9f03fdb7552ee => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:06:46.770941 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e708a687-6954-4992-880f-05c8ab1f5591 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:46.832602 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 185/375] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 16 17:06:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 460 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 17:06:46.839286 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21bc597-5db3-4f31-bc08-edfda1431a0d None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:46.966447 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e708a687-6954-4992-880f-05c8ab1f5591 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:47.006919 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f639047c-a23d-486e-b0b3-a3b2637a94a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:47.008924 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f639047c-a23d-486e-b0b3-a3b2637a94a9 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:47.008924 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f639047c-a23d-486e-b0b3-a3b2637a94a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:47.008924 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f639047c-a23d-486e-b0b3-a3b2637a94a9 None admin] PATH_INFO: `/v3/groups/c7805c4fc1db4d578b2a0e603b56bf39` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:47.011081 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f639047c-a23d-486e-b0b3-a3b2637a94a9 None admin] RBAC: Authorizing `identity:get_group(group_id=c7805c4fc1db4d578b2a0e603b56bf39)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:47.012671 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f639047c-a23d-486e-b0b3-a3b2637a94a9 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:47.015265 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 191/376] 10.222.0.39 () {56 vars in 1180 bytes} [Thu Jun 16 17:06:46 2022] GET /identity/v3/groups/c7805c4fc1db4d578b2a0e603b56bf39 => generated 226 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:06:47.021017 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f639047c-a23d-486e-b0b3-a3b2637a94a9 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:47.051206 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:47.079009 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21bc597-5db3-4f31-bc08-edfda1431a0d None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:47.135291 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:47.157080 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9827cd87-3d94-4bbc-bb96-43d5c163aa80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:47.158308 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9827cd87-3d94-4bbc-bb96-43d5c163aa80 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:47.158920 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9827cd87-3d94-4bbc-bb96-43d5c163aa80 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:47.159493 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9827cd87-3d94-4bbc-bb96-43d5c163aa80 None admin] PATH_INFO: `/v3/projects/63375056d675488ab27a6e1a845c0237` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:47.160919 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9827cd87-3d94-4bbc-bb96-43d5c163aa80 None admin] RBAC: Authorizing `identity:get_project(project_id=63375056d675488ab27a6e1a845c0237)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:47.167868 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9827cd87-3d94-4bbc-bb96-43d5c163aa80 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:47.167868 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 186/377] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 16 17:06:46 2022] GET /identity/v3/projects/63375056d675488ab27a6e1a845c0237 => generated 344 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:06:47.168091 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f639047c-a23d-486e-b0b3-a3b2637a94a9 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:47.175467 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9827cd87-3d94-4bbc-bb96-43d5c163aa80 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:47.266665 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95dab8b-e55e-4c0d-884c-c2016e24976c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:47.267320 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95dab8b-e55e-4c0d-884c-c2016e24976c None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:47.267610 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95dab8b-e55e-4c0d-884c-c2016e24976c None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:47.267889 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95dab8b-e55e-4c0d-884c-c2016e24976c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:47.268831 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95dab8b-e55e-4c0d-884c-c2016e24976c None admin] RBAC: Adding query filter params (group.id=c7805c4fc1db4d578b2a0e603b56bf39, role.id=9331b396c9894ab88267e7b82ef6f224, scope.project.id=d38e49d57050488484d9f03fdb7552ee) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:06:47.269148 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95dab8b-e55e-4c0d-884c-c2016e24976c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:47.270621 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95dab8b-e55e-4c0d-884c-c2016e24976c None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:47.284572 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 192/378] 10.222.0.39 () {56 vars in 1376 bytes} [Thu Jun 16 17:06:47 2022] GET /identity/v3/role_assignments?group.id=c7805c4fc1db4d578b2a0e603b56bf39&scope.project.id=d38e49d57050488484d9f03fdb7552ee&role.id=9331b396c9894ab88267e7b82ef6f224 => generated 260 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 17:06:47.300949 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9827cd87-3d94-4bbc-bb96-43d5c163aa80 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:47.345730 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2258308-31e7-4166-be60-e05656a73bc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:47.346881 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2258308-31e7-4166-be60-e05656a73bc7 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:47.347178 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2258308-31e7-4166-be60-e05656a73bc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:47.347467 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2258308-31e7-4166-be60-e05656a73bc7 None admin] PATH_INFO: `/v3/groups/93fa516d6693407d813d52f4b9d3d1fe` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:47.362685 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2258308-31e7-4166-be60-e05656a73bc7 None admin] RBAC: Authorizing `identity:get_group(group_id=93fa516d6693407d813d52f4b9d3d1fe)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:47.364273 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2258308-31e7-4166-be60-e05656a73bc7 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:47.366587 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 187/379] 10.222.0.39 () {56 vars in 1180 bytes} [Thu Jun 16 17:06:47 2022] GET /identity/v3/groups/93fa516d6693407d813d52f4b9d3d1fe => generated 229 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:06:47.372265 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95dab8b-e55e-4c0d-884c-c2016e24976c None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:47.521171 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:47.535913 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95dab8b-e55e-4c0d-884c-c2016e24976c None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:47.576926 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ed3a2a-f49d-4e5d-8dd5-90afb8b6c815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:47.577586 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ed3a2a-f49d-4e5d-8dd5-90afb8b6c815 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:47.577897 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ed3a2a-f49d-4e5d-8dd5-90afb8b6c815 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:47.578180 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ed3a2a-f49d-4e5d-8dd5-90afb8b6c815 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:47.579016 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ed3a2a-f49d-4e5d-8dd5-90afb8b6c815 None admin] RBAC: Adding query filter params (group.id=93fa516d6693407d813d52f4b9d3d1fe, role.id=dba744f8ab2a4c45b9d3212f8d203aba, scope.project.id=63375056d675488ab27a6e1a845c0237) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:06:47.579332 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ed3a2a-f49d-4e5d-8dd5-90afb8b6c815 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:47.580772 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ed3a2a-f49d-4e5d-8dd5-90afb8b6c815 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:47.589827 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 193/380] 10.222.0.39 () {56 vars in 1376 bytes} [Thu Jun 16 17:06:47 2022] GET /identity/v3/role_assignments?group.id=93fa516d6693407d813d52f4b9d3d1fe&scope.project.id=63375056d675488ab27a6e1a845c0237&role.id=dba744f8ab2a4c45b9d3212f8d203aba => generated 260 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:06:48.050532 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96d578f-470a-4dcc-81ef-666a4c5ce54f None None] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:48.050905 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96d578f-470a-4dcc-81ef-666a4c5ce54f None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:48.051101 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96d578f-470a-4dcc-81ef-666a4c5ce54f None None] PATH_INFO: `/` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:48.052779 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 188/381] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 17:06:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:06:48.067273 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506c7f39-33b0-4e96-a837-435fc64ddede None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:48.067779 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506c7f39-33b0-4e96-a837-435fc64ddede None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:48.067864 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506c7f39-33b0-4e96-a837-435fc64ddede None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:48.090779 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-506c7f39-33b0-4e96-a837-435fc64ddede None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:06:48.091987 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-506c7f39-33b0-4e96-a837-435fc64ddede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:06:48.183546 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 194/382] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 17:06:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 17:06:48.220939 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96d578f-470a-4dcc-81ef-666a4c5ce54f None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:48.304238 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:48.363635 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96d578f-470a-4dcc-81ef-666a4c5ce54f None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:48.413513 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5c7435-4064-4043-be84-2668ad99f75c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:48.418706 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5c7435-4064-4043-be84-2668ad99f75c None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:48.419209 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5c7435-4064-4043-be84-2668ad99f75c None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:48.419746 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5c7435-4064-4043-be84-2668ad99f75c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:48.432812 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5c7435-4064-4043-be84-2668ad99f75c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 17:06:48.445287 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application [None req-4f5c7435-4064-4043-be84-2668ad99f75c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 17:06:48.445287 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:06:48.445287 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:06:48.445287 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:06:48.445287 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:06:48.445287 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:06:48.445287 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:06:48.445287 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:06:48.445287 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:06:48.445287 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:06:48.445287 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:06:48.445287 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:06:48.445287 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 17:06:48.445287 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 17:06:48.445287 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 17:06:48.445287 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 17:06:48.446251 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 17:06:48.446251 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 17:06:48.446251 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 17:06:48.446251 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 17:06:48.446251 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:06:48.446251 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:06:48.446251 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:06:48.446251 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:06:48.446251 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:06:48.446251 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:06:48.446251 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:06:48.446251 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application with Lock( Jun 16 17:06:48.446251 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:06:48.446251 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:06:48.446251 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:06:48.446251 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:06:48.447045 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:06:48.447045 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:06:48.447045 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:06:48.447045 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:06:48.447045 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 17:06:48.447045 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 17:06:48.447045 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 17:06:48.447045 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 17:06:48.447045 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 17:06:48.447045 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 17:06:48.447045 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 17:06:48.447045 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Jun 16 17:06:48.449867 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 189/383] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 16 17:06:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:06:48.455638 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506c7f39-33b0-4e96-a837-435fc64ddede None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:48.589043 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:48.610851 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506c7f39-33b0-4e96-a837-435fc64ddede None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:48.621358 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87304a0a-a206-455a-a154-576ca909e068 None None] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:48.621650 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87304a0a-a206-455a-a154-576ca909e068 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:48.621964 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87304a0a-a206-455a-a154-576ca909e068 None None] PATH_INFO: `/` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:48.629864 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 190/384] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 17:06:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:06:48.639338 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e21eabb-04da-4979-ae36-4e89f0df6d06 None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:48.639637 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e21eabb-04da-4979-ae36-4e89f0df6d06 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:48.639928 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e21eabb-04da-4979-ae36-4e89f0df6d06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:48.659543 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67a65b6-0617-493e-b877-31f87bc9d4a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:48.660428 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67a65b6-0617-493e-b877-31f87bc9d4a8 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:48.660722 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67a65b6-0617-493e-b877-31f87bc9d4a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:48.661088 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67a65b6-0617-493e-b877-31f87bc9d4a8 None admin] PATH_INFO: `/v3/roles` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:48.661919 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67a65b6-0617-493e-b877-31f87bc9d4a8 None admin] RBAC: Adding query filter params (name=member) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:06:48.662398 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67a65b6-0617-493e-b877-31f87bc9d4a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:48.663883 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67a65b6-0617-493e-b877-31f87bc9d4a8 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:48.678308 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-2e21eabb-04da-4979-ae36-4e89f0df6d06 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:06:48.679520 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-2e21eabb-04da-4979-ae36-4e89f0df6d06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:06:48.685082 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 195/385] 10.222.0.39 () {56 vars in 1101 bytes} [Thu Jun 16 17:06:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:06:48.694803 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67a65b6-0617-493e-b877-31f87bc9d4a8 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:48.763042 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 191/386] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 17:06:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 17:06:48.797927 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e21eabb-04da-4979-ae36-4e89f0df6d06 None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:48.877944 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67a65b6-0617-493e-b877-31f87bc9d4a8 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:48.906131 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:48.921166 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a341650-83ab-4772-ab54-61385e01b1f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:48.923252 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a341650-83ab-4772-ab54-61385e01b1f8 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:48.923548 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a341650-83ab-4772-ab54-61385e01b1f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:48.923836 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a341650-83ab-4772-ab54-61385e01b1f8 None admin] PATH_INFO: `/v3/groups/c7805c4fc1db4d578b2a0e603b56bf39` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:48.928358 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a341650-83ab-4772-ab54-61385e01b1f8 None admin] RBAC: Authorizing `identity:get_group(group_id=c7805c4fc1db4d578b2a0e603b56bf39)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:48.930126 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a341650-83ab-4772-ab54-61385e01b1f8 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:48.937030 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 196/387] 10.222.0.39 () {56 vars in 1180 bytes} [Thu Jun 16 17:06:48 2022] GET /identity/v3/groups/c7805c4fc1db4d578b2a0e603b56bf39 => generated 226 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:06:48.942786 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a341650-83ab-4772-ab54-61385e01b1f8 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:48.977282 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:49.011942 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e21eabb-04da-4979-ae36-4e89f0df6d06 None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:49.049516 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ed0dc7-e4ca-4821-9052-72b8419a5709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:49.050275 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ed0dc7-e4ca-4821-9052-72b8419a5709 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:49.050662 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ed0dc7-e4ca-4821-9052-72b8419a5709 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:49.050942 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ed0dc7-e4ca-4821-9052-72b8419a5709 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:49.062777 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ed0dc7-e4ca-4821-9052-72b8419a5709 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 17:06:49.073205 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application [None req-a4ed0dc7-e4ca-4821-9052-72b8419a5709 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 17:06:49.073205 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:06:49.073205 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:06:49.073205 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:06:49.073205 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:06:49.073205 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:06:49.073205 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:06:49.073205 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:06:49.073205 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:06:49.073205 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:06:49.073205 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:06:49.073205 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:06:49.073205 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 17:06:49.073205 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 17:06:49.073205 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 17:06:49.073205 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 17:06:49.074149 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 17:06:49.074149 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 17:06:49.074149 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 17:06:49.074149 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 17:06:49.074149 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:06:49.074149 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:06:49.074149 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:06:49.074149 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:06:49.074149 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:06:49.074149 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:06:49.074149 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:06:49.074149 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application with Lock( Jun 16 17:06:49.074149 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:06:49.074149 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:06:49.074149 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:06:49.074149 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:06:49.074956 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:06:49.074956 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:06:49.074956 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:06:49.074956 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:06:49.074956 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 17:06:49.074956 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 17:06:49.074956 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 17:06:49.074956 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 17:06:49.074956 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 17:06:49.074956 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 17:06:49.074956 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 17:06:49.074956 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Jun 16 17:06:49.075572 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 192/388] 10.222.0.39 () {56 vars in 1114 bytes} [Thu Jun 16 17:06:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 17:06:49.080798 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27e4129-a785-49b2-81e4-b16cbd1054ca None None] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:49.080798 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27e4129-a785-49b2-81e4-b16cbd1054ca None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:49.080798 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27e4129-a785-49b2-81e4-b16cbd1054ca None None] PATH_INFO: `/` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:49.080798 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 193/389] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 17:06:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:06:49.086615 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27e4129-a785-49b2-81e4-b16cbd1054ca None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:49.088446 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a341650-83ab-4772-ab54-61385e01b1f8 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:49.134198 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3aade1-ca6c-464d-91f2-bc80c3e13984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:49.135457 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3aade1-ca6c-464d-91f2-bc80c3e13984 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:49.136185 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3aade1-ca6c-464d-91f2-bc80c3e13984 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:49.136672 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3aade1-ca6c-464d-91f2-bc80c3e13984 None admin] PATH_INFO: `/v3/projects/ac5b05cf174a49b0aae4343f1ac0f173` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:49.138998 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3aade1-ca6c-464d-91f2-bc80c3e13984 None admin] RBAC: Authorizing `identity:get_project(project_id=ac5b05cf174a49b0aae4343f1ac0f173)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:49.140634 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3aade1-ca6c-464d-91f2-bc80c3e13984 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:49.143611 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 197/390] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 16 17:06:48 2022] GET /identity/v3/projects/ac5b05cf174a49b0aae4343f1ac0f173 => generated 298 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 17:06:49.145537 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eaee25-7c8f-4837-8ead-4fe77a5078bd None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:49.146069 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eaee25-7c8f-4837-8ead-4fe77a5078bd None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:49.146913 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eaee25-7c8f-4837-8ead-4fe77a5078bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:49.169505 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-75eaee25-7c8f-4837-8ead-4fe77a5078bd None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:06:49.171587 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-75eaee25-7c8f-4837-8ead-4fe77a5078bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:06:49.222418 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27e4129-a785-49b2-81e4-b16cbd1054ca None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:49.233561 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:49.249112 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 198/391] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 17:06:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 17:06:49.249998 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75eaee25-7c8f-4837-8ead-4fe77a5078bd None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:49.270373 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf14a4d-bc88-4476-8022-e88cdbd84f83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:49.271411 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf14a4d-bc88-4476-8022-e88cdbd84f83 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:49.271905 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf14a4d-bc88-4476-8022-e88cdbd84f83 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:49.272858 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf14a4d-bc88-4476-8022-e88cdbd84f83 None admin] PATH_INFO: `/v3/roles` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:49.274119 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf14a4d-bc88-4476-8022-e88cdbd84f83 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80873) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:06:49.274618 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf14a4d-bc88-4476-8022-e88cdbd84f83 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:49.276949 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf14a4d-bc88-4476-8022-e88cdbd84f83 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:49.282183 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:49.289566 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 194/392] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 16 17:06:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:06:49.290638 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf14a4d-bc88-4476-8022-e88cdbd84f83 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:49.377946 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75eaee25-7c8f-4837-8ead-4fe77a5078bd None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:49.400996 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf14a4d-bc88-4476-8022-e88cdbd84f83 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:49.427102 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b2d908-136e-4170-9905-16f1fbe18f3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:49.428791 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b2d908-136e-4170-9905-16f1fbe18f3e None admin] REQUEST_METHOD: `PUT` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:49.429268 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b2d908-136e-4170-9905-16f1fbe18f3e None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:49.432206 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b2d908-136e-4170-9905-16f1fbe18f3e None admin] PATH_INFO: `/v3/projects/ac5b05cf174a49b0aae4343f1ac0f173/groups/c7805c4fc1db4d578b2a0e603b56bf39/roles/896bff49c5d6464eb612a15f4aa9badc` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:49.436484 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b2d908-136e-4170-9905-16f1fbe18f3e None admin] RBAC: Authorizing `identity:create_grant(project_id=ac5b05cf174a49b0aae4343f1ac0f173, group_id=c7805c4fc1db4d578b2a0e603b56bf39, role_id=896bff49c5d6464eb612a15f4aa9badc)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:49.438599 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b2d908-136e-4170-9905-16f1fbe18f3e None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:49.450334 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfb41ee-39c4-4e81-af79-e00a4325c45c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:49.450334 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfb41ee-39c4-4e81-af79-e00a4325c45c None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:49.450334 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfb41ee-39c4-4e81-af79-e00a4325c45c None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:49.450334 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfb41ee-39c4-4e81-af79-e00a4325c45c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:49.465430 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfb41ee-39c4-4e81-af79-e00a4325c45c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 17:06:49.474912 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application [None req-fdfb41ee-39c4-4e81-af79-e00a4325c45c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 17:06:49.474912 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:06:49.474912 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:06:49.474912 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:06:49.474912 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:06:49.474912 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:06:49.474912 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:06:49.474912 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:06:49.474912 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:06:49.474912 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:06:49.474912 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:06:49.474912 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:06:49.474912 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 17:06:49.474912 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 17:06:49.474912 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 17:06:49.474912 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 17:06:49.475770 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 17:06:49.475770 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 17:06:49.475770 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 17:06:49.475770 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 17:06:49.475770 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:06:49.475770 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:06:49.475770 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:06:49.475770 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:06:49.475770 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:06:49.475770 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:06:49.475770 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:06:49.475770 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application with Lock( Jun 16 17:06:49.475770 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:06:49.475770 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:06:49.475770 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:06:49.475770 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:06:49.476864 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:06:49.476864 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:06:49.476864 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:06:49.476864 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:06:49.476864 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 17:06:49.476864 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 17:06:49.476864 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 17:06:49.476864 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 17:06:49.476864 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 17:06:49.476864 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 17:06:49.476864 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 17:06:49.476864 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Jun 16 17:06:49.476864 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 195/393] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 16 17:06:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:06:49.476864 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfb41ee-39c4-4e81-af79-e00a4325c45c None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:49.509144 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:49.537811 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 199/394] 10.222.0.39 () {58 vars in 1442 bytes} [Thu Jun 16 17:06:49 2022] PUT /identity/v3/projects/ac5b05cf174a49b0aae4343f1ac0f173/groups/c7805c4fc1db4d578b2a0e603b56bf39/roles/896bff49c5d6464eb612a15f4aa9badc => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:06:49.537811 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b2d908-136e-4170-9905-16f1fbe18f3e None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:49.646498 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfb41ee-39c4-4e81-af79-e00a4325c45c None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:49.678600 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:49.722368 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326f97a1-508f-44a2-84de-40dba23f83a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:49.723670 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326f97a1-508f-44a2-84de-40dba23f83a4 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:49.725453 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326f97a1-508f-44a2-84de-40dba23f83a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:49.725944 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326f97a1-508f-44a2-84de-40dba23f83a4 None admin] PATH_INFO: `/v3/groups/c7805c4fc1db4d578b2a0e603b56bf39` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:49.727707 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326f97a1-508f-44a2-84de-40dba23f83a4 None admin] RBAC: Authorizing `identity:get_group(group_id=c7805c4fc1db4d578b2a0e603b56bf39)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:49.729331 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326f97a1-508f-44a2-84de-40dba23f83a4 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:49.731557 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 196/395] 10.222.0.39 () {56 vars in 1180 bytes} [Thu Jun 16 17:06:49 2022] GET /identity/v3/groups/c7805c4fc1db4d578b2a0e603b56bf39 => generated 226 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:06:49.737363 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326f97a1-508f-44a2-84de-40dba23f83a4 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:49.755995 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b2d908-136e-4170-9905-16f1fbe18f3e None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:49.824912 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c53e6f-fbb7-4436-a8b7-d8b247b5b681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:49.825906 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c53e6f-fbb7-4436-a8b7-d8b247b5b681 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:49.826370 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c53e6f-fbb7-4436-a8b7-d8b247b5b681 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:49.826804 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c53e6f-fbb7-4436-a8b7-d8b247b5b681 None admin] PATH_INFO: `/v3/roles` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:49.827726 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c53e6f-fbb7-4436-a8b7-d8b247b5b681 None admin] RBAC: Adding query filter params (name=member) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:06:49.828195 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c53e6f-fbb7-4436-a8b7-d8b247b5b681 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:49.829858 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c53e6f-fbb7-4436-a8b7-d8b247b5b681 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:49.840264 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 200/396] 10.222.0.39 () {56 vars in 1101 bytes} [Thu Jun 16 17:06:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:06:49.846533 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c53e6f-fbb7-4436-a8b7-d8b247b5b681 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:49.855157 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:49.861929 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326f97a1-508f-44a2-84de-40dba23f83a4 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:49.912414 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972be439-d0a5-40dd-a1ad-7cf366f993c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:49.913348 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972be439-d0a5-40dd-a1ad-7cf366f993c1 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:49.913739 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972be439-d0a5-40dd-a1ad-7cf366f993c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:49.914146 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972be439-d0a5-40dd-a1ad-7cf366f993c1 None admin] PATH_INFO: `/v3/projects/ac5b05cf174a49b0aae4343f1ac0f173` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:49.915663 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972be439-d0a5-40dd-a1ad-7cf366f993c1 None admin] RBAC: Authorizing `identity:get_project(project_id=ac5b05cf174a49b0aae4343f1ac0f173)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:49.917204 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972be439-d0a5-40dd-a1ad-7cf366f993c1 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:49.919658 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 197/397] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 16 17:06:49 2022] GET /identity/v3/projects/ac5b05cf174a49b0aae4343f1ac0f173 => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 17:06:49.921929 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c0818d-b63b-4938-8fc8-f718df71449b None None] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:49.922292 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c0818d-b63b-4938-8fc8-f718df71449b None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:49.922631 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c0818d-b63b-4938-8fc8-f718df71449b None None] PATH_INFO: `/` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:49.924193 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 198/398] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 17:06:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:06:49.928275 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c0818d-b63b-4938-8fc8-f718df71449b None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:49.962447 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c53e6f-fbb7-4436-a8b7-d8b247b5b681 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:50.000431 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa3a325-e67a-4df0-9373-ad6987daeaf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:50.001406 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa3a325-e67a-4df0-9373-ad6987daeaf2 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:50.001695 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa3a325-e67a-4df0-9373-ad6987daeaf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:50.002059 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa3a325-e67a-4df0-9373-ad6987daeaf2 None admin] PATH_INFO: `/v3/groups/c7805c4fc1db4d578b2a0e603b56bf39` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:50.003343 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa3a325-e67a-4df0-9373-ad6987daeaf2 None admin] RBAC: Authorizing `identity:get_group(group_id=c7805c4fc1db4d578b2a0e603b56bf39)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:50.004801 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa3a325-e67a-4df0-9373-ad6987daeaf2 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:50.007061 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 201/399] 10.222.0.39 () {56 vars in 1180 bytes} [Thu Jun 16 17:06:49 2022] GET /identity/v3/groups/c7805c4fc1db4d578b2a0e603b56bf39 => generated 226 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 17:06:50.008322 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52002862-5b7e-4edc-a3a0-3ff1169a03ef None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:50.008616 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52002862-5b7e-4edc-a3a0-3ff1169a03ef None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:50.008894 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52002862-5b7e-4edc-a3a0-3ff1169a03ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:50.016520 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:50.031429 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-52002862-5b7e-4edc-a3a0-3ff1169a03ef None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:06:50.033047 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-52002862-5b7e-4edc-a3a0-3ff1169a03ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:06:50.060172 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c0818d-b63b-4938-8fc8-f718df71449b None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:50.106626 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349d0996-6f2c-4362-b341-02c13d9b5a73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:50.107766 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349d0996-6f2c-4362-b341-02c13d9b5a73 None admin] REQUEST_METHOD: `PUT` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:50.108576 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349d0996-6f2c-4362-b341-02c13d9b5a73 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:50.109053 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349d0996-6f2c-4362-b341-02c13d9b5a73 None admin] PATH_INFO: `/v3/projects/ac5b05cf174a49b0aae4343f1ac0f173/groups/c7805c4fc1db4d578b2a0e603b56bf39/roles/9331b396c9894ab88267e7b82ef6f224` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:50.112082 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349d0996-6f2c-4362-b341-02c13d9b5a73 None admin] RBAC: Authorizing `identity:create_grant(project_id=ac5b05cf174a49b0aae4343f1ac0f173, group_id=c7805c4fc1db4d578b2a0e603b56bf39, role_id=9331b396c9894ab88267e7b82ef6f224)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:50.113707 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349d0996-6f2c-4362-b341-02c13d9b5a73 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:50.122082 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 202/400] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 17:06:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 17:06:50.122851 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52002862-5b7e-4edc-a3a0-3ff1169a03ef None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:50.192040 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 199/401] 10.222.0.39 () {58 vars in 1442 bytes} [Thu Jun 16 17:06:49 2022] PUT /identity/v3/projects/ac5b05cf174a49b0aae4343f1ac0f173/groups/c7805c4fc1db4d578b2a0e603b56bf39/roles/9331b396c9894ab88267e7b82ef6f224 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:06:50.192905 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349d0996-6f2c-4362-b341-02c13d9b5a73 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:50.232466 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:50.279955 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52002862-5b7e-4edc-a3a0-3ff1169a03ef None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:50.314695 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:50.321356 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7126d0ef-8374-408e-b4f8-5a1393b288fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:50.321817 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7126d0ef-8374-408e-b4f8-5a1393b288fc None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:50.322101 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7126d0ef-8374-408e-b4f8-5a1393b288fc None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:50.322385 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7126d0ef-8374-408e-b4f8-5a1393b288fc None admin] PATH_INFO: `/v3/projects/d38e49d57050488484d9f03fdb7552ee` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:50.323723 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7126d0ef-8374-408e-b4f8-5a1393b288fc None admin] RBAC: Authorizing `identity:get_project(project_id=d38e49d57050488484d9f03fdb7552ee)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:50.325201 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7126d0ef-8374-408e-b4f8-5a1393b288fc None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:50.332608 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 203/402] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 16 17:06:50 2022] GET /identity/v3/projects/d38e49d57050488484d9f03fdb7552ee => generated 302 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:06:50.332608 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e14054-a224-4bf9-8ab0-ecb3b6479057 None None] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:50.332608 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e14054-a224-4bf9-8ab0-ecb3b6479057 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:50.332608 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e14054-a224-4bf9-8ab0-ecb3b6479057 None None] PATH_INFO: `/` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:50.332608 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 204/403] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 17:06:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:06:50.337557 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62379fb3-215e-4825-b642-19be1ae3c75c None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:50.337898 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62379fb3-215e-4825-b642-19be1ae3c75c None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:50.338185 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62379fb3-215e-4825-b642-19be1ae3c75c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:50.345357 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349d0996-6f2c-4362-b341-02c13d9b5a73 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:50.356442 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-62379fb3-215e-4825-b642-19be1ae3c75c None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:06:50.357670 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-62379fb3-215e-4825-b642-19be1ae3c75c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:06:50.384994 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04aaed7-8cb3-42b3-8d2b-a48c3fd75cec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:50.385916 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04aaed7-8cb3-42b3-8d2b-a48c3fd75cec None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:50.386211 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04aaed7-8cb3-42b3-8d2b-a48c3fd75cec None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:50.386676 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04aaed7-8cb3-42b3-8d2b-a48c3fd75cec None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:50.402317 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04aaed7-8cb3-42b3-8d2b-a48c3fd75cec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 17:06:50.415323 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application [None req-a04aaed7-8cb3-42b3-8d2b-a48c3fd75cec None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 17:06:50.415323 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:06:50.415323 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:06:50.415323 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:06:50.415323 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:06:50.415323 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:06:50.415323 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:06:50.415323 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:06:50.415323 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:06:50.415323 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:06:50.415323 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:06:50.415323 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:06:50.415323 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 17:06:50.415323 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 17:06:50.415323 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 17:06:50.415323 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 17:06:50.416321 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 17:06:50.416321 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 17:06:50.416321 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 17:06:50.416321 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 17:06:50.416321 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:06:50.416321 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:06:50.416321 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:06:50.416321 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:06:50.416321 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:06:50.416321 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:06:50.416321 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:06:50.416321 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application with Lock( Jun 16 17:06:50.416321 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:06:50.416321 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:06:50.416321 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:06:50.416321 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:06:50.417133 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:06:50.417133 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:06:50.417133 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:06:50.417133 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:06:50.417133 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 17:06:50.417133 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 17:06:50.417133 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 17:06:50.417133 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 17:06:50.417133 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 17:06:50.417133 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 17:06:50.417133 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 17:06:50.417133 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Jun 16 17:06:50.417133 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 200/404] 10.222.0.39 () {56 vars in 1114 bytes} [Thu Jun 16 17:06:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:06:50.423265 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04aaed7-8cb3-42b3-8d2b-a48c3fd75cec None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:50.457165 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 205/405] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 17:06:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 17:06:50.458435 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62379fb3-215e-4825-b642-19be1ae3c75c None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:50.543032 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:50.566843 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04aaed7-8cb3-42b3-8d2b-a48c3fd75cec None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:50.579170 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62379fb3-215e-4825-b642-19be1ae3c75c None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:50.606382 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ff98b4-ff24-4a82-a11e-5c9e7626c9df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:50.607198 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ff98b4-ff24-4a82-a11e-5c9e7626c9df None admin] REQUEST_METHOD: `PUT` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:50.607487 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ff98b4-ff24-4a82-a11e-5c9e7626c9df None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:50.607804 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ff98b4-ff24-4a82-a11e-5c9e7626c9df None admin] PATH_INFO: `/v3/projects/d38e49d57050488484d9f03fdb7552ee/groups/c7805c4fc1db4d578b2a0e603b56bf39/roles/896bff49c5d6464eb612a15f4aa9badc` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:50.610046 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ff98b4-ff24-4a82-a11e-5c9e7626c9df None admin] RBAC: Authorizing `identity:create_grant(project_id=d38e49d57050488484d9f03fdb7552ee, group_id=c7805c4fc1db4d578b2a0e603b56bf39, role_id=896bff49c5d6464eb612a15f4aa9badc)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:50.611502 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ff98b4-ff24-4a82-a11e-5c9e7626c9df None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:50.612613 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:50.618777 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91f2b1a-fd56-4051-88fd-92c022e1334c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:50.625404 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91f2b1a-fd56-4051-88fd-92c022e1334c None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:50.625404 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91f2b1a-fd56-4051-88fd-92c022e1334c None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:50.625404 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91f2b1a-fd56-4051-88fd-92c022e1334c None admin] PATH_INFO: `/v3/roles` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:50.625404 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91f2b1a-fd56-4051-88fd-92c022e1334c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:06:50.625404 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91f2b1a-fd56-4051-88fd-92c022e1334c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:50.625404 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91f2b1a-fd56-4051-88fd-92c022e1334c None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:50.631427 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 206/406] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 16 17:06:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:06:50.632007 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91f2b1a-fd56-4051-88fd-92c022e1334c None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:50.722064 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 201/407] 10.222.0.39 () {58 vars in 1442 bytes} [Thu Jun 16 17:06:50 2022] PUT /identity/v3/projects/d38e49d57050488484d9f03fdb7552ee/groups/c7805c4fc1db4d578b2a0e603b56bf39/roles/896bff49c5d6464eb612a15f4aa9badc => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:06:50.723591 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ff98b4-ff24-4a82-a11e-5c9e7626c9df None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:50.759057 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91f2b1a-fd56-4051-88fd-92c022e1334c None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:50.836452 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17df743b-5dee-4a78-a721-72a1d574db75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:50.837389 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17df743b-5dee-4a78-a721-72a1d574db75 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:50.837683 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17df743b-5dee-4a78-a721-72a1d574db75 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:50.838007 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17df743b-5dee-4a78-a721-72a1d574db75 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:50.852364 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17df743b-5dee-4a78-a721-72a1d574db75 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 17:06:50.863766 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ff98b4-ff24-4a82-a11e-5c9e7626c9df None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:50.869302 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application [None req-17df743b-5dee-4a78-a721-72a1d574db75 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 17:06:50.869302 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:06:50.869302 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:06:50.869302 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:06:50.869302 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:06:50.869302 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:06:50.869302 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:06:50.869302 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:06:50.869302 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:06:50.869302 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:06:50.869302 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:06:50.869302 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:06:50.869302 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 17:06:50.869302 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 17:06:50.869302 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 17:06:50.869302 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 17:06:50.870303 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 17:06:50.870303 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 17:06:50.870303 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 17:06:50.870303 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 17:06:50.870303 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:06:50.870303 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:06:50.870303 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:06:50.870303 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:06:50.870303 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:06:50.870303 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:06:50.870303 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:06:50.870303 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application with Lock( Jun 16 17:06:50.870303 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:06:50.870303 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:06:50.870303 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:06:50.870303 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:06:50.871685 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:06:50.871685 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:06:50.871685 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:06:50.871685 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:06:50.871685 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 17:06:50.871685 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 17:06:50.871685 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 17:06:50.871685 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 17:06:50.871685 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 17:06:50.871685 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 17:06:50.871685 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 17:06:50.871685 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Jun 16 17:06:50.871685 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 207/408] 10.222.0.39 () {56 vars in 1096 bytes} [Thu Jun 16 17:06:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:06:50.876560 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17df743b-5dee-4a78-a721-72a1d574db75 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:50.918308 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50e1911-90d2-4482-8e1c-59fb993e79f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:50.919628 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50e1911-90d2-4482-8e1c-59fb993e79f7 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:50.920182 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50e1911-90d2-4482-8e1c-59fb993e79f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:50.921195 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50e1911-90d2-4482-8e1c-59fb993e79f7 None admin] PATH_INFO: `/v3/groups/c7805c4fc1db4d578b2a0e603b56bf39` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:50.923196 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50e1911-90d2-4482-8e1c-59fb993e79f7 None admin] RBAC: Authorizing `identity:get_group(group_id=c7805c4fc1db4d578b2a0e603b56bf39)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:50.924851 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50e1911-90d2-4482-8e1c-59fb993e79f7 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:50.927044 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 202/409] 10.222.0.39 () {56 vars in 1180 bytes} [Thu Jun 16 17:06:50 2022] GET /identity/v3/groups/c7805c4fc1db4d578b2a0e603b56bf39 => generated 226 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:06:50.932471 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50e1911-90d2-4482-8e1c-59fb993e79f7 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:50.948910 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:50.951384 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:51.006340 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17df743b-5dee-4a78-a721-72a1d574db75 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:51.044020 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972057ff-9973-4071-a21e-17fdab66d088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:51.044749 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972057ff-9973-4071-a21e-17fdab66d088 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:51.045235 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50e1911-90d2-4482-8e1c-59fb993e79f7 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:51.045397 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972057ff-9973-4071-a21e-17fdab66d088 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:51.045608 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972057ff-9973-4071-a21e-17fdab66d088 None admin] PATH_INFO: `/v3/roles` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:51.046399 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972057ff-9973-4071-a21e-17fdab66d088 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:06:51.046714 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972057ff-9973-4071-a21e-17fdab66d088 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:51.048101 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972057ff-9973-4071-a21e-17fdab66d088 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:51.057651 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 208/410] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 16 17:06:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:06:51.065785 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972057ff-9973-4071-a21e-17fdab66d088 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:51.130492 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aeb7b96-7d60-46c7-a35d-abda820d39fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:51.131619 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeb7b96-7d60-46c7-a35d-abda820d39fc None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:51.132060 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeb7b96-7d60-46c7-a35d-abda820d39fc None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:51.132522 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeb7b96-7d60-46c7-a35d-abda820d39fc None admin] PATH_INFO: `/v3/projects/d38e49d57050488484d9f03fdb7552ee` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:51.138521 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aeb7b96-7d60-46c7-a35d-abda820d39fc None admin] RBAC: Authorizing `identity:get_project(project_id=d38e49d57050488484d9f03fdb7552ee)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:51.140171 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aeb7b96-7d60-46c7-a35d-abda820d39fc None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:51.142114 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 203/411] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 16 17:06:50 2022] GET /identity/v3/projects/d38e49d57050488484d9f03fdb7552ee => generated 302 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 17:06:51.147803 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aeb7b96-7d60-46c7-a35d-abda820d39fc None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:51.182769 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972057ff-9973-4071-a21e-17fdab66d088 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:51.202181 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:51.226447 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9f514c-3fcd-4204-b257-fa049ba039f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:51.227937 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9f514c-3fcd-4204-b257-fa049ba039f7 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:51.228428 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9f514c-3fcd-4204-b257-fa049ba039f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:51.228947 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9f514c-3fcd-4204-b257-fa049ba039f7 None admin] PATH_INFO: `/v3/groups/93fa516d6693407d813d52f4b9d3d1fe` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:51.230573 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9f514c-3fcd-4204-b257-fa049ba039f7 None admin] RBAC: Authorizing `identity:get_group(group_id=93fa516d6693407d813d52f4b9d3d1fe)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:51.232313 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9f514c-3fcd-4204-b257-fa049ba039f7 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:51.235564 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 209/412] 10.222.0.39 () {56 vars in 1180 bytes} [Thu Jun 16 17:06:51 2022] GET /identity/v3/groups/93fa516d6693407d813d52f4b9d3d1fe => generated 229 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:06:51.240746 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9f514c-3fcd-4204-b257-fa049ba039f7 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:51.362235 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9f514c-3fcd-4204-b257-fa049ba039f7 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:51.368543 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:51.402137 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffbe745-5987-4061-875d-349f86b1faee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:51.403791 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffbe745-5987-4061-875d-349f86b1faee None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:51.404302 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffbe745-5987-4061-875d-349f86b1faee None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:51.405315 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffbe745-5987-4061-875d-349f86b1faee None admin] PATH_INFO: `/v3/projects/63375056d675488ab27a6e1a845c0237` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:51.406951 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffbe745-5987-4061-875d-349f86b1faee None admin] RBAC: Authorizing `identity:get_project(project_id=63375056d675488ab27a6e1a845c0237)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:51.408792 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffbe745-5987-4061-875d-349f86b1faee None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:51.411845 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 210/413] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 16 17:06:51 2022] GET /identity/v3/projects/63375056d675488ab27a6e1a845c0237 => generated 344 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:06:51.417896 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffbe745-5987-4061-875d-349f86b1faee None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:51.426851 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aeb7b96-7d60-46c7-a35d-abda820d39fc None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:51.511222 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43663eec-037d-4c9a-8f89-88b5fc96029b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:51.512260 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43663eec-037d-4c9a-8f89-88b5fc96029b None admin] REQUEST_METHOD: `PUT` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:51.512610 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43663eec-037d-4c9a-8f89-88b5fc96029b None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:51.512963 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43663eec-037d-4c9a-8f89-88b5fc96029b None admin] PATH_INFO: `/v3/projects/d38e49d57050488484d9f03fdb7552ee/groups/c7805c4fc1db4d578b2a0e603b56bf39/roles/9331b396c9894ab88267e7b82ef6f224` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:51.513148 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:51.522709 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43663eec-037d-4c9a-8f89-88b5fc96029b None admin] RBAC: Authorizing `identity:create_grant(project_id=d38e49d57050488484d9f03fdb7552ee, group_id=c7805c4fc1db4d578b2a0e603b56bf39, role_id=9331b396c9894ab88267e7b82ef6f224)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:51.524859 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43663eec-037d-4c9a-8f89-88b5fc96029b None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:51.558460 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffbe745-5987-4061-875d-349f86b1faee None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:51.598648 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc03c41a-903f-4bd7-81c5-bade1a618f15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:51.599929 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc03c41a-903f-4bd7-81c5-bade1a618f15 None admin] REQUEST_METHOD: `PUT` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:51.600405 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc03c41a-903f-4bd7-81c5-bade1a618f15 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:51.600897 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc03c41a-903f-4bd7-81c5-bade1a618f15 None admin] PATH_INFO: `/v3/projects/63375056d675488ab27a6e1a845c0237/groups/93fa516d6693407d813d52f4b9d3d1fe/roles/dba744f8ab2a4c45b9d3212f8d203aba` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:51.603551 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc03c41a-903f-4bd7-81c5-bade1a618f15 None admin] RBAC: Authorizing `identity:create_grant(project_id=63375056d675488ab27a6e1a845c0237, group_id=93fa516d6693407d813d52f4b9d3d1fe, role_id=dba744f8ab2a4c45b9d3212f8d203aba)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:51.605252 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc03c41a-903f-4bd7-81c5-bade1a618f15 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:51.645928 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 204/414] 10.222.0.39 () {58 vars in 1442 bytes} [Thu Jun 16 17:06:51 2022] PUT /identity/v3/projects/d38e49d57050488484d9f03fdb7552ee/groups/c7805c4fc1db4d578b2a0e603b56bf39/roles/9331b396c9894ab88267e7b82ef6f224 => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 17:06:51.738126 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 211/415] 10.222.0.39 () {58 vars in 1442 bytes} [Thu Jun 16 17:06:51 2022] PUT /identity/v3/projects/63375056d675488ab27a6e1a845c0237/groups/93fa516d6693407d813d52f4b9d3d1fe/roles/dba744f8ab2a4c45b9d3212f8d203aba => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 17:06:52.137455 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d54e3d-a7b6-4e50-8036-fc9f0badc6c4 None None] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:52.137851 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d54e3d-a7b6-4e50-8036-fc9f0badc6c4 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:52.138064 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d54e3d-a7b6-4e50-8036-fc9f0badc6c4 None None] PATH_INFO: `/` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:52.139808 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 205/416] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 17:06:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:06:52.145434 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95f5636-1794-49e2-b4bd-c32fb5d21613 None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:52.145737 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95f5636-1794-49e2-b4bd-c32fb5d21613 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:52.146047 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95f5636-1794-49e2-b4bd-c32fb5d21613 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:52.165555 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-f95f5636-1794-49e2-b4bd-c32fb5d21613 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:06:52.166794 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-f95f5636-1794-49e2-b4bd-c32fb5d21613 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:06:52.257783 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 212/417] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 17:06:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 17:06:52.286722 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d54e3d-a7b6-4e50-8036-fc9f0badc6c4 None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:52.431540 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d54e3d-a7b6-4e50-8036-fc9f0badc6c4 None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:52.470055 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b5490d-f605-4f41-98af-895d35302e41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:52.470864 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b5490d-f605-4f41-98af-895d35302e41 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:52.471154 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b5490d-f605-4f41-98af-895d35302e41 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:52.471436 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b5490d-f605-4f41-98af-895d35302e41 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:52.479746 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:52.482618 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b5490d-f605-4f41-98af-895d35302e41 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 17:06:52.491558 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application [None req-96b5490d-f605-4f41-98af-895d35302e41 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 17:06:52.491558 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:06:52.491558 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:06:52.491558 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:06:52.491558 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:06:52.491558 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:06:52.491558 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:06:52.491558 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:06:52.491558 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:06:52.491558 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:06:52.491558 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:06:52.491558 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:06:52.491558 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 17:06:52.491558 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 17:06:52.491558 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 17:06:52.491558 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 17:06:52.497064 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 17:06:52.497064 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 17:06:52.497064 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 17:06:52.497064 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 17:06:52.497064 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:06:52.497064 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:06:52.497064 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:06:52.497064 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:06:52.497064 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:06:52.497064 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:06:52.497064 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:06:52.497064 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application with Lock( Jun 16 17:06:52.497064 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:06:52.497064 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:06:52.497064 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:06:52.497064 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:06:52.497903 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:06:52.497903 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:06:52.497903 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:06:52.497903 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:06:52.497903 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 17:06:52.497903 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 17:06:52.497903 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 17:06:52.497903 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 17:06:52.497903 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 17:06:52.497903 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 17:06:52.497903 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 17:06:52.497903 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Jun 16 17:06:52.497903 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 206/418] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 16 17:06:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:06:52.499561 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95f5636-1794-49e2-b4bd-c32fb5d21613 None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:52.557466 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:52.638193 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95f5636-1794-49e2-b4bd-c32fb5d21613 None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:52.690359 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28676f13-6877-408f-bb4a-d9e0e52bf8dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:52.691012 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28676f13-6877-408f-bb4a-d9e0e52bf8dc None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:52.691308 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28676f13-6877-408f-bb4a-d9e0e52bf8dc None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:52.691591 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28676f13-6877-408f-bb4a-d9e0e52bf8dc None admin] PATH_INFO: `/v3/roles` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:52.692362 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28676f13-6877-408f-bb4a-d9e0e52bf8dc None admin] RBAC: Adding query filter params (name=member) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:06:52.692679 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28676f13-6877-408f-bb4a-d9e0e52bf8dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:52.694091 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28676f13-6877-408f-bb4a-d9e0e52bf8dc None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:52.703554 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 213/419] 10.222.0.39 () {56 vars in 1101 bytes} [Thu Jun 16 17:06:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:06:52.709219 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b5490d-f605-4f41-98af-895d35302e41 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:52.739064 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c353ade-2c25-41aa-b6ea-10fc7045fe73 None None] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:52.739408 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c353ade-2c25-41aa-b6ea-10fc7045fe73 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:52.739638 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c353ade-2c25-41aa-b6ea-10fc7045fe73 None None] PATH_INFO: `/` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:52.741313 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 214/420] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 17:06:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 17:06:52.746442 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b3ee71-272b-473c-80c1-b0e7adc90d9b None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:52.746739 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b3ee71-272b-473c-80c1-b0e7adc90d9b None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:52.747021 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b3ee71-272b-473c-80c1-b0e7adc90d9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:52.775261 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-c7b3ee71-272b-473c-80c1-b0e7adc90d9b None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:06:52.776465 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-c7b3ee71-272b-473c-80c1-b0e7adc90d9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:06:52.865884 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 215/421] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 17:06:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 17:06:52.887588 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b3ee71-272b-473c-80c1-b0e7adc90d9b None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:52.918647 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b5490d-f605-4f41-98af-895d35302e41 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:52.941862 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:52.982030 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c2f562-d17e-42f1-859d-94f55c7e57b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:52.983311 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c2f562-d17e-42f1-859d-94f55c7e57b2 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:52.983601 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c2f562-d17e-42f1-859d-94f55c7e57b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:52.983882 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c2f562-d17e-42f1-859d-94f55c7e57b2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:53.075288 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b3ee71-272b-473c-80c1-b0e7adc90d9b None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:53.115789 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:53.117434 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c2f562-d17e-42f1-859d-94f55c7e57b2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:53.118958 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c2f562-d17e-42f1-859d-94f55c7e57b2 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:53.165605 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35192c20-a2e8-4e6f-a7a2-2f2ec42be91f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:53.166499 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35192c20-a2e8-4e6f-a7a2-2f2ec42be91f None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:53.166788 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35192c20-a2e8-4e6f-a7a2-2f2ec42be91f None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:53.167071 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35192c20-a2e8-4e6f-a7a2-2f2ec42be91f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:53.195870 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35192c20-a2e8-4e6f-a7a2-2f2ec42be91f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 17:06:53.212333 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application [None req-35192c20-a2e8-4e6f-a7a2-2f2ec42be91f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 17:06:53.212333 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:06:53.212333 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:06:53.212333 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:06:53.212333 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:06:53.212333 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:06:53.212333 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:06:53.212333 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:06:53.212333 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:06:53.212333 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:06:53.212333 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:06:53.212333 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:06:53.212333 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 17:06:53.212333 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 17:06:53.212333 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 17:06:53.212333 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 17:06:53.213378 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 17:06:53.213378 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 17:06:53.213378 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 17:06:53.213378 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 17:06:53.213378 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:06:53.213378 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:06:53.213378 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:06:53.213378 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:06:53.213378 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:06:53.213378 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:06:53.213378 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:06:53.213378 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application with Lock( Jun 16 17:06:53.213378 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:06:53.213378 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:06:53.213378 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:06:53.213378 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:06:53.214209 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:06:53.214209 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:06:53.214209 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:06:53.214209 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:06:53.214209 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 17:06:53.214209 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 17:06:53.214209 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 17:06:53.214209 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 17:06:53.214209 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 17:06:53.214209 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 17:06:53.214209 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 17:06:53.214209 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Jun 16 17:06:53.222218 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 216/422] 10.222.0.39 () {56 vars in 1114 bytes} [Thu Jun 16 17:06:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 335 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:06:53.232035 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35192c20-a2e8-4e6f-a7a2-2f2ec42be91f None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:53.244222 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 207/423] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 16 17:06:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 535 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 17:06:53.245557 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b295fa5-af81-46f9-a776-3cb3702b5346 None None] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:53.245887 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b295fa5-af81-46f9-a776-3cb3702b5346 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:53.246233 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b295fa5-af81-46f9-a776-3cb3702b5346 None None] PATH_INFO: `/` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:53.247771 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 208/424] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 17:06:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:06:53.251694 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b295fa5-af81-46f9-a776-3cb3702b5346 None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:53.354743 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:53.358243 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:53.359182 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b295fa5-af81-46f9-a776-3cb3702b5346 None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:53.362078 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35192c20-a2e8-4e6f-a7a2-2f2ec42be91f None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:53.394468 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec79e84-a7bc-4332-a827-06ae1ed50408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:53.395338 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec79e84-a7bc-4332-a827-06ae1ed50408 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:53.395625 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec79e84-a7bc-4332-a827-06ae1ed50408 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:53.395914 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec79e84-a7bc-4332-a827-06ae1ed50408 None admin] PATH_INFO: `/v3/projects/ac5b05cf174a49b0aae4343f1ac0f173` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:53.397174 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec79e84-a7bc-4332-a827-06ae1ed50408 None admin] RBAC: Authorizing `identity:get_project(project_id=ac5b05cf174a49b0aae4343f1ac0f173)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:53.398641 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec79e84-a7bc-4332-a827-06ae1ed50408 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:53.399954 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93226ab-d9b6-4a9b-9564-d2d276913859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:53.405053 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 209/425] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 16 17:06:53 2022] GET /identity/v3/projects/ac5b05cf174a49b0aae4343f1ac0f173 => generated 298 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:06:53.405053 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e948a5db-d7b0-4d5e-be2b-b9691a0b8dab None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:53.405053 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e948a5db-d7b0-4d5e-be2b-b9691a0b8dab None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:53.405053 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e948a5db-d7b0-4d5e-be2b-b9691a0b8dab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:53.406367 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93226ab-d9b6-4a9b-9564-d2d276913859 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:53.406367 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93226ab-d9b6-4a9b-9564-d2d276913859 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:53.406367 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93226ab-d9b6-4a9b-9564-d2d276913859 None admin] PATH_INFO: `/v3/roles` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:53.407466 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93226ab-d9b6-4a9b-9564-d2d276913859 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:06:53.408071 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93226ab-d9b6-4a9b-9564-d2d276913859 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:53.409754 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93226ab-d9b6-4a9b-9564-d2d276913859 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:53.419702 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-e948a5db-d7b0-4d5e-be2b-b9691a0b8dab None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:06:53.420486 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 217/426] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 16 17:06:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 17:06:53.421611 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93226ab-d9b6-4a9b-9564-d2d276913859 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:53.426121 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-e948a5db-d7b0-4d5e-be2b-b9691a0b8dab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:06:53.509863 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 210/427] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 17:06:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 17:06:53.509863 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e948a5db-d7b0-4d5e-be2b-b9691a0b8dab None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:53.568554 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93226ab-d9b6-4a9b-9564-d2d276913859 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:53.607092 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:53.611781 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e948a5db-d7b0-4d5e-be2b-b9691a0b8dab None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:53.617737 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dd29c3-5df0-47f1-8f6b-f2141f4172fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:53.618629 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dd29c3-5df0-47f1-8f6b-f2141f4172fa None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:53.623870 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dd29c3-5df0-47f1-8f6b-f2141f4172fa None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:53.623870 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dd29c3-5df0-47f1-8f6b-f2141f4172fa None admin] PATH_INFO: `/v3/groups/c7805c4fc1db4d578b2a0e603b56bf39` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:53.623870 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dd29c3-5df0-47f1-8f6b-f2141f4172fa None admin] RBAC: Authorizing `identity:get_group(group_id=c7805c4fc1db4d578b2a0e603b56bf39)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:53.623870 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dd29c3-5df0-47f1-8f6b-f2141f4172fa None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:53.625315 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 218/428] 10.222.0.39 () {56 vars in 1180 bytes} [Thu Jun 16 17:06:53 2022] GET /identity/v3/groups/c7805c4fc1db4d578b2a0e603b56bf39 => generated 226 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:06:53.626404 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dd29c3-5df0-47f1-8f6b-f2141f4172fa None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:53.657559 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:53.658402 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc75a5aa-5ce3-47f9-9b29-ca37f78998a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:53.659208 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc75a5aa-5ce3-47f9-9b29-ca37f78998a0 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:53.659857 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc75a5aa-5ce3-47f9-9b29-ca37f78998a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:53.660136 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc75a5aa-5ce3-47f9-9b29-ca37f78998a0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:53.740071 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dd29c3-5df0-47f1-8f6b-f2141f4172fa None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:53.753898 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc75a5aa-5ce3-47f9-9b29-ca37f78998a0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:53.755621 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc75a5aa-5ce3-47f9-9b29-ca37f78998a0 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:53.778403 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c7664b-2ea6-4a03-b75d-e9c819cd8f48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:53.779348 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c7664b-2ea6-4a03-b75d-e9c819cd8f48 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:53.779838 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c7664b-2ea6-4a03-b75d-e9c819cd8f48 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:53.780440 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c7664b-2ea6-4a03-b75d-e9c819cd8f48 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:53.791785 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c7664b-2ea6-4a03-b75d-e9c819cd8f48 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 17:06:53.799932 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application [None req-e6c7664b-2ea6-4a03-b75d-e9c819cd8f48 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 17:06:53.799932 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:06:53.799932 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:06:53.799932 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:06:53.799932 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:06:53.799932 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:06:53.799932 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:06:53.799932 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:06:53.799932 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:06:53.799932 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:06:53.799932 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:06:53.799932 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:06:53.799932 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 17:06:53.799932 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 17:06:53.799932 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 17:06:53.799932 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 17:06:53.801416 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 17:06:53.801416 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 17:06:53.801416 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 17:06:53.801416 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 17:06:53.801416 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:06:53.801416 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:06:53.801416 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:06:53.801416 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:06:53.801416 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:06:53.801416 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:06:53.801416 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:06:53.801416 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application with Lock( Jun 16 17:06:53.801416 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:06:53.801416 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:06:53.801416 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:06:53.801416 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:06:53.803293 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:06:53.803293 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:06:53.803293 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:06:53.803293 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:06:53.803293 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 17:06:53.803293 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 17:06:53.803293 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 17:06:53.803293 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 17:06:53.803293 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 17:06:53.803293 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 17:06:53.803293 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 17:06:53.803293 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Jun 16 17:06:53.804791 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 219/429] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 16 17:06:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:06:53.804791 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c7664b-2ea6-4a03-b75d-e9c819cd8f48 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:53.880736 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:53.897377 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 211/430] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 16 17:06:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 17:06:53.897377 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc75a5aa-5ce3-47f9-9b29-ca37f78998a0 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:53.923332 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:53.943799 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c7664b-2ea6-4a03-b75d-e9c819cd8f48 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:53.990126 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34926f5e-6936-45ed-ab17-860d8dce219d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:53.990790 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34926f5e-6936-45ed-ab17-860d8dce219d None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:53.991130 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34926f5e-6936-45ed-ab17-860d8dce219d None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:53.991417 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34926f5e-6936-45ed-ab17-860d8dce219d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:53.992262 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34926f5e-6936-45ed-ab17-860d8dce219d None admin] RBAC: Adding query filter params (group.id=c7805c4fc1db4d578b2a0e603b56bf39, role.id=896bff49c5d6464eb612a15f4aa9badc, scope.project.id=ac5b05cf174a49b0aae4343f1ac0f173) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:06:53.992581 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34926f5e-6936-45ed-ab17-860d8dce219d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:53.994063 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34926f5e-6936-45ed-ab17-860d8dce219d None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:54.003359 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 220/431] 10.222.0.39 () {56 vars in 1376 bytes} [Thu Jun 16 17:06:53 2022] GET /identity/v3/role_assignments?group.id=c7805c4fc1db4d578b2a0e603b56bf39&scope.project.id=ac5b05cf174a49b0aae4343f1ac0f173&role.id=896bff49c5d6464eb612a15f4aa9badc => generated 611 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:06:54.004482 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34926f5e-6936-45ed-ab17-860d8dce219d None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:54.028911 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc75a5aa-5ce3-47f9-9b29-ca37f78998a0 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:54.107521 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e4f67c-b5e4-4203-a59f-f732749fe7ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:54.108588 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e4f67c-b5e4-4203-a59f-f732749fe7ea None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:54.109102 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e4f67c-b5e4-4203-a59f-f732749fe7ea None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:54.109591 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e4f67c-b5e4-4203-a59f-f732749fe7ea None admin] PATH_INFO: `/v3/roles` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:54.110596 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e4f67c-b5e4-4203-a59f-f732749fe7ea None admin] RBAC: Adding query filter params (name=member) {{(pid=80873) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:06:54.111112 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e4f67c-b5e4-4203-a59f-f732749fe7ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:54.112681 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e4f67c-b5e4-4203-a59f-f732749fe7ea None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:54.132179 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34926f5e-6936-45ed-ab17-860d8dce219d None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:54.134106 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 212/432] 10.222.0.39 () {56 vars in 1101 bytes} [Thu Jun 16 17:06:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:06:54.139789 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e4f67c-b5e4-4203-a59f-f732749fe7ea None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:54.178961 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfaf9816-0304-4ab6-8adf-244a577a0183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:54.179848 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaf9816-0304-4ab6-8adf-244a577a0183 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:54.180489 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaf9816-0304-4ab6-8adf-244a577a0183 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:54.181108 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaf9816-0304-4ab6-8adf-244a577a0183 None admin] PATH_INFO: `/v3/projects/ac5b05cf174a49b0aae4343f1ac0f173` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:54.182588 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfaf9816-0304-4ab6-8adf-244a577a0183 None admin] RBAC: Authorizing `identity:get_project(project_id=ac5b05cf174a49b0aae4343f1ac0f173)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:54.184428 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfaf9816-0304-4ab6-8adf-244a577a0183 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:54.187543 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 221/433] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 16 17:06:54 2022] GET /identity/v3/projects/ac5b05cf174a49b0aae4343f1ac0f173 => generated 298 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:06:54.193165 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfaf9816-0304-4ab6-8adf-244a577a0183 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:54.221141 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:54.234618 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:54.283008 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e4f67c-b5e4-4203-a59f-f732749fe7ea None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:54.337228 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfaf9816-0304-4ab6-8adf-244a577a0183 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:54.346482 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b965e307-741b-4d21-bdb1-2e7daca9d66a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:54.347180 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b965e307-741b-4d21-bdb1-2e7daca9d66a None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:54.347467 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b965e307-741b-4d21-bdb1-2e7daca9d66a None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:54.347748 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b965e307-741b-4d21-bdb1-2e7daca9d66a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:54.389362 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c7c389-4c2f-4284-8d0f-891a7fd5cadc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:54.389362 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c7c389-4c2f-4284-8d0f-891a7fd5cadc None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:54.389362 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c7c389-4c2f-4284-8d0f-891a7fd5cadc None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:54.389362 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c7c389-4c2f-4284-8d0f-891a7fd5cadc None admin] PATH_INFO: `/v3/groups/c7805c4fc1db4d578b2a0e603b56bf39` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:54.390747 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c7c389-4c2f-4284-8d0f-891a7fd5cadc None admin] RBAC: Authorizing `identity:get_group(group_id=c7805c4fc1db4d578b2a0e603b56bf39)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:54.392840 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c7c389-4c2f-4284-8d0f-891a7fd5cadc None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:54.394623 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 222/434] 10.222.0.39 () {56 vars in 1180 bytes} [Thu Jun 16 17:06:54 2022] GET /identity/v3/groups/c7805c4fc1db4d578b2a0e603b56bf39 => generated 226 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:06:54.396037 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b789fcac-03d4-4d99-98d7-b9317986a2ba None None] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:54.396331 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b789fcac-03d4-4d99-98d7-b9317986a2ba None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:54.396627 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b789fcac-03d4-4d99-98d7-b9317986a2ba None None] PATH_INFO: `/` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:54.398287 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 223/435] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 17:06:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:06:54.400443 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b789fcac-03d4-4d99-98d7-b9317986a2ba None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:54.440860 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b965e307-741b-4d21-bdb1-2e7daca9d66a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:54.442789 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b965e307-741b-4d21-bdb1-2e7daca9d66a None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:54.520049 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:54.530284 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:54.552365 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b789fcac-03d4-4d99-98d7-b9317986a2ba None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:54.597355 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 213/436] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 16 17:06:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 16 17:06:54.598808 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855aea5c-7483-4280-aee7-35b85f13b38d None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:54.599100 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855aea5c-7483-4280-aee7-35b85f13b38d None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:54.599379 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855aea5c-7483-4280-aee7-35b85f13b38d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:54.602938 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1934d302-d701-4717-b472-b874dd037578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:54.603650 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1934d302-d701-4717-b472-b874dd037578 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:54.603986 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1934d302-d701-4717-b472-b874dd037578 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:54.604273 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1934d302-d701-4717-b472-b874dd037578 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:54.605113 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1934d302-d701-4717-b472-b874dd037578 None admin] RBAC: Adding query filter params (group.id=c7805c4fc1db4d578b2a0e603b56bf39, role.id=9331b396c9894ab88267e7b82ef6f224, scope.project.id=ac5b05cf174a49b0aae4343f1ac0f173) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:06:54.605432 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1934d302-d701-4717-b472-b874dd037578 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:54.606910 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1934d302-d701-4717-b472-b874dd037578 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:54.621788 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 224/437] 10.222.0.39 () {56 vars in 1376 bytes} [Thu Jun 16 17:06:54 2022] GET /identity/v3/role_assignments?group.id=c7805c4fc1db4d578b2a0e603b56bf39&scope.project.id=ac5b05cf174a49b0aae4343f1ac0f173&role.id=9331b396c9894ab88267e7b82ef6f224 => generated 611 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 17:06:54.621788 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1934d302-d701-4717-b472-b874dd037578 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:54.622050 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-855aea5c-7483-4280-aee7-35b85f13b38d None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:06:54.622050 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-855aea5c-7483-4280-aee7-35b85f13b38d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:06:54.702312 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 214/438] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 17:06:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 17:06:54.703846 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7884d551-5a67-46ac-a0eb-21a7f0a5b367 None None] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:54.704145 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7884d551-5a67-46ac-a0eb-21a7f0a5b367 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:54.704428 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7884d551-5a67-46ac-a0eb-21a7f0a5b367 None None] PATH_INFO: `/` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:54.705992 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 215/439] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 17:06:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:06:54.711672 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844c4af2-d4c5-4fc9-b6fc-70b9325081f4 None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:54.711978 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844c4af2-d4c5-4fc9-b6fc-70b9325081f4 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:54.712266 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844c4af2-d4c5-4fc9-b6fc-70b9325081f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:54.736628 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-844c4af2-d4c5-4fc9-b6fc-70b9325081f4 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:06:54.738309 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-844c4af2-d4c5-4fc9-b6fc-70b9325081f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:06:54.754816 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1934d302-d701-4717-b472-b874dd037578 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:54.794066 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e7bfcb-13be-45c1-8d9a-7493cafe4d4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:54.794550 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e7bfcb-13be-45c1-8d9a-7493cafe4d4a None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:54.795397 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e7bfcb-13be-45c1-8d9a-7493cafe4d4a None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:54.795877 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e7bfcb-13be-45c1-8d9a-7493cafe4d4a None admin] PATH_INFO: `/v3/projects/d38e49d57050488484d9f03fdb7552ee` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:54.797156 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e7bfcb-13be-45c1-8d9a-7493cafe4d4a None admin] RBAC: Authorizing `identity:get_project(project_id=d38e49d57050488484d9f03fdb7552ee)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:54.798993 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e7bfcb-13be-45c1-8d9a-7493cafe4d4a None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:54.801873 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 225/440] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 16 17:06:54 2022] GET /identity/v3/projects/d38e49d57050488484d9f03fdb7552ee => generated 302 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:06:54.801873 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e7bfcb-13be-45c1-8d9a-7493cafe4d4a None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:54.819044 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 216/441] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 17:06:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 17:06:54.820019 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844c4af2-d4c5-4fc9-b6fc-70b9325081f4 None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:54.820513 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:54.854886 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:54.929044 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e7bfcb-13be-45c1-8d9a-7493cafe4d4a None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:54.970068 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844c4af2-d4c5-4fc9-b6fc-70b9325081f4 None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:54.971731 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f921461c-f51d-468d-9801-f0a4d18cc309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:54.972551 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f921461c-f51d-468d-9801-f0a4d18cc309 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:54.972835 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f921461c-f51d-468d-9801-f0a4d18cc309 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:54.973112 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f921461c-f51d-468d-9801-f0a4d18cc309 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:54.986310 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f921461c-f51d-468d-9801-f0a4d18cc309 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 17:06:54.994367 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application [None req-f921461c-f51d-468d-9801-f0a4d18cc309 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 17:06:54.994367 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:06:54.994367 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:06:54.994367 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:06:54.994367 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:06:54.994367 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:06:54.994367 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:06:54.994367 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:06:54.994367 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:06:54.994367 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:06:54.994367 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:06:54.994367 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:06:54.994367 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 17:06:54.994367 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 17:06:54.994367 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 17:06:54.994367 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 17:06:54.995462 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 17:06:54.995462 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 17:06:54.995462 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 17:06:54.995462 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 17:06:54.995462 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:06:54.995462 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:06:54.995462 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:06:54.995462 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:06:54.995462 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:06:54.995462 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:06:54.995462 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:06:54.995462 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application with Lock( Jun 16 17:06:54.995462 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:06:54.995462 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:06:54.995462 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:06:54.995462 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:06:54.996446 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:06:54.996446 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:06:54.996446 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:06:54.996446 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:06:54.996446 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 17:06:54.996446 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 17:06:54.996446 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 17:06:54.996446 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 17:06:54.996446 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 17:06:54.996446 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 17:06:54.996446 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 17:06:54.996446 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Jun 16 17:06:55.001159 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 226/442] 10.222.0.39 () {56 vars in 1114 bytes} [Thu Jun 16 17:06:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:06:55.002073 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f921461c-f51d-468d-9801-f0a4d18cc309 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:55.013165 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d8a2f4-56b9-48a3-a21e-dbfec14866cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:55.014180 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d8a2f4-56b9-48a3-a21e-dbfec14866cb None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:55.014469 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d8a2f4-56b9-48a3-a21e-dbfec14866cb None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:55.014749 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d8a2f4-56b9-48a3-a21e-dbfec14866cb None admin] PATH_INFO: `/v3/groups/c7805c4fc1db4d578b2a0e603b56bf39` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:55.016458 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d8a2f4-56b9-48a3-a21e-dbfec14866cb None admin] RBAC: Authorizing `identity:get_group(group_id=c7805c4fc1db4d578b2a0e603b56bf39)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:55.018673 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d8a2f4-56b9-48a3-a21e-dbfec14866cb None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:55.020343 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 217/443] 10.222.0.39 () {56 vars in 1180 bytes} [Thu Jun 16 17:06:54 2022] GET /identity/v3/groups/c7805c4fc1db4d578b2a0e603b56bf39 => generated 226 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:06:55.021189 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d8a2f4-56b9-48a3-a21e-dbfec14866cb None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:55.086928 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:55.110822 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f921461c-f51d-468d-9801-f0a4d18cc309 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:55.111995 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:55.124257 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d8a2f4-56b9-48a3-a21e-dbfec14866cb None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:55.143909 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436ee88c-b110-402e-bba6-e50c7608c1e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:55.144702 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436ee88c-b110-402e-bba6-e50c7608c1e6 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:55.144988 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436ee88c-b110-402e-bba6-e50c7608c1e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:55.145267 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436ee88c-b110-402e-bba6-e50c7608c1e6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:55.156680 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436ee88c-b110-402e-bba6-e50c7608c1e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 17:06:55.160735 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fec26fe-0565-425b-835d-094a58adbf7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:55.161407 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fec26fe-0565-425b-835d-094a58adbf7a None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:55.161695 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fec26fe-0565-425b-835d-094a58adbf7a None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:55.162006 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fec26fe-0565-425b-835d-094a58adbf7a None admin] PATH_INFO: `/v3/roles` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:55.162760 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fec26fe-0565-425b-835d-094a58adbf7a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80873) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:06:55.163075 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fec26fe-0565-425b-835d-094a58adbf7a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:55.164454 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fec26fe-0565-425b-835d-094a58adbf7a None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:55.164772 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application [None req-436ee88c-b110-402e-bba6-e50c7608c1e6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 17:06:55.164772 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:06:55.164772 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:06:55.164772 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:06:55.164772 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:06:55.164772 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:06:55.164772 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:06:55.164772 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:06:55.164772 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:06:55.164772 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:06:55.164772 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:06:55.164772 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:06:55.164772 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 17:06:55.164772 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 17:06:55.164772 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 17:06:55.164772 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 17:06:55.165794 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 17:06:55.165794 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 17:06:55.165794 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 17:06:55.165794 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 17:06:55.165794 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:06:55.165794 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:06:55.165794 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:06:55.165794 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:06:55.165794 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:06:55.165794 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:06:55.165794 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:06:55.165794 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application with Lock( Jun 16 17:06:55.165794 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:06:55.165794 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:06:55.165794 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:06:55.165794 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:06:55.166598 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:06:55.166598 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:06:55.166598 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:06:55.166598 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:06:55.166598 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 17:06:55.166598 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 17:06:55.166598 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 17:06:55.166598 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 17:06:55.166598 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 17:06:55.166598 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 17:06:55.166598 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 17:06:55.166598 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Jun 16 17:06:55.170632 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 227/444] 10.222.0.39 () {56 vars in 1096 bytes} [Thu Jun 16 17:06:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:06:55.171723 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436ee88c-b110-402e-bba6-e50c7608c1e6 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:55.177656 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 218/445] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 16 17:06:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:06:55.177656 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fec26fe-0565-425b-835d-094a58adbf7a None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:55.269635 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436ee88c-b110-402e-bba6-e50c7608c1e6 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:55.269848 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fec26fe-0565-425b-835d-094a58adbf7a None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:55.303575 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b6c9c7-e6e7-47bc-aab5-521b773dca90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:55.303794 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a002de-edc9-48bc-9d6e-086ad4d12bf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:55.304229 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b6c9c7-e6e7-47bc-aab5-521b773dca90 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:55.304324 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a002de-edc9-48bc-9d6e-086ad4d12bf8 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:55.304515 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b6c9c7-e6e7-47bc-aab5-521b773dca90 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:55.304615 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a002de-edc9-48bc-9d6e-086ad4d12bf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:55.304794 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b6c9c7-e6e7-47bc-aab5-521b773dca90 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:55.304882 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a002de-edc9-48bc-9d6e-086ad4d12bf8 None admin] PATH_INFO: `/v3/roles` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:55.305608 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a002de-edc9-48bc-9d6e-086ad4d12bf8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80873) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:06:55.305744 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b6c9c7-e6e7-47bc-aab5-521b773dca90 None admin] RBAC: Adding query filter params (group.id=c7805c4fc1db4d578b2a0e603b56bf39, role.id=896bff49c5d6464eb612a15f4aa9badc, scope.project.id=d38e49d57050488484d9f03fdb7552ee) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:06:55.305947 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a002de-edc9-48bc-9d6e-086ad4d12bf8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:55.306051 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b6c9c7-e6e7-47bc-aab5-521b773dca90 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:55.307307 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a002de-edc9-48bc-9d6e-086ad4d12bf8 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:55.307402 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b6c9c7-e6e7-47bc-aab5-521b773dca90 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:55.309155 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:55.314692 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 228/446] 10.222.0.39 () {56 vars in 1376 bytes} [Thu Jun 16 17:06:55 2022] GET /identity/v3/role_assignments?group.id=c7805c4fc1db4d578b2a0e603b56bf39&scope.project.id=d38e49d57050488484d9f03fdb7552ee&role.id=896bff49c5d6464eb612a15f4aa9badc => generated 611 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:06:55.315757 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b6c9c7-e6e7-47bc-aab5-521b773dca90 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:55.316414 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 219/447] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 16 17:06:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:06:55.322206 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a002de-edc9-48bc-9d6e-086ad4d12bf8 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:55.340323 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:55.441050 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b6c9c7-e6e7-47bc-aab5-521b773dca90 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:55.442862 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a002de-edc9-48bc-9d6e-086ad4d12bf8 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:55.481374 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b40a730-bca0-4a7d-92a3-aeb7b09b4d09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:55.482059 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b40a730-bca0-4a7d-92a3-aeb7b09b4d09 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:55.482380 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b40a730-bca0-4a7d-92a3-aeb7b09b4d09 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:55.482735 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b40a730-bca0-4a7d-92a3-aeb7b09b4d09 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:55.484358 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1185b170-8971-4b66-bbac-22dda6b86812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:55.485028 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1185b170-8971-4b66-bbac-22dda6b86812 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:55.485312 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1185b170-8971-4b66-bbac-22dda6b86812 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:55.485588 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1185b170-8971-4b66-bbac-22dda6b86812 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:55.564725 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1185b170-8971-4b66-bbac-22dda6b86812 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:55.565485 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:55.566297 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1185b170-8971-4b66-bbac-22dda6b86812 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:55.569541 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b40a730-bca0-4a7d-92a3-aeb7b09b4d09 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:55.571265 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b40a730-bca0-4a7d-92a3-aeb7b09b4d09 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:55.582029 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:55.686682 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 220/448] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 16 17:06:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 16 17:06:55.693243 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1185b170-8971-4b66-bbac-22dda6b86812 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:55.703934 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 229/449] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 16 17:06:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 17:06:55.711511 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b40a730-bca0-4a7d-92a3-aeb7b09b4d09 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:55.799068 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1185b170-8971-4b66-bbac-22dda6b86812 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:55.805412 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:55.809135 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b40a730-bca0-4a7d-92a3-aeb7b09b4d09 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:55.812502 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:55.833422 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0f0427-cdd8-464f-9c5f-843104aa9df9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:55.834313 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0f0427-cdd8-464f-9c5f-843104aa9df9 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:55.834604 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0f0427-cdd8-464f-9c5f-843104aa9df9 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:55.834887 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0f0427-cdd8-464f-9c5f-843104aa9df9 None admin] PATH_INFO: `/v3/projects/63375056d675488ab27a6e1a845c0237` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:55.836078 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0f0427-cdd8-464f-9c5f-843104aa9df9 None admin] RBAC: Authorizing `identity:get_project(project_id=63375056d675488ab27a6e1a845c0237)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:55.837521 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0f0427-cdd8-464f-9c5f-843104aa9df9 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:55.839269 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 221/450] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 16 17:06:55 2022] GET /identity/v3/projects/63375056d675488ab27a6e1a845c0237 => generated 344 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:06:55.844016 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e9be23-ed6d-4669-87ef-cac04372cf33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:55.845171 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e9be23-ed6d-4669-87ef-cac04372cf33 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:55.845279 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0f0427-cdd8-464f-9c5f-843104aa9df9 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:55.845456 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e9be23-ed6d-4669-87ef-cac04372cf33 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:55.845734 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e9be23-ed6d-4669-87ef-cac04372cf33 None admin] PATH_INFO: `/v3/projects/d38e49d57050488484d9f03fdb7552ee` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:55.846943 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e9be23-ed6d-4669-87ef-cac04372cf33 None admin] RBAC: Authorizing `identity:get_project(project_id=d38e49d57050488484d9f03fdb7552ee)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:55.853090 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e9be23-ed6d-4669-87ef-cac04372cf33 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:55.853090 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 230/451] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 16 17:06:55 2022] GET /identity/v3/projects/d38e49d57050488484d9f03fdb7552ee => generated 302 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 17:06:55.855592 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e9be23-ed6d-4669-87ef-cac04372cf33 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:55.947475 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0f0427-cdd8-464f-9c5f-843104aa9df9 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:55.955788 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e9be23-ed6d-4669-87ef-cac04372cf33 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:55.986217 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d8da22-641d-43ef-9b0f-de76e6a28520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:55.987077 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d8da22-641d-43ef-9b0f-de76e6a28520 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:55.987358 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d8da22-641d-43ef-9b0f-de76e6a28520 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:55.987636 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d8da22-641d-43ef-9b0f-de76e6a28520 None admin] PATH_INFO: `/v3/groups/93fa516d6693407d813d52f4b9d3d1fe` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:55.988813 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d8da22-641d-43ef-9b0f-de76e6a28520 None admin] RBAC: Authorizing `identity:get_group(group_id=93fa516d6693407d813d52f4b9d3d1fe)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:55.990268 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d8da22-641d-43ef-9b0f-de76e6a28520 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:55.991477 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5fc5cd-88ab-4252-ae59-34958f427915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:55.991888 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 222/452] 10.222.0.39 () {56 vars in 1180 bytes} [Thu Jun 16 17:06:55 2022] GET /identity/v3/groups/93fa516d6693407d813d52f4b9d3d1fe => generated 229 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 17:06:55.992336 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5fc5cd-88ab-4252-ae59-34958f427915 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:55.992622 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5fc5cd-88ab-4252-ae59-34958f427915 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:55.992903 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5fc5cd-88ab-4252-ae59-34958f427915 None admin] PATH_INFO: `/v3/groups/c7805c4fc1db4d578b2a0e603b56bf39` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:55.994126 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5fc5cd-88ab-4252-ae59-34958f427915 None admin] RBAC: Authorizing `identity:get_group(group_id=c7805c4fc1db4d578b2a0e603b56bf39)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:55.995590 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5fc5cd-88ab-4252-ae59-34958f427915 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:56.002132 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 231/453] 10.222.0.39 () {56 vars in 1180 bytes} [Thu Jun 16 17:06:55 2022] GET /identity/v3/groups/c7805c4fc1db4d578b2a0e603b56bf39 => generated 226 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 17:06:56.002286 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d8da22-641d-43ef-9b0f-de76e6a28520 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:56.002932 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5fc5cd-88ab-4252-ae59-34958f427915 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:56.037061 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:56.048657 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:56.098008 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d8da22-641d-43ef-9b0f-de76e6a28520 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:56.103359 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5fc5cd-88ab-4252-ae59-34958f427915 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:56.133912 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e765ea-4db0-4e85-94ce-4134e9e23358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:56.134566 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e765ea-4db0-4e85-94ce-4134e9e23358 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:56.134848 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e765ea-4db0-4e85-94ce-4134e9e23358 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:56.135126 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e765ea-4db0-4e85-94ce-4134e9e23358 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:56.135949 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e765ea-4db0-4e85-94ce-4134e9e23358 None admin] RBAC: Adding query filter params (group.id=93fa516d6693407d813d52f4b9d3d1fe, role.id=dba744f8ab2a4c45b9d3212f8d203aba, scope.project.id=63375056d675488ab27a6e1a845c0237) {{(pid=80873) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:06:56.136262 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e765ea-4db0-4e85-94ce-4134e9e23358 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:56.137248 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507fc77c-ca6f-4ea3-b1a7-e7e0aaaf3148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:56.137680 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e765ea-4db0-4e85-94ce-4134e9e23358 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:56.137921 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507fc77c-ca6f-4ea3-b1a7-e7e0aaaf3148 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:56.138209 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507fc77c-ca6f-4ea3-b1a7-e7e0aaaf3148 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:56.138559 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507fc77c-ca6f-4ea3-b1a7-e7e0aaaf3148 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:56.139427 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507fc77c-ca6f-4ea3-b1a7-e7e0aaaf3148 None admin] RBAC: Adding query filter params (group.id=c7805c4fc1db4d578b2a0e603b56bf39, role.id=9331b396c9894ab88267e7b82ef6f224, scope.project.id=d38e49d57050488484d9f03fdb7552ee) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:06:56.139745 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507fc77c-ca6f-4ea3-b1a7-e7e0aaaf3148 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:56.141158 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507fc77c-ca6f-4ea3-b1a7-e7e0aaaf3148 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:56.143505 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 223/454] 10.222.0.39 () {56 vars in 1376 bytes} [Thu Jun 16 17:06:55 2022] GET /identity/v3/role_assignments?group.id=93fa516d6693407d813d52f4b9d3d1fe&scope.project.id=63375056d675488ab27a6e1a845c0237&role.id=dba744f8ab2a4c45b9d3212f8d203aba => generated 611 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 17:06:56.147132 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 232/455] 10.222.0.39 () {56 vars in 1376 bytes} [Thu Jun 16 17:06:56 2022] GET /identity/v3/role_assignments?group.id=c7805c4fc1db4d578b2a0e603b56bf39&scope.project.id=d38e49d57050488484d9f03fdb7552ee&role.id=9331b396c9894ab88267e7b82ef6f224 => generated 611 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 17:06:58.988493 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6e9c55-b73d-4fd3-b7a4-2f3fad8c27c4 None None] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:58.989487 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6e9c55-b73d-4fd3-b7a4-2f3fad8c27c4 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:58.989998 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6e9c55-b73d-4fd3-b7a4-2f3fad8c27c4 None None] PATH_INFO: `/` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:58.991851 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 224/456] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 17:06:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:06:58.997534 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0838ac57-763f-402f-87c7-93d8cf61164e None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:58.998627 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0838ac57-763f-402f-87c7-93d8cf61164e None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:58.998818 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0838ac57-763f-402f-87c7-93d8cf61164e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:59.019839 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-0838ac57-763f-402f-87c7-93d8cf61164e None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:06:59.021036 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-0838ac57-763f-402f-87c7-93d8cf61164e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:06:59.113342 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6193e90a-92c6-48b9-8417-5697c954895a None None] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:59.114022 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6193e90a-92c6-48b9-8417-5697c954895a None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:59.114510 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6193e90a-92c6-48b9-8417-5697c954895a None None] PATH_INFO: `/` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:59.116383 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 225/457] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 17:06:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:06:59.121322 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f23c6b-0687-4007-9563-0746d0b97cc8 None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:59.121870 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f23c6b-0687-4007-9563-0746d0b97cc8 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:59.122363 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f23c6b-0687-4007-9563-0746d0b97cc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:59.124317 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 233/458] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 17:06:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 17:06:59.147196 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0838ac57-763f-402f-87c7-93d8cf61164e None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:59.158755 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-d0f23c6b-0687-4007-9563-0746d0b97cc8 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:06:59.159966 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-d0f23c6b-0687-4007-9563-0746d0b97cc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:06:59.214132 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:59.295213 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 226/459] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 17:06:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 17:06:59.323414 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f23c6b-0687-4007-9563-0746d0b97cc8 None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:59.327388 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0838ac57-763f-402f-87c7-93d8cf61164e None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:59.386352 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d00908-da9c-4483-87cd-3701e548ab3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:59.387372 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d00908-da9c-4483-87cd-3701e548ab3c None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:59.387665 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d00908-da9c-4483-87cd-3701e548ab3c None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:59.390399 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d00908-da9c-4483-87cd-3701e548ab3c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:59.416817 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d00908-da9c-4483-87cd-3701e548ab3c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:59.418156 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:59.418275 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d00908-da9c-4483-87cd-3701e548ab3c None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:59.455862 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application [None req-06d00908-da9c-4483-87cd-3701e548ab3c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:06:59.455862 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:06:59.455862 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:06:59.455862 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:06:59.455862 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:06:59.455862 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:06:59.455862 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:06:59.455862 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:06:59.455862 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:06:59.455862 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:06:59.455862 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:06:59.455862 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:06:59.455862 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 17:06:59.455862 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 17:06:59.455862 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 17:06:59.456820 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 17:06:59.456820 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:06:59.456820 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:06:59.456820 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:06:59.456820 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:06:59.456820 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:06:59.456820 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:06:59.456820 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:06:59.456820 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application with Lock( Jun 16 17:06:59.456820 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:06:59.456820 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:06:59.456820 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:06:59.456820 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:06:59.456820 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:06:59.456820 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:06:59.456820 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:06:59.456820 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:06:59.457664 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 17:06:59.457664 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 17:06:59.457664 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:06:59.457664 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Jun 16 17:06:59.457664 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 234/460] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 17:06:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:06:59.463220 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d00908-da9c-4483-87cd-3701e548ab3c None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:59.507535 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f23c6b-0687-4007-9563-0746d0b97cc8 None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:59.543624 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987307f3-65ab-44b2-91a7-18fd2287f094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:59.544424 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987307f3-65ab-44b2-91a7-18fd2287f094 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:59.545250 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987307f3-65ab-44b2-91a7-18fd2287f094 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:59.545525 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987307f3-65ab-44b2-91a7-18fd2287f094 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:59.553204 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:59.555590 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987307f3-65ab-44b2-91a7-18fd2287f094 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:59.557044 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987307f3-65ab-44b2-91a7-18fd2287f094 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:59.574253 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d00908-da9c-4483-87cd-3701e548ab3c None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:59.576457 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application [None req-987307f3-65ab-44b2-91a7-18fd2287f094 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:06:59.576457 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:06:59.576457 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:06:59.576457 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:06:59.576457 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:06:59.576457 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:06:59.576457 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:06:59.576457 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:06:59.576457 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:06:59.576457 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:06:59.576457 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:06:59.576457 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:06:59.576457 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 17:06:59.576457 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 17:06:59.576457 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 17:06:59.577318 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 17:06:59.577318 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:06:59.577318 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:06:59.577318 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:06:59.577318 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:06:59.577318 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:06:59.577318 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:06:59.577318 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:06:59.577318 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application with Lock( Jun 16 17:06:59.577318 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:06:59.577318 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:06:59.577318 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:06:59.577318 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:06:59.577318 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:06:59.577318 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:06:59.577318 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:06:59.577318 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:06:59.579516 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 17:06:59.579516 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 17:06:59.579516 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:06:59.579516 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Jun 16 17:06:59.579516 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 227/461] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 17:06:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 17:06:59.579516 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce1df1a-4afa-40cc-9eb0-ba78345a4c2a None None] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:59.579516 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce1df1a-4afa-40cc-9eb0-ba78345a4c2a None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:59.579516 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce1df1a-4afa-40cc-9eb0-ba78345a4c2a None None] PATH_INFO: `/` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:59.580858 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 228/462] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 17:06:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:06:59.583005 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf26b20f-0f15-4817-8170-efbba0ed7157 None None] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:59.583520 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf26b20f-0f15-4817-8170-efbba0ed7157 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:59.584070 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf26b20f-0f15-4817-8170-efbba0ed7157 None None] PATH_INFO: `/` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:59.585539 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 229/463] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 17:06:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:06:59.586460 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf26b20f-0f15-4817-8170-efbba0ed7157 None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:59.617098 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a77cd43-9b8c-48e7-9a56-c721419eb2bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:59.617767 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a77cd43-9b8c-48e7-9a56-c721419eb2bc None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:59.618085 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a77cd43-9b8c-48e7-9a56-c721419eb2bc None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:59.618524 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a77cd43-9b8c-48e7-9a56-c721419eb2bc None admin] PATH_INFO: `/v3/domains` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:59.619155 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a77cd43-9b8c-48e7-9a56-c721419eb2bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:06:59.619417 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a77cd43-9b8c-48e7-9a56-c721419eb2bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:59.620768 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a77cd43-9b8c-48e7-9a56-c721419eb2bc None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:59.633176 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 235/464] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 16 17:06:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 17:06:59.634419 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4415eb79-719c-4da3-83ce-df99effd91a1 None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:59.634708 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4415eb79-719c-4da3-83ce-df99effd91a1 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:59.634980 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4415eb79-719c-4da3-83ce-df99effd91a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:59.652284 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-4415eb79-719c-4da3-83ce-df99effd91a1 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:06:59.653463 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-4415eb79-719c-4da3-83ce-df99effd91a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:06:59.695229 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:59.702780 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf26b20f-0f15-4817-8170-efbba0ed7157 None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:59.739014 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 236/465] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 17:06:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 17:06:59.740375 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55242c71-c28d-47dc-b401-492ee4b2afda None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:59.740672 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55242c71-c28d-47dc-b401-492ee4b2afda None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:59.740953 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55242c71-c28d-47dc-b401-492ee4b2afda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:59.750707 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed9504c-f54e-46e9-ab76-63977304d3ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:59.754104 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed9504c-f54e-46e9-ab76-63977304d3ef None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:59.754587 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed9504c-f54e-46e9-ab76-63977304d3ef None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:59.755105 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed9504c-f54e-46e9-ab76-63977304d3ef None admin] PATH_INFO: `/v3/domains` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:59.756464 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed9504c-f54e-46e9-ab76-63977304d3ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=80873) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:06:59.756963 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed9504c-f54e-46e9-ab76-63977304d3ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:59.759285 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed9504c-f54e-46e9-ab76-63977304d3ef None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:59.768491 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-55242c71-c28d-47dc-b401-492ee4b2afda None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:06:59.770195 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-55242c71-c28d-47dc-b401-492ee4b2afda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:06:59.773546 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 230/466] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 16 17:06:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:06:59.774566 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed9504c-f54e-46e9-ab76-63977304d3ef None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:59.840078 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:06:59.844707 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 237/467] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 17:06:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 17:06:59.845686 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55242c71-c28d-47dc-b401-492ee4b2afda None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:06:59.895884 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed9504c-f54e-46e9-ab76-63977304d3ef None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:59.930903 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7334184b-ffa0-4785-9a72-99b15fc6ff1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:59.931578 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7334184b-ffa0-4785-9a72-99b15fc6ff1c None admin] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:59.931863 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7334184b-ffa0-4785-9a72-99b15fc6ff1c None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:59.932141 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7334184b-ffa0-4785-9a72-99b15fc6ff1c None admin] PATH_INFO: `/v3/users` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:06:59.932841 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7334184b-ffa0-4785-9a72-99b15fc6ff1c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:06:59.934301 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7334184b-ffa0-4785-9a72-99b15fc6ff1c None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:06:59.960845 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55242c71-c28d-47dc-b401-492ee4b2afda None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:06:59.996860 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af531cd-9b93-492a-b72d-5311355a3848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:06:59.997698 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af531cd-9b93-492a-b72d-5311355a3848 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:06:59.998314 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af531cd-9b93-492a-b72d-5311355a3848 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:06:59.998314 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af531cd-9b93-492a-b72d-5311355a3848 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:00.008329 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af531cd-9b93-492a-b72d-5311355a3848 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:00.009811 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af531cd-9b93-492a-b72d-5311355a3848 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:00.028663 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application [None req-2af531cd-9b93-492a-b72d-5311355a3848 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:07:00.028663 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:07:00.028663 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:07:00.028663 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:07:00.028663 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:07:00.028663 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:07:00.028663 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:07:00.028663 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:07:00.028663 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:07:00.028663 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:07:00.028663 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:07:00.028663 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:07:00.028663 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 17:07:00.028663 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 17:07:00.028663 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 17:07:00.030205 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 17:07:00.030205 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:07:00.030205 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:07:00.030205 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:07:00.030205 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:07:00.030205 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:07:00.030205 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:07:00.030205 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:07:00.030205 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application with Lock( Jun 16 17:07:00.030205 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:07:00.030205 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:07:00.030205 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:07:00.030205 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:07:00.030205 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:07:00.030205 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:07:00.030205 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:07:00.030205 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:07:00.031047 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 17:07:00.031047 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 17:07:00.031047 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:07:00.031047 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Jun 16 17:07:00.031047 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 238/468] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 17:06:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:07:00.031306 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af531cd-9b93-492a-b72d-5311355a3848 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:00.050395 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 231/469] 10.222.0.39 () {60 vars in 1132 bytes} [Thu Jun 16 17:06:59 2022] POST /identity/v3/users => generated 248 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:07:00.051224 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7334184b-ffa0-4785-9a72-99b15fc6ff1c None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:00.070311 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:00.110064 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:00.166049 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af531cd-9b93-492a-b72d-5311355a3848 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:00.192884 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7334184b-ffa0-4785-9a72-99b15fc6ff1c None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:00.211592 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c59d79-bce1-4a95-8bdd-8a13743d56c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:00.212201 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c59d79-bce1-4a95-8bdd-8a13743d56c9 None admin] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:00.212496 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c59d79-bce1-4a95-8bdd-8a13743d56c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:00.212781 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c59d79-bce1-4a95-8bdd-8a13743d56c9 None admin] PATH_INFO: `/v3/users` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:00.213516 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c59d79-bce1-4a95-8bdd-8a13743d56c9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:00.215100 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c59d79-bce1-4a95-8bdd-8a13743d56c9 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:00.243562 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1410b08-3fd6-4778-a478-08059783ce88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:00.244401 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1410b08-3fd6-4778-a478-08059783ce88 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:00.244693 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1410b08-3fd6-4778-a478-08059783ce88 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:00.245932 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1410b08-3fd6-4778-a478-08059783ce88 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:00.259372 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1410b08-3fd6-4778-a478-08059783ce88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:00.260919 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1410b08-3fd6-4778-a478-08059783ce88 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:00.282248 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application [None req-f1410b08-3fd6-4778-a478-08059783ce88 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:07:00.282248 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:07:00.282248 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:07:00.282248 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:07:00.282248 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:07:00.282248 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:07:00.282248 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:07:00.282248 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:07:00.282248 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:07:00.282248 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:07:00.282248 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:07:00.282248 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:07:00.282248 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 17:07:00.282248 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 17:07:00.282248 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 17:07:00.283208 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 17:07:00.283208 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:07:00.283208 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:07:00.283208 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:07:00.283208 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:07:00.283208 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:07:00.283208 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:07:00.283208 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:07:00.283208 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application with Lock( Jun 16 17:07:00.283208 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:07:00.283208 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:07:00.283208 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:07:00.283208 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:07:00.283208 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:07:00.283208 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:07:00.283208 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:07:00.283208 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:07:00.284067 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 17:07:00.284067 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 17:07:00.284067 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:07:00.284067 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Jun 16 17:07:00.284067 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 232/470] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 17:07:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:07:00.284350 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1410b08-3fd6-4778-a478-08059783ce88 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:00.306801 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 239/471] 10.222.0.39 () {60 vars in 1132 bytes} [Thu Jun 16 17:07:00 2022] POST /identity/v3/users => generated 246 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:07:00.307752 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c59d79-bce1-4a95-8bdd-8a13743d56c9 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:00.368146 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:00.415146 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1410b08-3fd6-4778-a478-08059783ce88 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:00.455912 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2307cae-af2f-4dc5-b2bd-9f9b43b128fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:00.456765 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2307cae-af2f-4dc5-b2bd-9f9b43b128fe None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:00.457158 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2307cae-af2f-4dc5-b2bd-9f9b43b128fe None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:00.457544 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2307cae-af2f-4dc5-b2bd-9f9b43b128fe None admin] PATH_INFO: `/v3/domains` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:00.458489 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2307cae-af2f-4dc5-b2bd-9f9b43b128fe None admin] RBAC: Adding query filter params (name=Default) {{(pid=80873) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:07:00.458714 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c59d79-bce1-4a95-8bdd-8a13743d56c9 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:00.459020 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2307cae-af2f-4dc5-b2bd-9f9b43b128fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:00.460568 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2307cae-af2f-4dc5-b2bd-9f9b43b128fe None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:00.473393 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:00.475534 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 233/472] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 16 17:07:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:07:00.480347 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3f7be0-7ad1-4cba-a2c4-91e834ece9eb None None] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:00.480347 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3f7be0-7ad1-4cba-a2c4-91e834ece9eb None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:00.480347 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3f7be0-7ad1-4cba-a2c4-91e834ece9eb None None] PATH_INFO: `/` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:00.480347 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 234/473] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 17:07:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:07:00.481425 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3f7be0-7ad1-4cba-a2c4-91e834ece9eb None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:00.515414 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea02fb3-d047-430a-9c19-4f669558445f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:00.516093 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea02fb3-d047-430a-9c19-4f669558445f None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:00.516379 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea02fb3-d047-430a-9c19-4f669558445f None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:00.516658 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea02fb3-d047-430a-9c19-4f669558445f None admin] PATH_INFO: `/v3/domains` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:00.519202 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea02fb3-d047-430a-9c19-4f669558445f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:07:00.519202 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea02fb3-d047-430a-9c19-4f669558445f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:00.519202 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea02fb3-d047-430a-9c19-4f669558445f None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:00.537681 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 240/474] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 16 17:07:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:07:00.539373 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf80842-94be-43a4-923a-5df8a831a129 None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:00.539739 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf80842-94be-43a4-923a-5df8a831a129 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:00.540088 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf80842-94be-43a4-923a-5df8a831a129 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:00.562737 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-0cf80842-94be-43a4-923a-5df8a831a129 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:07:00.564522 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-0cf80842-94be-43a4-923a-5df8a831a129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:07:00.634518 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3f7be0-7ad1-4cba-a2c4-91e834ece9eb None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:00.651776 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 241/475] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 17:07:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 17:07:00.652880 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf80842-94be-43a4-923a-5df8a831a129 None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:00.664336 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:00.705775 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c898467-6319-4798-ac32-ca0b2b34e7ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:00.706774 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c898467-6319-4798-ac32-ca0b2b34e7ed None admin] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:00.707069 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c898467-6319-4798-ac32-ca0b2b34e7ed None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:00.707821 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c898467-6319-4798-ac32-ca0b2b34e7ed None admin] PATH_INFO: `/v3/users` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:00.708862 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c898467-6319-4798-ac32-ca0b2b34e7ed None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:00.711042 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c898467-6319-4798-ac32-ca0b2b34e7ed None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:00.761442 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:00.767233 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf80842-94be-43a4-923a-5df8a831a129 None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:00.803167 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089883b6-8280-4deb-8bfd-46fa39a00968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:00.803829 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089883b6-8280-4deb-8bfd-46fa39a00968 None admin] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:00.804115 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089883b6-8280-4deb-8bfd-46fa39a00968 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:00.804393 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089883b6-8280-4deb-8bfd-46fa39a00968 None admin] PATH_INFO: `/v3/users` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:00.805096 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089883b6-8280-4deb-8bfd-46fa39a00968 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:00.806592 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089883b6-8280-4deb-8bfd-46fa39a00968 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:00.823204 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 235/476] 10.222.0.39 () {60 vars in 1132 bytes} [Thu Jun 16 17:07:00 2022] POST /identity/v3/users => generated 249 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:07:00.831049 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c898467-6319-4798-ac32-ca0b2b34e7ed None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:00.938777 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 242/477] 10.222.0.39 () {60 vars in 1132 bytes} [Thu Jun 16 17:07:00 2022] POST /identity/v3/users => generated 248 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:07:00.987784 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c898467-6319-4798-ac32-ca0b2b34e7ed None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:01.050714 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e528476-3145-495e-8e68-b2652704ef5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:01.051349 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e528476-3145-495e-8e68-b2652704ef5e None admin] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:01.051650 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e528476-3145-495e-8e68-b2652704ef5e None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:01.051937 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e528476-3145-495e-8e68-b2652704ef5e None admin] PATH_INFO: `/v3/roles` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:01.052703 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e528476-3145-495e-8e68-b2652704ef5e None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:01.054170 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e528476-3145-495e-8e68-b2652704ef5e None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:01.087393 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.sql.core [None req-9e528476-3145-495e-8e68-b2652704ef5e None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 16 17:07:01.087393 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 16 17:07:01.087393 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [parameters: {'id': 'c965d2965d35459f90bff01f53b9e1b0', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 16 17:07:01.087393 dv-cinder-837356-2-smb devstack@keystone.service[80873]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80873) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 16 17:07:01.105963 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application [None req-9e528476-3145-495e-8e68-b2652704ef5e None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 16 17:07:01.105963 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:07:01.105963 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 16 17:07:01.105963 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 16 17:07:01.105963 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 16 17:07:01.105963 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 16 17:07:01.105963 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 16 17:07:01.105963 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application result = self._query(query) Jun 16 17:07:01.105963 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 16 17:07:01.105963 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application conn.query(q) Jun 16 17:07:01.105963 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 16 17:07:01.105963 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 16 17:07:01.105963 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 16 17:07:01.105963 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application result.read() Jun 16 17:07:01.105963 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 16 17:07:01.106905 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 16 17:07:01.106905 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 16 17:07:01.106905 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 16 17:07:01.106905 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 16 17:07:01.106905 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 16 17:07:01.106905 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 16 17:07:01.106905 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 16 17:07:01.106905 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 16 17:07:01.106905 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Jun 16 17:07:01.106905 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 16 17:07:01.106905 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Jun 16 17:07:01.106905 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:07:01.106905 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 16 17:07:01.106905 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 16 17:07:01.106905 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jun 16 17:07:01.106905 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return ref.to_dict() Jun 16 17:07:01.106905 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 16 17:07:01.106905 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application next(self.gen) Jun 16 17:07:01.108003 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 16 17:07:01.108003 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application yield resource Jun 16 17:07:01.108003 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 16 17:07:01.108003 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application next(self.gen) Jun 16 17:07:01.108003 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 16 17:07:01.108003 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application self.session.rollback() Jun 16 17:07:01.108003 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 16 17:07:01.108003 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application self.force_reraise() Jun 16 17:07:01.108003 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 16 17:07:01.108003 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application raise self.value Jun 16 17:07:01.108003 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 16 17:07:01.108003 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 16 17:07:01.108003 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 16 17:07:01.108003 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application session.commit() Jun 16 17:07:01.108003 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 16 17:07:01.108003 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 16 17:07:01.108003 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 16 17:07:01.108869 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application self._prepare_impl() Jun 16 17:07:01.108869 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 16 17:07:01.108869 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application self.session.flush() Jun 16 17:07:01.108869 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 16 17:07:01.108869 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application self._flush(objects) Jun 16 17:07:01.108869 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 16 17:07:01.108869 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 16 17:07:01.108869 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 16 17:07:01.108869 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application compat.raise_( Jun 16 17:07:01.108869 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 16 17:07:01.108869 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application raise exception Jun 16 17:07:01.108869 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 16 17:07:01.108869 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application flush_context.execute() Jun 16 17:07:01.108869 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 16 17:07:01.108869 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application rec.execute(self) Jun 16 17:07:01.108869 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 16 17:07:01.108869 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 16 17:07:01.109731 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 16 17:07:01.109731 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 16 17:07:01.109731 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 16 17:07:01.109731 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 16 17:07:01.109731 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 16 17:07:01.109731 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 16 17:07:01.109731 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 16 17:07:01.109731 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 16 17:07:01.109731 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 16 17:07:01.109731 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 16 17:07:01.109731 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 16 17:07:01.109731 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 16 17:07:01.109731 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 16 17:07:01.109731 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 16 17:07:01.109731 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 16 17:07:01.109731 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application raise exception Jun 16 17:07:01.110575 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 16 17:07:01.110575 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 16 17:07:01.110575 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 16 17:07:01.110575 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 16 17:07:01.110575 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 16 17:07:01.110575 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application result = self._query(query) Jun 16 17:07:01.110575 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 16 17:07:01.110575 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application conn.query(q) Jun 16 17:07:01.110575 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 16 17:07:01.110575 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 16 17:07:01.110575 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 16 17:07:01.110575 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application result.read() Jun 16 17:07:01.110575 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 16 17:07:01.110575 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 16 17:07:01.110575 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 16 17:07:01.110575 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 16 17:07:01.111371 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 16 17:07:01.111371 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 16 17:07:01.111371 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 16 17:07:01.111371 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 16 17:07:01.111371 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 16 17:07:01.111371 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 16 17:07:01.111371 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application [parameters: {'id': 'c965d2965d35459f90bff01f53b9e1b0', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 16 17:07:01.111371 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 16 17:07:01.111371 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Jun 16 17:07:01.111371 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 17:07:01.111371 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Jun 16 17:07:01.111371 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:07:01.111371 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:07:01.111371 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:07:01.111371 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:07:01.111371 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:07:01.112173 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:07:01.112173 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:07:01.112173 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:07:01.112173 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:07:01.112173 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:07:01.112173 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:07:01.112173 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jun 16 17:07:01.112173 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jun 16 17:07:01.112173 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:07:01.112173 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:07:01.112173 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jun 16 17:07:01.112173 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jun 16 17:07:01.112173 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 16 17:07:01.112173 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 16 17:07:01.112173 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 16 17:07:01.112173 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Jun 16 17:07:01.113013 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 236/478] 10.222.0.39 () {60 vars in 1131 bytes} [Thu Jun 16 17:07:00 2022] POST /identity/v3/roles => generated 144 bytes in 277 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:07:01.113709 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089883b6-8280-4deb-8bfd-46fa39a00968 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:01.264290 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089883b6-8280-4deb-8bfd-46fa39a00968 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:01.309657 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3504633-0d64-4330-a725-79ccd45049c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:01.311378 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3504633-0d64-4330-a725-79ccd45049c2 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:01.311839 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3504633-0d64-4330-a725-79ccd45049c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:01.312260 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3504633-0d64-4330-a725-79ccd45049c2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:01.327112 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3504633-0d64-4330-a725-79ccd45049c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 17:07:01.335864 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application [None req-e3504633-0d64-4330-a725-79ccd45049c2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 17:07:01.335864 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:07:01.335864 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:07:01.335864 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:07:01.335864 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:07:01.335864 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:07:01.335864 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:07:01.335864 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:07:01.335864 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:07:01.335864 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:07:01.335864 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:07:01.335864 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:07:01.335864 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 17:07:01.335864 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 17:07:01.335864 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 17:07:01.335864 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 17:07:01.337030 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 17:07:01.337030 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 17:07:01.337030 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 17:07:01.337030 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 17:07:01.337030 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:07:01.337030 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:07:01.337030 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:07:01.337030 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:07:01.337030 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:07:01.337030 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:07:01.337030 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:07:01.337030 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application with Lock( Jun 16 17:07:01.337030 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:07:01.337030 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:07:01.337030 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:07:01.337030 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:07:01.338079 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:07:01.338079 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:07:01.338079 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:07:01.338079 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:07:01.338079 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 17:07:01.338079 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 17:07:01.338079 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 17:07:01.338079 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 17:07:01.338079 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 17:07:01.338079 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 17:07:01.338079 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 17:07:01.338079 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Jun 16 17:07:01.340480 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 243/479] 10.222.0.39 () {56 vars in 1114 bytes} [Thu Jun 16 17:07:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:07:01.346863 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e528476-3145-495e-8e68-b2652704ef5e None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:01.486225 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:01.559196 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e528476-3145-495e-8e68-b2652704ef5e None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:01.605453 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89668869-5430-4b2a-85c8-96c53cc303c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:01.606076 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89668869-5430-4b2a-85c8-96c53cc303c8 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:01.606372 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89668869-5430-4b2a-85c8-96c53cc303c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:01.606657 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89668869-5430-4b2a-85c8-96c53cc303c8 None admin] PATH_INFO: `/v3/roles` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:01.607952 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89668869-5430-4b2a-85c8-96c53cc303c8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80873) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:07:01.608270 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89668869-5430-4b2a-85c8-96c53cc303c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:01.609662 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89668869-5430-4b2a-85c8-96c53cc303c8 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:01.618489 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 237/480] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 16 17:07:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:07:02.487962 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0294a958-ce26-489d-b449-8d5838ed53ec None None] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:02.489042 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0294a958-ce26-489d-b449-8d5838ed53ec None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:02.489550 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0294a958-ce26-489d-b449-8d5838ed53ec None None] PATH_INFO: `/` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:02.491151 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 244/481] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 17:07:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:07:02.496222 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883b00eb-783e-463e-8af9-d3e1d52e8189 None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:02.497004 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883b00eb-783e-463e-8af9-d3e1d52e8189 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:02.498110 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883b00eb-783e-463e-8af9-d3e1d52e8189 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:02.517808 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-883b00eb-783e-463e-8af9-d3e1d52e8189 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:07:02.519290 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-883b00eb-783e-463e-8af9-d3e1d52e8189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:07:02.620220 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 238/482] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 17:07:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 17:07:02.652375 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0294a958-ce26-489d-b449-8d5838ed53ec None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:02.675282 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:02.784969 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0294a958-ce26-489d-b449-8d5838ed53ec None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:02.820416 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5363ce78-38cf-45bc-aac0-7bd9f10d3205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:02.821213 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5363ce78-38cf-45bc-aac0-7bd9f10d3205 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:02.821497 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5363ce78-38cf-45bc-aac0-7bd9f10d3205 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:02.821791 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5363ce78-38cf-45bc-aac0-7bd9f10d3205 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:02.832827 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5363ce78-38cf-45bc-aac0-7bd9f10d3205 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 17:07:02.840522 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application [None req-5363ce78-38cf-45bc-aac0-7bd9f10d3205 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 17:07:02.840522 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:07:02.840522 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:07:02.840522 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:07:02.840522 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:07:02.840522 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:07:02.840522 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:07:02.840522 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:07:02.840522 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:07:02.840522 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:07:02.840522 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:07:02.840522 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:07:02.840522 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 17:07:02.840522 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 17:07:02.840522 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 17:07:02.840522 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 17:07:02.842036 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 17:07:02.842036 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 17:07:02.842036 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 17:07:02.842036 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 17:07:02.842036 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:07:02.842036 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:07:02.842036 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:07:02.842036 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:07:02.842036 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:07:02.842036 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:07:02.842036 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:07:02.842036 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application with Lock( Jun 16 17:07:02.842036 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:07:02.842036 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:07:02.842036 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:07:02.842036 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:07:02.843477 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:07:02.843477 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:07:02.843477 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:07:02.843477 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:07:02.843477 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 17:07:02.843477 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 17:07:02.843477 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 17:07:02.843477 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 17:07:02.843477 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 17:07:02.843477 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 17:07:02.843477 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 17:07:02.843477 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Jun 16 17:07:02.843477 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 245/483] 10.222.0.39 () {56 vars in 1102 bytes} [Thu Jun 16 17:07:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:07:02.848429 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883b00eb-783e-463e-8af9-d3e1d52e8189 None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:02.941638 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:02.953641 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d29a42-69d9-4e51-97f2-926894e59a7d None None] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:02.953965 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d29a42-69d9-4e51-97f2-926894e59a7d None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:02.954252 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d29a42-69d9-4e51-97f2-926894e59a7d None None] PATH_INFO: `/` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:02.956292 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 246/484] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 17:07:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:07:02.961346 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d3670b-9ee9-41b3-877c-327cdc904844 None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:02.961639 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d3670b-9ee9-41b3-877c-327cdc904844 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:02.961948 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d3670b-9ee9-41b3-877c-327cdc904844 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:02.990855 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-13d3670b-9ee9-41b3-877c-327cdc904844 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:07:02.992075 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-13d3670b-9ee9-41b3-877c-327cdc904844 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:07:03.056429 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883b00eb-783e-463e-8af9-d3e1d52e8189 None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:03.092444 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da64bf0a-7586-42d9-a7f2-dc4ced637fc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:03.093126 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da64bf0a-7586-42d9-a7f2-dc4ced637fc8 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:03.093470 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da64bf0a-7586-42d9-a7f2-dc4ced637fc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:03.093773 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da64bf0a-7586-42d9-a7f2-dc4ced637fc8 None admin] PATH_INFO: `/v3/roles` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:03.097796 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da64bf0a-7586-42d9-a7f2-dc4ced637fc8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80873) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:07:03.097796 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da64bf0a-7586-42d9-a7f2-dc4ced637fc8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:03.097796 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da64bf0a-7586-42d9-a7f2-dc4ced637fc8 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:03.105643 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 239/485] 10.222.0.39 () {56 vars in 1103 bytes} [Thu Jun 16 17:07:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:07:03.111593 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da64bf0a-7586-42d9-a7f2-dc4ced637fc8 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:03.132451 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 247/486] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 17:07:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 17:07:03.172145 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d3670b-9ee9-41b3-877c-327cdc904844 None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:03.176172 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:03.231210 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da64bf0a-7586-42d9-a7f2-dc4ced637fc8 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:03.246179 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:03.291872 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221e28cf-3f89-49e4-8de4-7ee0e65c96d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:03.292681 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221e28cf-3f89-49e4-8de4-7ee0e65c96d0 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:03.292968 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221e28cf-3f89-49e4-8de4-7ee0e65c96d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:03.293244 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221e28cf-3f89-49e4-8de4-7ee0e65c96d0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:03.318567 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221e28cf-3f89-49e4-8de4-7ee0e65c96d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:03.319958 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221e28cf-3f89-49e4-8de4-7ee0e65c96d0 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:03.351811 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application [None req-221e28cf-3f89-49e4-8de4-7ee0e65c96d0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:07:03.351811 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:07:03.351811 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:07:03.351811 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:07:03.351811 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:07:03.351811 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:07:03.351811 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:07:03.351811 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:07:03.351811 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:07:03.351811 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:07:03.351811 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:07:03.351811 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:07:03.351811 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 17:07:03.351811 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 17:07:03.351811 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 17:07:03.352726 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 17:07:03.352726 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:07:03.352726 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:07:03.352726 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:07:03.352726 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:07:03.352726 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:07:03.352726 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:07:03.352726 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:07:03.352726 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application with Lock( Jun 16 17:07:03.352726 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:07:03.352726 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:07:03.352726 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:07:03.352726 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:07:03.352726 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:07:03.352726 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:07:03.352726 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:07:03.352726 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:07:03.353578 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 17:07:03.353578 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 17:07:03.353578 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:07:03.353578 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Jun 16 17:07:03.364469 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 240/487] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 17:07:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 17:07:03.365387 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221e28cf-3f89-49e4-8de4-7ee0e65c96d0 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:03.388607 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d3670b-9ee9-41b3-877c-327cdc904844 None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:03.444618 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732c7cbc-699f-4936-8193-f9345676602e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:03.445436 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732c7cbc-699f-4936-8193-f9345676602e None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:03.445725 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732c7cbc-699f-4936-8193-f9345676602e None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:03.446040 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732c7cbc-699f-4936-8193-f9345676602e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:03.474267 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732c7cbc-699f-4936-8193-f9345676602e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 17:07:03.485581 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application [None req-732c7cbc-699f-4936-8193-f9345676602e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 17:07:03.485581 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:07:03.485581 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:07:03.485581 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:07:03.485581 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:07:03.485581 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:07:03.485581 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:07:03.485581 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:07:03.485581 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:07:03.485581 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:07:03.485581 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:07:03.485581 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:07:03.485581 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 17:07:03.485581 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 17:07:03.485581 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 17:07:03.485581 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 17:07:03.487807 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 17:07:03.487807 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 17:07:03.487807 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 17:07:03.487807 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 17:07:03.487807 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:07:03.487807 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:07:03.487807 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:07:03.487807 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:07:03.487807 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:07:03.487807 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:07:03.487807 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:07:03.487807 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application with Lock( Jun 16 17:07:03.487807 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:07:03.487807 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:07:03.487807 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:07:03.487807 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:07:03.490303 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:07:03.490303 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:07:03.490303 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:07:03.490303 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:07:03.490303 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 17:07:03.490303 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 17:07:03.490303 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 17:07:03.490303 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 17:07:03.490303 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 17:07:03.490303 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 17:07:03.490303 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 17:07:03.490303 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Jun 16 17:07:03.490303 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 248/488] 10.222.0.39 () {56 vars in 1102 bytes} [Thu Jun 16 17:07:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 17:07:03.490303 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27ede96-d2d7-42b1-a4a1-dfaba670a785 None None] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:03.493299 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27ede96-d2d7-42b1-a4a1-dfaba670a785 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:03.493299 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27ede96-d2d7-42b1-a4a1-dfaba670a785 None None] PATH_INFO: `/` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:03.494536 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 249/489] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 17:07:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:07:03.496812 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27ede96-d2d7-42b1-a4a1-dfaba670a785 None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:03.539543 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221e28cf-3f89-49e4-8de4-7ee0e65c96d0 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:03.578397 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:03.591807 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fb434a-1d0d-4f30-865f-68e0f087cee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:03.593383 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fb434a-1d0d-4f30-865f-68e0f087cee1 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:03.593937 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fb434a-1d0d-4f30-865f-68e0f087cee1 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:03.594449 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fb434a-1d0d-4f30-865f-68e0f087cee1 None admin] PATH_INFO: `/v3/domains` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:03.595760 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fb434a-1d0d-4f30-865f-68e0f087cee1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80873) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:07:03.596290 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fb434a-1d0d-4f30-865f-68e0f087cee1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:03.598513 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fb434a-1d0d-4f30-865f-68e0f087cee1 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:03.620093 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 241/490] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 16 17:07:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:07:03.620093 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5473258-a0ad-4b0a-b34a-929f307be063 None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:03.620093 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5473258-a0ad-4b0a-b34a-929f307be063 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:03.620093 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5473258-a0ad-4b0a-b34a-929f307be063 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:03.627017 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27ede96-d2d7-42b1-a4a1-dfaba670a785 None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:03.645232 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-b5473258-a0ad-4b0a-b34a-929f307be063 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:07:03.646497 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-b5473258-a0ad-4b0a-b34a-929f307be063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:07:03.648688 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:03.673189 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2007203b-0a5d-4676-bbf4-521aea1f9873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:03.674860 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2007203b-0a5d-4676-bbf4-521aea1f9873 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:03.675449 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2007203b-0a5d-4676-bbf4-521aea1f9873 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:03.675951 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2007203b-0a5d-4676-bbf4-521aea1f9873 None admin] PATH_INFO: `/v3/roles` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:03.677141 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2007203b-0a5d-4676-bbf4-521aea1f9873 None admin] RBAC: Adding query filter params (name=service) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:07:03.678113 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2007203b-0a5d-4676-bbf4-521aea1f9873 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:03.680221 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2007203b-0a5d-4676-bbf4-521aea1f9873 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:03.693105 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 250/491] 10.222.0.39 () {56 vars in 1103 bytes} [Thu Jun 16 17:07:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:07:03.694422 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2007203b-0a5d-4676-bbf4-521aea1f9873 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:03.728766 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 242/492] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 17:07:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 17:07:03.737993 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5473258-a0ad-4b0a-b34a-929f307be063 None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:03.811349 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2007203b-0a5d-4676-bbf4-521aea1f9873 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:03.836186 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:03.843271 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5473258-a0ad-4b0a-b34a-929f307be063 None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:03.845168 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01072b13-0a2d-4d36-a4ce-271e7f7dd101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:03.845663 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01072b13-0a2d-4d36-a4ce-271e7f7dd101 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:03.845978 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01072b13-0a2d-4d36-a4ce-271e7f7dd101 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:03.846258 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01072b13-0a2d-4d36-a4ce-271e7f7dd101 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:03.855198 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01072b13-0a2d-4d36-a4ce-271e7f7dd101 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:03.856625 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01072b13-0a2d-4d36-a4ce-271e7f7dd101 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:03.873125 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application [None req-01072b13-0a2d-4d36-a4ce-271e7f7dd101 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 16 17:07:03.873125 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:07:03.873125 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:07:03.873125 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:07:03.873125 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:07:03.873125 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:07:03.873125 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:07:03.873125 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:07:03.873125 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:07:03.873125 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:07:03.873125 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:07:03.873125 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:07:03.873125 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 17:07:03.873125 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 17:07:03.873125 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 17:07:03.873125 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 17:07:03.874127 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:07:03.874127 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:07:03.874127 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 17:07:03.874127 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 17:07:03.874127 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 17:07:03.874127 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 17:07:03.874127 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:07:03.874127 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:07:03.874127 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:07:03.874127 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:07:03.874127 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:07:03.874127 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application with Lock( Jun 16 17:07:03.874127 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:07:03.874127 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:07:03.874127 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:07:03.874127 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:07:03.874127 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:07:03.874127 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:07:03.875093 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:07:03.875093 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:07:03.875093 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 17:07:03.875093 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 17:07:03.875093 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 17:07:03.875093 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 17:07:03.875093 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 17:07:03.875093 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 17:07:03.875093 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 16 17:07:03.875093 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Jun 16 17:07:03.875093 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 251/493] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 16 17:07:03 2022] GET /identity/v3/users/glance => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:07:03.876364 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9409f47d-70cc-4649-89b1-a74c22bb13fa None None] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:03.876364 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9409f47d-70cc-4649-89b1-a74c22bb13fa None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:03.876364 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9409f47d-70cc-4649-89b1-a74c22bb13fa None None] PATH_INFO: `/` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:03.882025 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 252/494] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 17:07:03 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:07:03.882025 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9409f47d-70cc-4649-89b1-a74c22bb13fa None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:03.896114 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99888d8a-7b4f-4c12-985f-356ca75757f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:03.896908 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99888d8a-7b4f-4c12-985f-356ca75757f8 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:03.897192 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99888d8a-7b4f-4c12-985f-356ca75757f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:03.897472 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99888d8a-7b4f-4c12-985f-356ca75757f8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:03.904188 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:03.907719 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99888d8a-7b4f-4c12-985f-356ca75757f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:03.909344 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99888d8a-7b4f-4c12-985f-356ca75757f8 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:03.927799 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application [None req-99888d8a-7b4f-4c12-985f-356ca75757f8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:07:03.927799 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:07:03.927799 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:07:03.927799 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:07:03.927799 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:07:03.927799 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:07:03.927799 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:07:03.927799 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:07:03.927799 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:07:03.927799 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:07:03.927799 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:07:03.927799 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:07:03.927799 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 17:07:03.927799 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 17:07:03.927799 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 17:07:03.928675 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 17:07:03.928675 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:07:03.928675 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:07:03.928675 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:07:03.928675 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:07:03.928675 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:07:03.928675 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:07:03.928675 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:07:03.928675 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application with Lock( Jun 16 17:07:03.928675 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:07:03.928675 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:07:03.928675 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:07:03.928675 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:07:03.928675 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:07:03.928675 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:07:03.928675 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:07:03.928675 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:07:03.929542 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 17:07:03.929542 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 17:07:03.929542 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:07:03.929542 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Jun 16 17:07:03.929542 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 243/495] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 17:07:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:07:03.929833 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99888d8a-7b4f-4c12-985f-356ca75757f8 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:03.999258 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9409f47d-70cc-4649-89b1-a74c22bb13fa None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:04.034188 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99888d8a-7b4f-4c12-985f-356ca75757f8 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:04.036086 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae474d6d-a0d3-4b72-bb09-b83b9f90463a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:04.037021 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae474d6d-a0d3-4b72-bb09-b83b9f90463a None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:04.037302 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae474d6d-a0d3-4b72-bb09-b83b9f90463a None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:04.037578 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae474d6d-a0d3-4b72-bb09-b83b9f90463a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:04.048153 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae474d6d-a0d3-4b72-bb09-b83b9f90463a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 17:07:04.056290 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application [None req-ae474d6d-a0d3-4b72-bb09-b83b9f90463a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 17:07:04.056290 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:07:04.056290 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:07:04.056290 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:07:04.056290 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:07:04.056290 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:07:04.056290 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:07:04.056290 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:07:04.056290 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:07:04.056290 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:07:04.056290 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:07:04.056290 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:07:04.056290 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 17:07:04.056290 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 17:07:04.056290 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 17:07:04.056290 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 17:07:04.057197 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 17:07:04.057197 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 17:07:04.057197 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 17:07:04.057197 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 17:07:04.057197 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:07:04.057197 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:07:04.057197 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:07:04.057197 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:07:04.057197 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:07:04.057197 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:07:04.057197 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:07:04.057197 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application with Lock( Jun 16 17:07:04.057197 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:07:04.057197 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:07:04.057197 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:07:04.057197 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:07:04.058022 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:07:04.058022 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:07:04.058022 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:07:04.058022 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:07:04.058022 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 17:07:04.058022 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 17:07:04.058022 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 17:07:04.058022 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 17:07:04.058022 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 17:07:04.058022 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 17:07:04.058022 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 17:07:04.058022 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Jun 16 17:07:04.058022 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 253/496] 10.222.0.39 () {56 vars in 1102 bytes} [Thu Jun 16 17:07:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:07:04.059251 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b95da0e-4f5f-42a5-b9a9-d408b1c27f8e None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:04.059251 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b95da0e-4f5f-42a5-b9a9-d408b1c27f8e None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:04.059383 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b95da0e-4f5f-42a5-b9a9-d408b1c27f8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:04.073584 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1a3d6f-6ae5-4d65-b7cc-f91bdb7e2f4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:04.074298 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1a3d6f-6ae5-4d65-b7cc-f91bdb7e2f4c None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:04.074583 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1a3d6f-6ae5-4d65-b7cc-f91bdb7e2f4c None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:04.074860 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1a3d6f-6ae5-4d65-b7cc-f91bdb7e2f4c None admin] PATH_INFO: `/v3/users` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:04.076327 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1a3d6f-6ae5-4d65-b7cc-f91bdb7e2f4c None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80873) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:07:04.076643 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1a3d6f-6ae5-4d65-b7cc-f91bdb7e2f4c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:04.076989 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-4b95da0e-4f5f-42a5-b9a9-d408b1c27f8e None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:07:04.078103 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1a3d6f-6ae5-4d65-b7cc-f91bdb7e2f4c None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:04.078279 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-4b95da0e-4f5f-42a5-b9a9-d408b1c27f8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:07:04.120591 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 244/497] 10.222.0.39 () {56 vars in 1137 bytes} [Thu Jun 16 17:07:03 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:07:04.120591 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1a3d6f-6ae5-4d65-b7cc-f91bdb7e2f4c None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:04.124234 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:04.149038 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 254/498] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 17:07:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 17:07:04.149993 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b95da0e-4f5f-42a5-b9a9-d408b1c27f8e None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:04.186787 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:04.243963 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1a3d6f-6ae5-4d65-b7cc-f91bdb7e2f4c None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:04.272725 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b95da0e-4f5f-42a5-b9a9-d408b1c27f8e None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:04.280445 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55864595-9eea-4555-ba8d-2a4727b78bd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:04.281120 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55864595-9eea-4555-ba8d-2a4727b78bd1 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:04.281440 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55864595-9eea-4555-ba8d-2a4727b78bd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:04.281727 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55864595-9eea-4555-ba8d-2a4727b78bd1 None admin] PATH_INFO: `/v3/domains` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:04.282494 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55864595-9eea-4555-ba8d-2a4727b78bd1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80873) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:07:04.282813 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55864595-9eea-4555-ba8d-2a4727b78bd1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:04.284199 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55864595-9eea-4555-ba8d-2a4727b78bd1 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:04.301615 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 245/499] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 16 17:07:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:07:04.301615 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55864595-9eea-4555-ba8d-2a4727b78bd1 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:04.315368 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2e3722-7f9e-4de4-96b9-25b59bbd1fdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:04.316041 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2e3722-7f9e-4de4-96b9-25b59bbd1fdc None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:04.316329 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2e3722-7f9e-4de4-96b9-25b59bbd1fdc None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:04.316610 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2e3722-7f9e-4de4-96b9-25b59bbd1fdc None admin] PATH_INFO: `/v3/roles` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:04.317365 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2e3722-7f9e-4de4-96b9-25b59bbd1fdc None admin] RBAC: Adding query filter params (name=service) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:07:04.317677 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2e3722-7f9e-4de4-96b9-25b59bbd1fdc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:04.319096 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2e3722-7f9e-4de4-96b9-25b59bbd1fdc None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:04.328041 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 255/500] 10.222.0.39 () {56 vars in 1103 bytes} [Thu Jun 16 17:07:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:07:04.328838 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2e3722-7f9e-4de4-96b9-25b59bbd1fdc None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:04.375695 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:04.411685 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55864595-9eea-4555-ba8d-2a4727b78bd1 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:04.422966 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:04.438908 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2e3722-7f9e-4de4-96b9-25b59bbd1fdc None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:04.448186 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54755a6b-3523-4889-9059-2b067f66733a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:04.448842 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54755a6b-3523-4889-9059-2b067f66733a None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:04.449130 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54755a6b-3523-4889-9059-2b067f66733a None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:04.449418 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54755a6b-3523-4889-9059-2b067f66733a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:04.475926 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383aaec1-2bab-41a8-8ed5-4f13e8997cb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:04.476849 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383aaec1-2bab-41a8-8ed5-4f13e8997cb3 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:04.477136 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383aaec1-2bab-41a8-8ed5-4f13e8997cb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:04.477416 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383aaec1-2bab-41a8-8ed5-4f13e8997cb3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:04.488013 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383aaec1-2bab-41a8-8ed5-4f13e8997cb3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 17:07:04.495636 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application [None req-383aaec1-2bab-41a8-8ed5-4f13e8997cb3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 17:07:04.495636 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:07:04.495636 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:07:04.495636 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:07:04.495636 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:07:04.495636 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:07:04.495636 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:07:04.495636 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:07:04.495636 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:07:04.495636 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:07:04.495636 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:07:04.495636 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:07:04.495636 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 17:07:04.495636 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 17:07:04.495636 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 17:07:04.495636 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 17:07:04.496993 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 17:07:04.496993 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 17:07:04.496993 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 17:07:04.496993 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 17:07:04.496993 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:07:04.496993 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:07:04.496993 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:07:04.496993 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:07:04.496993 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:07:04.496993 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:07:04.496993 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:07:04.496993 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application with Lock( Jun 16 17:07:04.496993 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:07:04.496993 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:07:04.496993 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:07:04.496993 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:07:04.498815 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:07:04.498815 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:07:04.498815 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:07:04.498815 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:07:04.498815 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 17:07:04.498815 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 17:07:04.498815 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 17:07:04.498815 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 17:07:04.498815 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 17:07:04.498815 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 17:07:04.498815 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 17:07:04.498815 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Jun 16 17:07:04.498815 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 256/501] 10.222.0.39 () {56 vars in 1102 bytes} [Thu Jun 16 17:07:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:07:04.498815 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383aaec1-2bab-41a8-8ed5-4f13e8997cb3 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:04.529269 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54755a6b-3523-4889-9059-2b067f66733a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:04.530807 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54755a6b-3523-4889-9059-2b067f66733a None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:04.621147 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:04.626614 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383aaec1-2bab-41a8-8ed5-4f13e8997cb3 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:04.639310 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 246/502] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 16 17:07:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 17:07:04.640351 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54755a6b-3523-4889-9059-2b067f66733a None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:04.652319 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:04.659223 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33efb2dd-e345-4190-89cb-d56c6d32ae2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:04.660019 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33efb2dd-e345-4190-89cb-d56c6d32ae2b None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:04.660435 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33efb2dd-e345-4190-89cb-d56c6d32ae2b None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:04.660722 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33efb2dd-e345-4190-89cb-d56c6d32ae2b None admin] PATH_INFO: `/v3/users/nova` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:04.668826 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33efb2dd-e345-4190-89cb-d56c6d32ae2b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:04.670839 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33efb2dd-e345-4190-89cb-d56c6d32ae2b None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:04.685587 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application [None req-33efb2dd-e345-4190-89cb-d56c6d32ae2b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 16 17:07:04.685587 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:07:04.685587 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:07:04.685587 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:07:04.685587 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:07:04.685587 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:07:04.685587 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:07:04.685587 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:07:04.685587 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:07:04.685587 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:07:04.685587 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:07:04.685587 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:07:04.685587 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 17:07:04.685587 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 17:07:04.685587 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 17:07:04.685587 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 17:07:04.686836 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:07:04.686836 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:07:04.686836 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 17:07:04.686836 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 17:07:04.686836 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 17:07:04.686836 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 17:07:04.686836 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:07:04.686836 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:07:04.686836 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:07:04.686836 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:07:04.686836 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:07:04.686836 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application with Lock( Jun 16 17:07:04.686836 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:07:04.686836 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:07:04.686836 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:07:04.686836 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:07:04.686836 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:07:04.686836 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:07:04.687973 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:07:04.687973 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:07:04.687973 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 17:07:04.687973 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 17:07:04.687973 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 17:07:04.687973 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 17:07:04.687973 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 17:07:04.687973 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 17:07:04.687973 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 16 17:07:04.687973 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Jun 16 17:07:04.687973 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 257/503] 10.222.0.39 () {56 vars in 1093 bytes} [Thu Jun 16 17:07:04 2022] GET /identity/v3/users/nova => generated 82 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:07:04.688687 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33efb2dd-e345-4190-89cb-d56c6d32ae2b None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:04.743870 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54755a6b-3523-4889-9059-2b067f66733a None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:04.777081 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9b5483-4624-4a8b-a13e-469860130bcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:04.777898 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9b5483-4624-4a8b-a13e-469860130bcf None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:04.778190 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9b5483-4624-4a8b-a13e-469860130bcf None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:04.778498 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9b5483-4624-4a8b-a13e-469860130bcf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:04.787966 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33efb2dd-e345-4190-89cb-d56c6d32ae2b None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:04.789177 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9b5483-4624-4a8b-a13e-469860130bcf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:04.790662 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9b5483-4624-4a8b-a13e-469860130bcf None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:04.808357 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application [None req-ab9b5483-4624-4a8b-a13e-469860130bcf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:07:04.808357 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:07:04.808357 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:07:04.808357 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:07:04.808357 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:07:04.808357 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:07:04.808357 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:07:04.808357 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:07:04.808357 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:07:04.808357 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:07:04.808357 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:07:04.808357 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:07:04.808357 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 17:07:04.808357 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 17:07:04.808357 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 17:07:04.809243 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 17:07:04.809243 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:07:04.809243 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:07:04.809243 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:07:04.809243 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:07:04.809243 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:07:04.809243 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:07:04.809243 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:07:04.809243 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application with Lock( Jun 16 17:07:04.809243 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:07:04.809243 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:07:04.809243 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:07:04.809243 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:07:04.809243 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:07:04.809243 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:07:04.809243 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:07:04.809243 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:07:04.810679 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 17:07:04.810679 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 17:07:04.810679 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:07:04.810679 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Jun 16 17:07:04.810679 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 247/504] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 17:07:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:07:04.811928 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88025aa2-6d50-402d-932a-60fe9d22c99e None None] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:04.812214 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88025aa2-6d50-402d-932a-60fe9d22c99e None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:04.812491 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88025aa2-6d50-402d-932a-60fe9d22c99e None None] PATH_INFO: `/` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:04.813785 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 248/505] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 17:07:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:07:04.815435 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88025aa2-6d50-402d-932a-60fe9d22c99e None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:04.826738 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a9384b-eb5d-421f-9e9c-26f316f9a724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:04.827403 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a9384b-eb5d-421f-9e9c-26f316f9a724 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:04.827684 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a9384b-eb5d-421f-9e9c-26f316f9a724 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:04.827960 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a9384b-eb5d-421f-9e9c-26f316f9a724 None admin] PATH_INFO: `/v3/roles` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:04.828706 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a9384b-eb5d-421f-9e9c-26f316f9a724 None admin] RBAC: Adding query filter params (name=service) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:07:04.829011 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a9384b-eb5d-421f-9e9c-26f316f9a724 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:04.830394 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a9384b-eb5d-421f-9e9c-26f316f9a724 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:04.838280 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 258/506] 10.222.0.39 () {56 vars in 1103 bytes} [Thu Jun 16 17:07:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:07:04.839049 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a9384b-eb5d-421f-9e9c-26f316f9a724 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:04.861781 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:04.880963 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:04.920233 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88025aa2-6d50-402d-932a-60fe9d22c99e None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:04.945831 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a9384b-eb5d-421f-9e9c-26f316f9a724 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:04.957494 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9741de3f-cd12-4908-89c4-db9b81a58ea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:04.958314 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9741de3f-cd12-4908-89c4-db9b81a58ea7 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:04.958648 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9741de3f-cd12-4908-89c4-db9b81a58ea7 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:04.958931 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9741de3f-cd12-4908-89c4-db9b81a58ea7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:04.969672 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9741de3f-cd12-4908-89c4-db9b81a58ea7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:04.971144 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9741de3f-cd12-4908-89c4-db9b81a58ea7 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:04.980837 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d8fc1c-606c-4703-afd8-d81e2c0cc601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:04.981497 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d8fc1c-606c-4703-afd8-d81e2c0cc601 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:04.981883 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d8fc1c-606c-4703-afd8-d81e2c0cc601 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:04.982162 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d8fc1c-606c-4703-afd8-d81e2c0cc601 None admin] PATH_INFO: `/v3/users` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:04.983010 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d8fc1c-606c-4703-afd8-d81e2c0cc601 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:07:04.983322 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d8fc1c-606c-4703-afd8-d81e2c0cc601 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:04.984740 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d8fc1c-606c-4703-afd8-d81e2c0cc601 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:04.989069 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application [None req-9741de3f-cd12-4908-89c4-db9b81a58ea7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:07:04.989069 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:07:04.989069 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:07:04.989069 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:07:04.989069 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:07:04.989069 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:07:04.989069 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:07:04.989069 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:07:04.989069 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:07:04.989069 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:07:04.989069 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:07:04.989069 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:07:04.989069 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 17:07:04.989069 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 17:07:04.989069 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 17:07:04.989924 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 17:07:04.989924 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:07:04.989924 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:07:04.989924 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:07:04.989924 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:07:04.989924 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:07:04.989924 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:07:04.989924 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:07:04.989924 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application with Lock( Jun 16 17:07:04.989924 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:07:04.989924 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:07:04.989924 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:07:04.989924 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:07:04.989924 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:07:04.989924 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:07:04.989924 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:07:04.989924 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:07:04.995530 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 17:07:04.995530 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 17:07:04.995530 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:07:04.995530 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Jun 16 17:07:04.995530 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 249/507] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 17:07:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:07:04.995530 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9741de3f-cd12-4908-89c4-db9b81a58ea7 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:05.022060 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 259/508] 10.222.0.39 () {56 vars in 1133 bytes} [Thu Jun 16 17:07:04 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:07:05.023397 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f250c7f-80e1-4fe4-b048-e40b62581f60 None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:05.023695 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f250c7f-80e1-4fe4-b048-e40b62581f60 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:05.023970 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f250c7f-80e1-4fe4-b048-e40b62581f60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:05.039676 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-9f250c7f-80e1-4fe4-b048-e40b62581f60 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:07:05.040858 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-9f250c7f-80e1-4fe4-b048-e40b62581f60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:07:05.099084 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9741de3f-cd12-4908-89c4-db9b81a58ea7 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:05.106395 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 260/509] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 17:07:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 17:07:05.107447 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f250c7f-80e1-4fe4-b048-e40b62581f60 None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:05.112592 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:05.118299 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:05.135633 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57dcc6e-046b-43da-88dc-09a60054323d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:05.136226 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57dcc6e-046b-43da-88dc-09a60054323d None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:05.136510 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57dcc6e-046b-43da-88dc-09a60054323d None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:05.136790 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57dcc6e-046b-43da-88dc-09a60054323d None admin] PATH_INFO: `/v3/domains` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:05.137512 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57dcc6e-046b-43da-88dc-09a60054323d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80873) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:07:05.137851 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57dcc6e-046b-43da-88dc-09a60054323d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:05.139818 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57dcc6e-046b-43da-88dc-09a60054323d None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:05.151288 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 250/510] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 16 17:07:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:07:05.151288 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57dcc6e-046b-43da-88dc-09a60054323d None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:05.212686 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f250c7f-80e1-4fe4-b048-e40b62581f60 None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:05.248222 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1bd742-604b-4744-b485-491598686ea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:05.249519 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1bd742-604b-4744-b485-491598686ea0 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:05.249968 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1bd742-604b-4744-b485-491598686ea0 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:05.250265 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1bd742-604b-4744-b485-491598686ea0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:05.252245 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57dcc6e-046b-43da-88dc-09a60054323d None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:05.260391 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1bd742-604b-4744-b485-491598686ea0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:05.261885 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1bd742-604b-4744-b485-491598686ea0 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:05.280504 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application [None req-fe1bd742-604b-4744-b485-491598686ea0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:07:05.280504 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:07:05.280504 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:07:05.280504 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:07:05.280504 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:07:05.280504 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:07:05.280504 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:07:05.280504 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:07:05.280504 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:07:05.280504 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:07:05.280504 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:07:05.280504 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:07:05.280504 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 17:07:05.280504 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 17:07:05.280504 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 17:07:05.281425 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 17:07:05.281425 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:07:05.281425 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:07:05.281425 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:07:05.281425 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:07:05.281425 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:07:05.281425 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:07:05.281425 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:07:05.281425 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application with Lock( Jun 16 17:07:05.281425 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:07:05.281425 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:07:05.281425 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:07:05.281425 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:07:05.281425 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:07:05.281425 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:07:05.281425 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:07:05.281425 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:07:05.282803 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 17:07:05.282803 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 17:07:05.282803 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:07:05.282803 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Jun 16 17:07:05.282803 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 261/511] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 17:07:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:07:05.282803 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1bd742-604b-4744-b485-491598686ea0 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:05.292620 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a700cd-27c9-4d71-b754-cfcb1bef6036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:05.293828 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a700cd-27c9-4d71-b754-cfcb1bef6036 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:05.294131 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a700cd-27c9-4d71-b754-cfcb1bef6036 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:05.294414 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a700cd-27c9-4d71-b754-cfcb1bef6036 None admin] PATH_INFO: `/v3/domains` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:05.295167 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a700cd-27c9-4d71-b754-cfcb1bef6036 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80873) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:07:05.295477 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a700cd-27c9-4d71-b754-cfcb1bef6036 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:05.297193 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a700cd-27c9-4d71-b754-cfcb1bef6036 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:05.309068 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 251/512] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 16 17:07:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:07:05.310021 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a700cd-27c9-4d71-b754-cfcb1bef6036 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:05.343313 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:05.357635 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:05.402230 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1bd742-604b-4744-b485-491598686ea0 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:05.411140 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a700cd-27c9-4d71-b754-cfcb1bef6036 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:05.437164 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d82ac1-9363-47a7-b50a-f4c4eb953ea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:05.437841 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d82ac1-9363-47a7-b50a-f4c4eb953ea8 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:05.438138 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d82ac1-9363-47a7-b50a-f4c4eb953ea8 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:05.438421 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d82ac1-9363-47a7-b50a-f4c4eb953ea8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:05.444850 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9be4837-6984-4520-a333-e5eab198cb75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:05.445641 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9be4837-6984-4520-a333-e5eab198cb75 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:05.445968 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9be4837-6984-4520-a333-e5eab198cb75 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:05.446251 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9be4837-6984-4520-a333-e5eab198cb75 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:05.456813 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9be4837-6984-4520-a333-e5eab198cb75 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:05.458459 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9be4837-6984-4520-a333-e5eab198cb75 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:05.475224 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application [None req-d9be4837-6984-4520-a333-e5eab198cb75 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:07:05.475224 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:07:05.475224 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:07:05.475224 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:07:05.475224 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:07:05.475224 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:07:05.475224 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:07:05.475224 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:07:05.475224 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:07:05.475224 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:07:05.475224 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:07:05.475224 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:07:05.475224 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 17:07:05.475224 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 17:07:05.475224 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 17:07:05.476521 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 17:07:05.476521 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:07:05.476521 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:07:05.476521 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:07:05.476521 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:07:05.476521 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:07:05.476521 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:07:05.476521 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:07:05.476521 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application with Lock( Jun 16 17:07:05.476521 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:07:05.476521 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:07:05.476521 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:07:05.476521 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:07:05.476521 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:07:05.476521 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:07:05.476521 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:07:05.476521 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:07:05.477617 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 17:07:05.477617 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 17:07:05.477617 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:07:05.477617 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Jun 16 17:07:05.482506 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 252/513] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 17:07:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:07:05.483506 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9be4837-6984-4520-a333-e5eab198cb75 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:05.508061 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d82ac1-9363-47a7-b50a-f4c4eb953ea8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:05.509530 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d82ac1-9363-47a7-b50a-f4c4eb953ea8 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:05.566824 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:05.567505 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:05.582348 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9be4837-6984-4520-a333-e5eab198cb75 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:05.608691 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 262/514] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 16 17:07:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 17:07:05.609536 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d82ac1-9363-47a7-b50a-f4c4eb953ea8 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:05.634068 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aae9cab-32a7-4624-af8a-33c661e78d75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:05.634875 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aae9cab-32a7-4624-af8a-33c661e78d75 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:05.635160 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aae9cab-32a7-4624-af8a-33c661e78d75 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:05.635435 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aae9cab-32a7-4624-af8a-33c661e78d75 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:05.644048 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aae9cab-32a7-4624-af8a-33c661e78d75 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:05.645497 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aae9cab-32a7-4624-af8a-33c661e78d75 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:05.661227 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application [None req-0aae9cab-32a7-4624-af8a-33c661e78d75 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 16 17:07:05.661227 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:07:05.661227 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:07:05.661227 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:07:05.661227 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:07:05.661227 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:07:05.661227 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:07:05.661227 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:07:05.661227 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:07:05.661227 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:07:05.661227 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:07:05.661227 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:07:05.661227 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 17:07:05.661227 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 17:07:05.661227 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 17:07:05.661227 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 17:07:05.662163 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:07:05.662163 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:07:05.662163 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 17:07:05.662163 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 17:07:05.662163 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 17:07:05.662163 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 17:07:05.662163 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:07:05.662163 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:07:05.662163 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:07:05.662163 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:07:05.662163 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:07:05.662163 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application with Lock( Jun 16 17:07:05.662163 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:07:05.662163 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:07:05.662163 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:07:05.662163 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:07:05.662163 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:07:05.662163 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:07:05.663068 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:07:05.663068 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:07:05.663068 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 17:07:05.663068 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 17:07:05.663068 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 17:07:05.663068 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 17:07:05.663068 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 17:07:05.663068 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 17:07:05.663068 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 16 17:07:05.663068 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Jun 16 17:07:05.663068 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 253/515] 10.222.0.39 () {56 vars in 1102 bytes} [Thu Jun 16 17:07:05 2022] GET /identity/v3/users/neutron => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:07:05.663629 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aae9cab-32a7-4624-af8a-33c661e78d75 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:05.717557 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d82ac1-9363-47a7-b50a-f4c4eb953ea8 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:05.751391 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ff5006-f4d7-4f48-808a-d3bb3dd7948f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:05.752054 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ff5006-f4d7-4f48-808a-d3bb3dd7948f None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:05.752337 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ff5006-f4d7-4f48-808a-d3bb3dd7948f None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:05.752613 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ff5006-f4d7-4f48-808a-d3bb3dd7948f None admin] PATH_INFO: `/v3/domains` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:05.753335 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ff5006-f4d7-4f48-808a-d3bb3dd7948f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:07:05.753644 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ff5006-f4d7-4f48-808a-d3bb3dd7948f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:05.755032 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ff5006-f4d7-4f48-808a-d3bb3dd7948f None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:05.765994 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 263/516] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 16 17:07:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:07:05.766145 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aae9cab-32a7-4624-af8a-33c661e78d75 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:05.766776 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ff5006-f4d7-4f48-808a-d3bb3dd7948f None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:05.787913 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:05.800285 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b983d7-c435-4e4b-bade-5e0893ab82a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:05.801082 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b983d7-c435-4e4b-bade-5e0893ab82a3 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:05.801367 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b983d7-c435-4e4b-bade-5e0893ab82a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:05.801647 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b983d7-c435-4e4b-bade-5e0893ab82a3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:05.808405 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b983d7-c435-4e4b-bade-5e0893ab82a3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:05.809937 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b983d7-c435-4e4b-bade-5e0893ab82a3 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:05.824704 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application [None req-e2b983d7-c435-4e4b-bade-5e0893ab82a3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 17:07:05.824704 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:07:05.824704 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:07:05.824704 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:07:05.824704 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:07:05.824704 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:07:05.824704 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:07:05.824704 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:07:05.824704 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:07:05.824704 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:07:05.824704 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:07:05.824704 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:07:05.824704 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 17:07:05.824704 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 17:07:05.824704 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 17:07:05.825604 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 17:07:05.825604 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:07:05.825604 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:07:05.825604 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:07:05.825604 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:07:05.825604 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:07:05.825604 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:07:05.825604 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:07:05.825604 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application with Lock( Jun 16 17:07:05.825604 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:07:05.825604 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:07:05.825604 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:07:05.825604 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:07:05.825604 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:07:05.825604 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:07:05.825604 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:07:05.825604 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:07:05.826720 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 17:07:05.826720 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 17:07:05.826720 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 17:07:05.826720 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 17:07:05.826720 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 17:07:05.826720 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 17:07:05.826720 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 17:07:05.826720 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Jun 16 17:07:05.826720 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 254/517] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 16 17:07:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:07:05.826720 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b983d7-c435-4e4b-bade-5e0893ab82a3 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:05.831018 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:05.868228 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ff5006-f4d7-4f48-808a-d3bb3dd7948f None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:05.907059 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16495dc-6733-424b-8519-ea1d326bce78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:05.907730 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16495dc-6733-424b-8519-ea1d326bce78 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:05.908020 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16495dc-6733-424b-8519-ea1d326bce78 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:05.908308 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16495dc-6733-424b-8519-ea1d326bce78 None admin] PATH_INFO: `/v3/domains` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:05.909038 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16495dc-6733-424b-8519-ea1d326bce78 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:07:05.909354 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16495dc-6733-424b-8519-ea1d326bce78 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:05.910780 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16495dc-6733-424b-8519-ea1d326bce78 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:05.923373 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 264/518] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 16 17:07:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:07:05.924116 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16495dc-6733-424b-8519-ea1d326bce78 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:05.930963 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b983d7-c435-4e4b-bade-5e0893ab82a3 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:05.966354 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261a7b14-6c68-4672-afc5-c131df7279b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:05.967140 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261a7b14-6c68-4672-afc5-c131df7279b7 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:05.967441 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261a7b14-6c68-4672-afc5-c131df7279b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:05.967747 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261a7b14-6c68-4672-afc5-c131df7279b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:05.978067 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261a7b14-6c68-4672-afc5-c131df7279b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:05.979513 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261a7b14-6c68-4672-afc5-c131df7279b7 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:05.996964 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application [None req-261a7b14-6c68-4672-afc5-c131df7279b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:07:05.996964 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:07:05.996964 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:07:05.996964 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:07:05.996964 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:07:05.996964 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:07:05.996964 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:07:05.996964 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:07:05.996964 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:07:05.996964 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:07:05.996964 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:07:05.996964 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:07:05.996964 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 17:07:05.996964 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 17:07:05.996964 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 17:07:05.998532 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 17:07:05.998532 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:07:05.998532 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:07:05.998532 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:07:05.998532 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:07:05.998532 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:07:05.998532 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:07:05.998532 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:07:05.998532 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application with Lock( Jun 16 17:07:05.998532 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:07:05.998532 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:07:05.998532 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:07:05.998532 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:07:05.998532 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:07:05.998532 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:07:05.998532 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:07:05.998532 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:07:05.999396 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 17:07:05.999396 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 17:07:05.999396 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:07:05.999396 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Jun 16 17:07:05.999396 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 255/519] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 17:07:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:07:06.000852 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261a7b14-6c68-4672-afc5-c131df7279b7 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:06.004958 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:06.024046 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16495dc-6733-424b-8519-ea1d326bce78 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:06.056431 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:06.058303 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c71aa0-8fbd-41b8-b65d-32870c8d76b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:06.058980 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c71aa0-8fbd-41b8-b65d-32870c8d76b0 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:06.059279 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c71aa0-8fbd-41b8-b65d-32870c8d76b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:06.059566 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c71aa0-8fbd-41b8-b65d-32870c8d76b0 None admin] PATH_INFO: `/v3/users` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:06.061248 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c71aa0-8fbd-41b8-b65d-32870c8d76b0 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:07:06.061571 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c71aa0-8fbd-41b8-b65d-32870c8d76b0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:06.063046 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c71aa0-8fbd-41b8-b65d-32870c8d76b0 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:06.081475 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 265/520] 10.222.0.39 () {56 vars in 1139 bytes} [Thu Jun 16 17:07:05 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:07:06.082516 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c71aa0-8fbd-41b8-b65d-32870c8d76b0 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:06.099735 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261a7b14-6c68-4672-afc5-c131df7279b7 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:06.134249 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfed8cf-e3c9-4852-b911-9d11e2b1a428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:06.135044 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfed8cf-e3c9-4852-b911-9d11e2b1a428 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:06.135329 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfed8cf-e3c9-4852-b911-9d11e2b1a428 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:06.135605 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfed8cf-e3c9-4852-b911-9d11e2b1a428 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:06.142620 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfed8cf-e3c9-4852-b911-9d11e2b1a428 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:06.144050 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfed8cf-e3c9-4852-b911-9d11e2b1a428 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:06.158173 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application [None req-1dfed8cf-e3c9-4852-b911-9d11e2b1a428 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 16 17:07:06.158173 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:07:06.158173 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:07:06.158173 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:07:06.158173 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:07:06.158173 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:07:06.158173 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:07:06.158173 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:07:06.158173 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:07:06.158173 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:07:06.158173 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:07:06.158173 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:07:06.158173 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 17:07:06.158173 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 17:07:06.158173 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 17:07:06.158173 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 17:07:06.159254 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:07:06.159254 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:07:06.159254 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 17:07:06.159254 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 17:07:06.159254 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 17:07:06.159254 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 17:07:06.159254 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:07:06.159254 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:07:06.159254 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:07:06.159254 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:07:06.159254 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:07:06.159254 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application with Lock( Jun 16 17:07:06.159254 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:07:06.159254 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:07:06.159254 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:07:06.159254 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:07:06.159254 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:07:06.159254 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:07:06.160154 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:07:06.160154 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:07:06.160154 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 17:07:06.160154 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 17:07:06.160154 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 17:07:06.160154 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 17:07:06.160154 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 17:07:06.160154 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 17:07:06.160154 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 16 17:07:06.160154 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Jun 16 17:07:06.160154 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 256/521] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 16 17:07:05 2022] GET /identity/v3/users/cinder => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:07:06.160744 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfed8cf-e3c9-4852-b911-9d11e2b1a428 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:06.187192 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c71aa0-8fbd-41b8-b65d-32870c8d76b0 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:06.222560 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20da1de-28cc-473e-b720-f65704ea3de1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:06.223213 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20da1de-28cc-473e-b720-f65704ea3de1 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:06.223506 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20da1de-28cc-473e-b720-f65704ea3de1 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:06.223796 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20da1de-28cc-473e-b720-f65704ea3de1 None admin] PATH_INFO: `/v3/projects` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:06.224584 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20da1de-28cc-473e-b720-f65704ea3de1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:07:06.224908 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20da1de-28cc-473e-b720-f65704ea3de1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:06.226638 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20da1de-28cc-473e-b720-f65704ea3de1 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:06.237210 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:06.245225 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 266/522] 10.222.0.39 () {56 vars in 1148 bytes} [Thu Jun 16 17:07:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:07:06.246056 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20da1de-28cc-473e-b720-f65704ea3de1 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:06.267319 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfed8cf-e3c9-4852-b911-9d11e2b1a428 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:06.285905 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:06.303372 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39582111-ff1b-4af9-ab98-b13ca37ad493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:06.304235 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39582111-ff1b-4af9-ab98-b13ca37ad493 None admin] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:06.304530 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39582111-ff1b-4af9-ab98-b13ca37ad493 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:06.304809 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39582111-ff1b-4af9-ab98-b13ca37ad493 None admin] PATH_INFO: `/v3/users` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:06.305514 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39582111-ff1b-4af9-ab98-b13ca37ad493 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:06.306973 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39582111-ff1b-4af9-ab98-b13ca37ad493 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:06.346137 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20da1de-28cc-473e-b720-f65704ea3de1 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:06.379956 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676e6ecd-8687-4cb6-bd99-864ba83ec95d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:06.380625 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676e6ecd-8687-4cb6-bd99-864ba83ec95d None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:06.380911 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676e6ecd-8687-4cb6-bd99-864ba83ec95d None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:06.381188 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676e6ecd-8687-4cb6-bd99-864ba83ec95d None admin] PATH_INFO: `/v3/domains` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:06.381944 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676e6ecd-8687-4cb6-bd99-864ba83ec95d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:07:06.382260 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676e6ecd-8687-4cb6-bd99-864ba83ec95d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:06.383621 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676e6ecd-8687-4cb6-bd99-864ba83ec95d None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:06.395368 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 267/523] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 16 17:07:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:07:06.396143 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676e6ecd-8687-4cb6-bd99-864ba83ec95d None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:06.420195 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 257/524] 10.222.0.39 () {60 vars in 1132 bytes} [Thu Jun 16 17:07:06 2022] POST /identity/v3/users => generated 247 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:07:06.420195 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39582111-ff1b-4af9-ab98-b13ca37ad493 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:06.465526 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:06.516748 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676e6ecd-8687-4cb6-bd99-864ba83ec95d None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:06.543104 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39582111-ff1b-4af9-ab98-b13ca37ad493 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:06.560545 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bee820-b673-46f6-b8aa-ba7340db1324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:06.561540 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bee820-b673-46f6-b8aa-ba7340db1324 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:06.561906 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bee820-b673-46f6-b8aa-ba7340db1324 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:06.562186 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bee820-b673-46f6-b8aa-ba7340db1324 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:06.587061 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884bf9d6-ec63-4744-8885-37a672f21e06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:06.587741 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884bf9d6-ec63-4744-8885-37a672f21e06 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:06.588025 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884bf9d6-ec63-4744-8885-37a672f21e06 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:06.588300 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884bf9d6-ec63-4744-8885-37a672f21e06 None admin] PATH_INFO: `/v3/users` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:06.589145 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884bf9d6-ec63-4744-8885-37a672f21e06 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80873) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:07:06.589932 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884bf9d6-ec63-4744-8885-37a672f21e06 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:06.591136 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884bf9d6-ec63-4744-8885-37a672f21e06 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:06.611499 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 258/525] 10.222.0.39 () {56 vars in 1137 bytes} [Thu Jun 16 17:07:06 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:07:06.612342 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884bf9d6-ec63-4744-8885-37a672f21e06 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:06.656470 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:06.658345 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bee820-b673-46f6-b8aa-ba7340db1324 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:06.660184 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bee820-b673-46f6-b8aa-ba7340db1324 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:06.728801 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:06.737379 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884bf9d6-ec63-4744-8885-37a672f21e06 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:06.772868 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f31a50c-6215-4ef6-8d21-5fa100a39dca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:06.773536 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f31a50c-6215-4ef6-8d21-5fa100a39dca None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:06.773875 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f31a50c-6215-4ef6-8d21-5fa100a39dca None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:06.774135 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f31a50c-6215-4ef6-8d21-5fa100a39dca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:06.774972 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f31a50c-6215-4ef6-8d21-5fa100a39dca None admin] RBAC: Adding query filter params (role.id=a12797d48dac420cb2eaadbe537f60ef, scope.project.id=73015da4de1f48c29f57fff1040d2c10, user.id=3985eae1ec3240129eec8d1f4d8d21e8) {{(pid=80873) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:07:06.775295 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f31a50c-6215-4ef6-8d21-5fa100a39dca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:06.776715 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f31a50c-6215-4ef6-8d21-5fa100a39dca None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:06.779176 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 268/526] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 16 17:07:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 17:07:06.780882 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bee820-b673-46f6-b8aa-ba7340db1324 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:06.793798 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 259/527] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jun 16 17:07:06 2022] GET /identity/v3/role_assignments?user.id=3985eae1ec3240129eec8d1f4d8d21e8&scope.project.id=73015da4de1f48c29f57fff1040d2c10&role.id=a12797d48dac420cb2eaadbe537f60ef => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:07:06.793798 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f31a50c-6215-4ef6-8d21-5fa100a39dca None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:06.918377 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bee820-b673-46f6-b8aa-ba7340db1324 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:06.925744 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:06.933427 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f31a50c-6215-4ef6-8d21-5fa100a39dca None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:06.973651 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b5fe77-4d54-43dc-99a4-f6ae188671f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:06.974355 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b5fe77-4d54-43dc-99a4-f6ae188671f3 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:06.974649 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b5fe77-4d54-43dc-99a4-f6ae188671f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:06.974752 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812ee4d6-d12a-45c3-9d4d-84ffb2c66b50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:06.974952 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b5fe77-4d54-43dc-99a4-f6ae188671f3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:06.975791 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812ee4d6-d12a-45c3-9d4d-84ffb2c66b50 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:06.976081 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812ee4d6-d12a-45c3-9d4d-84ffb2c66b50 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:06.976431 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812ee4d6-d12a-45c3-9d4d-84ffb2c66b50 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:06.986362 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812ee4d6-d12a-45c3-9d4d-84ffb2c66b50 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:06.988118 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812ee4d6-d12a-45c3-9d4d-84ffb2c66b50 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:07.010013 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application [None req-812ee4d6-d12a-45c3-9d4d-84ffb2c66b50 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 17:07:07.010013 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:07:07.010013 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:07:07.010013 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:07:07.010013 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:07:07.010013 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:07:07.010013 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:07:07.010013 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:07:07.010013 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:07:07.010013 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:07:07.010013 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:07:07.010013 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:07:07.010013 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 17:07:07.010013 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 17:07:07.010013 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 17:07:07.010932 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 17:07:07.010932 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:07:07.010932 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:07:07.010932 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:07:07.010932 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:07:07.010932 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:07:07.010932 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:07:07.010932 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:07:07.010932 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application with Lock( Jun 16 17:07:07.010932 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:07:07.010932 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:07:07.010932 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:07:07.010932 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:07:07.010932 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:07:07.010932 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:07:07.010932 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:07:07.010932 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:07:07.012191 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 17:07:07.012191 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 17:07:07.012191 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 17:07:07.012191 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 17:07:07.012191 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 17:07:07.012191 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 17:07:07.012191 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 17:07:07.012191 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Jun 16 17:07:07.012191 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 269/528] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 16 17:07:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:07:07.013807 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812ee4d6-d12a-45c3-9d4d-84ffb2c66b50 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:07.039567 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:07.055768 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b5fe77-4d54-43dc-99a4-f6ae188671f3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:07.057232 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b5fe77-4d54-43dc-99a4-f6ae188671f3 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:07.130746 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812ee4d6-d12a-45c3-9d4d-84ffb2c66b50 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:07.160422 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:07.168071 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dc163f-26b4-4310-9de0-377019045a4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:07.168448 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 260/529] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 16 17:07:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 17:07:07.174030 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dc163f-26b4-4310-9de0-377019045a4d None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:07.174030 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dc163f-26b4-4310-9de0-377019045a4d None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:07.174232 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b5fe77-4d54-43dc-99a4-f6ae188671f3 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:07.174374 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dc163f-26b4-4310-9de0-377019045a4d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:07.186756 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dc163f-26b4-4310-9de0-377019045a4d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:07.188351 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dc163f-26b4-4310-9de0-377019045a4d None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:07.208705 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application [None req-26dc163f-26b4-4310-9de0-377019045a4d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:07:07.208705 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:07:07.208705 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:07:07.208705 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:07:07.208705 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:07:07.208705 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:07:07.208705 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:07:07.208705 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:07:07.208705 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:07:07.208705 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:07:07.208705 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:07:07.208705 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:07:07.208705 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 17:07:07.208705 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 17:07:07.208705 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 17:07:07.209643 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 17:07:07.209643 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:07:07.209643 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:07:07.209643 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:07:07.209643 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:07:07.209643 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:07:07.209643 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:07:07.209643 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:07:07.209643 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application with Lock( Jun 16 17:07:07.209643 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:07:07.209643 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:07:07.209643 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:07:07.209643 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:07:07.209643 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:07:07.209643 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:07:07.209643 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:07:07.209643 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:07:07.210558 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 17:07:07.210558 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 17:07:07.210558 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:07:07.210558 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Jun 16 17:07:07.214707 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 270/530] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 17:07:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:07:07.215581 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dc163f-26b4-4310-9de0-377019045a4d None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:07.279485 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b5fe77-4d54-43dc-99a4-f6ae188671f3 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:07.293555 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:07.316888 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1dd143-5f63-46db-9b57-824927e9c73c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:07.317570 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1dd143-5f63-46db-9b57-824927e9c73c None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:07.317884 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1dd143-5f63-46db-9b57-824927e9c73c None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:07.318165 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1dd143-5f63-46db-9b57-824927e9c73c None admin] PATH_INFO: `/v3/projects` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:07.318959 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1dd143-5f63-46db-9b57-824927e9c73c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80873) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:07:07.319276 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1dd143-5f63-46db-9b57-824927e9c73c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:07.320711 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1dd143-5f63-46db-9b57-824927e9c73c None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:07.328959 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dc163f-26b4-4310-9de0-377019045a4d None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:07.340871 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 261/531] 10.222.0.39 () {56 vars in 1148 bytes} [Thu Jun 16 17:07:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:07:07.341862 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1dd143-5f63-46db-9b57-824927e9c73c None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:07.367439 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6cf479-684f-46c4-8e98-296ffbe2434f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:07.369988 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6cf479-684f-46c4-8e98-296ffbe2434f None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:07.369988 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6cf479-684f-46c4-8e98-296ffbe2434f None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:07.369988 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6cf479-684f-46c4-8e98-296ffbe2434f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:07.383284 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6cf479-684f-46c4-8e98-296ffbe2434f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:07.384988 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6cf479-684f-46c4-8e98-296ffbe2434f None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:07.407461 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:07.413525 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application [None req-7d6cf479-684f-46c4-8e98-296ffbe2434f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:07:07.413525 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:07:07.413525 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:07:07.413525 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:07:07.413525 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:07:07.413525 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:07:07.413525 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:07:07.413525 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:07:07.413525 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:07:07.413525 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:07:07.413525 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:07:07.413525 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:07:07.413525 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 17:07:07.413525 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 17:07:07.413525 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 17:07:07.421212 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 17:07:07.421212 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:07:07.421212 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:07:07.421212 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:07:07.421212 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:07:07.421212 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:07:07.421212 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:07:07.421212 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:07:07.421212 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application with Lock( Jun 16 17:07:07.421212 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:07:07.421212 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:07:07.421212 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:07:07.421212 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:07:07.421212 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:07:07.421212 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:07:07.421212 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:07:07.421212 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:07:07.422297 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 17:07:07.422297 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 17:07:07.422297 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:07:07.422297 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Jun 16 17:07:07.422804 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 271/532] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 17:07:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:07:07.423924 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6cf479-684f-46c4-8e98-296ffbe2434f None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:07.457972 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1dd143-5f63-46db-9b57-824927e9c73c None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:07.494850 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8843ffcb-d2a0-4da2-8f92-a7858ca24742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:07.495652 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8843ffcb-d2a0-4da2-8f92-a7858ca24742 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:07.495944 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8843ffcb-d2a0-4da2-8f92-a7858ca24742 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:07.496227 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8843ffcb-d2a0-4da2-8f92-a7858ca24742 None admin] PATH_INFO: `/v3/domains` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:07.497708 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8843ffcb-d2a0-4da2-8f92-a7858ca24742 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80873) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:07:07.498144 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8843ffcb-d2a0-4da2-8f92-a7858ca24742 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:07.500107 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8843ffcb-d2a0-4da2-8f92-a7858ca24742 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:07.517813 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 262/533] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 16 17:07:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:07:07.517813 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8843ffcb-d2a0-4da2-8f92-a7858ca24742 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:07.542389 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6cf479-684f-46c4-8e98-296ffbe2434f None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:07.570634 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:07.585209 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799eab24-1f77-43dc-8372-5807b40efc7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:07.585914 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799eab24-1f77-43dc-8372-5807b40efc7a None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:07.586311 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799eab24-1f77-43dc-8372-5807b40efc7a None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:07.587019 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799eab24-1f77-43dc-8372-5807b40efc7a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:07.587777 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799eab24-1f77-43dc-8372-5807b40efc7a None admin] RBAC: Adding query filter params (role.id=a12797d48dac420cb2eaadbe537f60ef, scope.project.id=73015da4de1f48c29f57fff1040d2c10, user.id=3d381bb41dea4f1e90c3cf3815ac88dc) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:07:07.588104 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799eab24-1f77-43dc-8372-5807b40efc7a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:07.589798 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799eab24-1f77-43dc-8372-5807b40efc7a None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:07.596986 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 272/534] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jun 16 17:07:07 2022] GET /identity/v3/role_assignments?user.id=3d381bb41dea4f1e90c3cf3815ac88dc&scope.project.id=73015da4de1f48c29f57fff1040d2c10&role.id=a12797d48dac420cb2eaadbe537f60ef => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:07:07.598069 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799eab24-1f77-43dc-8372-5807b40efc7a None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:07.659304 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8843ffcb-d2a0-4da2-8f92-a7858ca24742 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:07.678327 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:07.731725 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07eb1de-16b4-4385-83b8-c37096b12b9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:07.732552 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07eb1de-16b4-4385-83b8-c37096b12b9a None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:07.733022 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07eb1de-16b4-4385-83b8-c37096b12b9a None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:07.733265 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07eb1de-16b4-4385-83b8-c37096b12b9a None admin] PATH_INFO: `/v3/domains` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:07.734545 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07eb1de-16b4-4385-83b8-c37096b12b9a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80873) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:07:07.734545 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07eb1de-16b4-4385-83b8-c37096b12b9a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:07.736096 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07eb1de-16b4-4385-83b8-c37096b12b9a None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:07.737891 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799eab24-1f77-43dc-8372-5807b40efc7a None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:07.765859 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 263/535] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 16 17:07:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:07:07.771428 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07eb1de-16b4-4385-83b8-c37096b12b9a None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:07.782323 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bd9219-a375-4cf2-bc59-55783918928b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:07.783391 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bd9219-a375-4cf2-bc59-55783918928b None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:07.783857 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bd9219-a375-4cf2-bc59-55783918928b None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:07.784285 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bd9219-a375-4cf2-bc59-55783918928b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:07.793576 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bd9219-a375-4cf2-bc59-55783918928b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:07.795486 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bd9219-a375-4cf2-bc59-55783918928b None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:07.814062 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application [None req-e4bd9219-a375-4cf2-bc59-55783918928b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 17:07:07.814062 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:07:07.814062 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:07:07.814062 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:07:07.814062 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:07:07.814062 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:07:07.814062 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:07:07.814062 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:07:07.814062 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:07:07.814062 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:07:07.814062 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:07:07.814062 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:07:07.814062 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 17:07:07.814062 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 17:07:07.814062 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 17:07:07.815065 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 17:07:07.815065 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:07:07.815065 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:07:07.815065 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:07:07.815065 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:07:07.815065 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:07:07.815065 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:07:07.815065 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:07:07.815065 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application with Lock( Jun 16 17:07:07.815065 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:07:07.815065 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:07:07.815065 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:07:07.815065 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:07:07.815065 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:07:07.815065 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:07:07.815065 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:07:07.815065 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:07:07.815915 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 17:07:07.815915 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 17:07:07.815915 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 17:07:07.815915 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 17:07:07.815915 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 17:07:07.815915 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 17:07:07.815915 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 17:07:07.815915 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Jun 16 17:07:07.818666 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 273/536] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 16 17:07:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:07:07.823869 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bd9219-a375-4cf2-bc59-55783918928b None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:07.884441 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:07.941965 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bd9219-a375-4cf2-bc59-55783918928b None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:07.954422 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07eb1de-16b4-4385-83b8-c37096b12b9a None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:07.977961 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a3edcb-e062-4e68-94a0-a80be981a4c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:07.978707 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a3edcb-e062-4e68-94a0-a80be981a4c6 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:07.978998 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a3edcb-e062-4e68-94a0-a80be981a4c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:07.979279 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a3edcb-e062-4e68-94a0-a80be981a4c6 None admin] PATH_INFO: `/v3/projects` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:07.980074 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a3edcb-e062-4e68-94a0-a80be981a4c6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:07:07.980391 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a3edcb-e062-4e68-94a0-a80be981a4c6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:07.981962 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a3edcb-e062-4e68-94a0-a80be981a4c6 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:07.994078 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 274/537] 10.222.0.39 () {56 vars in 1148 bytes} [Thu Jun 16 17:07:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:07:08.000398 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a3edcb-e062-4e68-94a0-a80be981a4c6 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:08.021994 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c138a29e-9ca4-4926-9e48-ef12e59afed3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:08.022817 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c138a29e-9ca4-4926-9e48-ef12e59afed3 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:08.023108 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c138a29e-9ca4-4926-9e48-ef12e59afed3 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:08.023392 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c138a29e-9ca4-4926-9e48-ef12e59afed3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:08.038263 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c138a29e-9ca4-4926-9e48-ef12e59afed3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:08.039727 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c138a29e-9ca4-4926-9e48-ef12e59afed3 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:08.070154 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application [None req-c138a29e-9ca4-4926-9e48-ef12e59afed3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 17:07:08.070154 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:07:08.070154 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:07:08.070154 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:07:08.070154 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:07:08.070154 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:07:08.070154 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:07:08.070154 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:07:08.070154 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:07:08.070154 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:07:08.070154 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:07:08.070154 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:07:08.070154 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 17:07:08.070154 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 17:07:08.070154 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 17:07:08.071037 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 17:07:08.071037 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:07:08.071037 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:07:08.071037 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:07:08.071037 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:07:08.071037 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:07:08.071037 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:07:08.071037 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:07:08.071037 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application with Lock( Jun 16 17:07:08.071037 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:07:08.071037 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:07:08.071037 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:07:08.071037 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:07:08.071037 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:07:08.071037 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:07:08.071037 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:07:08.071037 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:07:08.071886 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 17:07:08.071886 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 17:07:08.071886 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 17:07:08.071886 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 17:07:08.071886 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 17:07:08.071886 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 17:07:08.071886 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 17:07:08.071886 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Jun 16 17:07:08.071886 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 264/538] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 16 17:07:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 17:07:08.078054 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c138a29e-9ca4-4926-9e48-ef12e59afed3 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:08.143496 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:08.156146 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a3edcb-e062-4e68-94a0-a80be981a4c6 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:08.166097 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:08.217291 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38ed3d7-7f7e-4166-89c8-f467649ce595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:08.218185 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38ed3d7-7f7e-4166-89c8-f467649ce595 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:08.218481 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38ed3d7-7f7e-4166-89c8-f467649ce595 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:08.218758 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38ed3d7-7f7e-4166-89c8-f467649ce595 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:08.219604 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38ed3d7-7f7e-4166-89c8-f467649ce595 None admin] RBAC: Adding query filter params (role.id=a12797d48dac420cb2eaadbe537f60ef, scope.project.id=73015da4de1f48c29f57fff1040d2c10, user.id=b5d25bfa8dc042329d57cd55fa7b7b23) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:07:08.219916 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38ed3d7-7f7e-4166-89c8-f467649ce595 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:08.221344 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38ed3d7-7f7e-4166-89c8-f467649ce595 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:08.237913 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 275/539] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jun 16 17:07:07 2022] GET /identity/v3/role_assignments?user.id=b5d25bfa8dc042329d57cd55fa7b7b23&scope.project.id=73015da4de1f48c29f57fff1040d2c10&role.id=a12797d48dac420cb2eaadbe537f60ef => generated 259 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:07:08.241159 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c138a29e-9ca4-4926-9e48-ef12e59afed3 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:08.280087 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb6ec69-4dee-489c-942f-59a3a410f42d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:08.280765 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb6ec69-4dee-489c-942f-59a3a410f42d None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:08.281053 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb6ec69-4dee-489c-942f-59a3a410f42d None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:08.281336 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb6ec69-4dee-489c-942f-59a3a410f42d None admin] PATH_INFO: `/v3/projects` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:08.282186 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb6ec69-4dee-489c-942f-59a3a410f42d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80873) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:07:08.282503 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb6ec69-4dee-489c-942f-59a3a410f42d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:08.283944 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb6ec69-4dee-489c-942f-59a3a410f42d None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:08.298181 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 265/540] 10.222.0.39 () {56 vars in 1148 bytes} [Thu Jun 16 17:07:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 17:07:08.311445 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38ed3d7-7f7e-4166-89c8-f467649ce595 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:08.448272 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38ed3d7-7f7e-4166-89c8-f467649ce595 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:08.483543 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1584c87d-1aa9-4634-9b69-0af1a46bd1e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:08.484204 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1584c87d-1aa9-4634-9b69-0af1a46bd1e7 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:08.484490 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1584c87d-1aa9-4634-9b69-0af1a46bd1e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:08.484768 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1584c87d-1aa9-4634-9b69-0af1a46bd1e7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:08.485604 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1584c87d-1aa9-4634-9b69-0af1a46bd1e7 None admin] RBAC: Adding query filter params (role.id=a12797d48dac420cb2eaadbe537f60ef, scope.project.id=73015da4de1f48c29f57fff1040d2c10, user.id=ef37136b89d34edc9cd94c7aa81b2095) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:07:08.485948 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1584c87d-1aa9-4634-9b69-0af1a46bd1e7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:08.487432 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1584c87d-1aa9-4634-9b69-0af1a46bd1e7 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:08.493736 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 276/541] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jun 16 17:07:08 2022] GET /identity/v3/role_assignments?user.id=ef37136b89d34edc9cd94c7aa81b2095&scope.project.id=73015da4de1f48c29f57fff1040d2c10&role.id=a12797d48dac420cb2eaadbe537f60ef => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:07:09.087029 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e884fdb-2ee4-436c-8e3a-ce762b2b8321 None None] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:09.087726 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e884fdb-2ee4-436c-8e3a-ce762b2b8321 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:09.087726 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e884fdb-2ee4-436c-8e3a-ce762b2b8321 None None] PATH_INFO: `/` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:09.089247 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 266/542] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 17:07:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:07:09.103618 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f19c71-3d1d-4d6d-aab1-61f15a3787d8 None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:09.104193 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f19c71-3d1d-4d6d-aab1-61f15a3787d8 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:09.104193 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f19c71-3d1d-4d6d-aab1-61f15a3787d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:09.126875 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-e0f19c71-3d1d-4d6d-aab1-61f15a3787d8 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:07:09.128112 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-e0f19c71-3d1d-4d6d-aab1-61f15a3787d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:07:09.157811 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:09.210595 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 277/543] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 17:07:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 17:07:09.252793 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e884fdb-2ee4-436c-8e3a-ce762b2b8321 None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:09.284755 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d42829-0367-4c65-8ea7-e850d9f6ce0f None None] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:09.285060 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d42829-0367-4c65-8ea7-e850d9f6ce0f None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:09.285311 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d42829-0367-4c65-8ea7-e850d9f6ce0f None None] PATH_INFO: `/` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:09.286719 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 278/544] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 17:07:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 17:07:09.291893 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c578b3d1-0cbc-437d-92f3-c0f1da8f350a None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:09.292115 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c578b3d1-0cbc-437d-92f3-c0f1da8f350a None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:09.292496 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c578b3d1-0cbc-437d-92f3-c0f1da8f350a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:09.320425 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-c578b3d1-0cbc-437d-92f3-c0f1da8f350a None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:07:09.321638 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-c578b3d1-0cbc-437d-92f3-c0f1da8f350a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:07:09.358079 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:09.365711 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e884fdb-2ee4-436c-8e3a-ce762b2b8321 None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:09.402097 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eba27cb-6e7e-4790-bba6-5eae583805f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:09.402905 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eba27cb-6e7e-4790-bba6-5eae583805f1 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:09.403210 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eba27cb-6e7e-4790-bba6-5eae583805f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:09.403592 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eba27cb-6e7e-4790-bba6-5eae583805f1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:09.424235 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eba27cb-6e7e-4790-bba6-5eae583805f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 17:07:09.437420 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application [None req-4eba27cb-6e7e-4790-bba6-5eae583805f1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 17:07:09.437420 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:07:09.437420 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:07:09.437420 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:07:09.437420 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:07:09.437420 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:07:09.437420 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:07:09.437420 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:07:09.437420 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:07:09.437420 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:07:09.437420 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:07:09.437420 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:07:09.437420 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 17:07:09.437420 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 17:07:09.437420 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 17:07:09.437420 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 17:07:09.438371 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 17:07:09.438371 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 17:07:09.438371 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 17:07:09.438371 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 17:07:09.438371 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:07:09.438371 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:07:09.438371 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:07:09.438371 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:07:09.438371 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:07:09.438371 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:07:09.438371 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:07:09.438371 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application with Lock( Jun 16 17:07:09.438371 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:07:09.438371 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:07:09.438371 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:07:09.438371 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:07:09.439178 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:07:09.439178 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:07:09.439178 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:07:09.439178 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:07:09.439178 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 17:07:09.439178 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 17:07:09.439178 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 17:07:09.439178 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 17:07:09.439178 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 17:07:09.439178 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 17:07:09.439178 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 17:07:09.439178 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Jun 16 17:07:09.440280 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 267/545] 10.222.0.39 () {56 vars in 1102 bytes} [Thu Jun 16 17:07:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:07:09.445429 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eba27cb-6e7e-4790-bba6-5eae583805f1 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:09.468913 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 279/546] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 17:07:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 17:07:09.489736 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c578b3d1-0cbc-437d-92f3-c0f1da8f350a None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:09.601859 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eba27cb-6e7e-4790-bba6-5eae583805f1 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:09.645399 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3325a6b-e399-4054-a676-798fbc6f828c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:09.646111 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3325a6b-e399-4054-a676-798fbc6f828c None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:09.646401 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3325a6b-e399-4054-a676-798fbc6f828c None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:09.646681 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3325a6b-e399-4054-a676-798fbc6f828c None admin] PATH_INFO: `/v3/roles` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:09.647447 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3325a6b-e399-4054-a676-798fbc6f828c None admin] RBAC: Adding query filter params (name=service) {{(pid=80873) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:07:09.647762 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3325a6b-e399-4054-a676-798fbc6f828c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:09.649150 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3325a6b-e399-4054-a676-798fbc6f828c None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:09.665389 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 268/547] 10.222.0.39 () {56 vars in 1103 bytes} [Thu Jun 16 17:07:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:07:09.671352 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3325a6b-e399-4054-a676-798fbc6f828c None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:09.693847 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:09.705030 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c578b3d1-0cbc-437d-92f3-c0f1da8f350a None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:09.706105 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:09.773032 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491ae78b-1373-46fd-8d08-e13dcf74760f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:09.773884 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491ae78b-1373-46fd-8d08-e13dcf74760f None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:09.774205 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491ae78b-1373-46fd-8d08-e13dcf74760f None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:09.774493 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491ae78b-1373-46fd-8d08-e13dcf74760f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:09.821446 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491ae78b-1373-46fd-8d08-e13dcf74760f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 17:07:09.831757 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application [None req-491ae78b-1373-46fd-8d08-e13dcf74760f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 17:07:09.831757 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:07:09.831757 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:07:09.831757 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:07:09.831757 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:07:09.831757 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:07:09.831757 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:07:09.831757 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:07:09.831757 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:07:09.831757 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:07:09.831757 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:07:09.831757 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:07:09.831757 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 17:07:09.831757 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 17:07:09.831757 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 17:07:09.831757 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 17:07:09.832791 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 17:07:09.832791 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 17:07:09.832791 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 17:07:09.832791 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 17:07:09.832791 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:07:09.832791 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:07:09.832791 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:07:09.832791 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:07:09.832791 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:07:09.832791 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:07:09.832791 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:07:09.832791 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application with Lock( Jun 16 17:07:09.832791 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:07:09.832791 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:07:09.832791 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:07:09.832791 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:07:09.834007 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:07:09.834007 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:07:09.834007 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:07:09.834007 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:07:09.834007 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 17:07:09.834007 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 17:07:09.834007 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 17:07:09.834007 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 17:07:09.834007 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 17:07:09.834007 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 17:07:09.834007 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 17:07:09.834007 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Jun 16 17:07:09.836391 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 280/548] 10.222.0.39 () {56 vars in 1102 bytes} [Thu Jun 16 17:07:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 343 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 17:07:09.837689 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491ae78b-1373-46fd-8d08-e13dcf74760f None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:09.879318 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3325a6b-e399-4054-a676-798fbc6f828c None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:09.945632 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6697e28-3b1b-4b14-a020-20b8a1dfb48f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:09.946379 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6697e28-3b1b-4b14-a020-20b8a1dfb48f None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:09.946662 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6697e28-3b1b-4b14-a020-20b8a1dfb48f None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:09.946938 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6697e28-3b1b-4b14-a020-20b8a1dfb48f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:09.971944 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6697e28-3b1b-4b14-a020-20b8a1dfb48f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:09.973380 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6697e28-3b1b-4b14-a020-20b8a1dfb48f None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:10.004932 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application [None req-c6697e28-3b1b-4b14-a020-20b8a1dfb48f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:07:10.004932 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:07:10.004932 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:07:10.004932 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:07:10.004932 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:07:10.004932 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:07:10.004932 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:07:10.004932 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:07:10.004932 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:07:10.004932 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:07:10.004932 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:07:10.004932 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:07:10.004932 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 17:07:10.004932 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 17:07:10.004932 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 17:07:10.005907 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 17:07:10.005907 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:07:10.005907 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:07:10.005907 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:07:10.005907 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:07:10.005907 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:07:10.005907 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:07:10.005907 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:07:10.005907 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application with Lock( Jun 16 17:07:10.005907 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:07:10.005907 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:07:10.005907 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:07:10.005907 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:07:10.005907 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:07:10.005907 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:07:10.005907 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:07:10.005907 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:07:10.006795 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 17:07:10.006795 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 17:07:10.006795 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:07:10.006795 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Jun 16 17:07:10.007573 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 269/549] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 17:07:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 336 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 17:07:10.011603 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6697e28-3b1b-4b14-a020-20b8a1dfb48f None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:10.037549 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491ae78b-1373-46fd-8d08-e13dcf74760f None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:10.092297 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04b7da4-478f-4f37-9f13-1c61fc3e482a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:10.092972 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04b7da4-478f-4f37-9f13-1c61fc3e482a None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:10.093260 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04b7da4-478f-4f37-9f13-1c61fc3e482a None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:10.093538 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04b7da4-478f-4f37-9f13-1c61fc3e482a None admin] PATH_INFO: `/v3/roles` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:10.094338 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04b7da4-478f-4f37-9f13-1c61fc3e482a None admin] RBAC: Adding query filter params (name=service) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:07:10.094651 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04b7da4-478f-4f37-9f13-1c61fc3e482a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:10.096031 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04b7da4-478f-4f37-9f13-1c61fc3e482a None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:10.105492 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 281/550] 10.222.0.39 () {56 vars in 1103 bytes} [Thu Jun 16 17:07:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 17:07:10.112201 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04b7da4-478f-4f37-9f13-1c61fc3e482a None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:10.138227 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:10.142663 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:10.225458 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6697e28-3b1b-4b14-a020-20b8a1dfb48f None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:10.268688 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04b7da4-478f-4f37-9f13-1c61fc3e482a None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:10.295118 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fb485b-3e98-41a4-8327-646774227d06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:10.295834 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fb485b-3e98-41a4-8327-646774227d06 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:10.296110 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fb485b-3e98-41a4-8327-646774227d06 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:10.296394 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fb485b-3e98-41a4-8327-646774227d06 None admin] PATH_INFO: `/v3/domains` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:10.297121 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fb485b-3e98-41a4-8327-646774227d06 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80873) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:07:10.298347 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fb485b-3e98-41a4-8327-646774227d06 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:10.299721 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fb485b-3e98-41a4-8327-646774227d06 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:10.319942 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 270/551] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 16 17:07:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:07:10.321385 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950055dc-bf4e-4da7-a912-0b7913de9a49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:10.321927 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4da4f1-9d1d-4ff5-8886-cfb631b252f9 None None] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:10.322239 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950055dc-bf4e-4da7-a912-0b7913de9a49 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:10.322522 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950055dc-bf4e-4da7-a912-0b7913de9a49 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:10.322796 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950055dc-bf4e-4da7-a912-0b7913de9a49 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:10.323112 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4da4f1-9d1d-4ff5-8886-cfb631b252f9 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:10.323618 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4da4f1-9d1d-4ff5-8886-cfb631b252f9 None None] PATH_INFO: `/` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:10.330656 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 271/552] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 17:07:10 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:07:10.333167 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4da4f1-9d1d-4ff5-8886-cfb631b252f9 None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:10.339402 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950055dc-bf4e-4da7-a912-0b7913de9a49 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:10.341260 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950055dc-bf4e-4da7-a912-0b7913de9a49 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:10.360525 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application [None req-950055dc-bf4e-4da7-a912-0b7913de9a49 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:07:10.360525 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:07:10.360525 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:07:10.360525 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:07:10.360525 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:07:10.360525 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:07:10.360525 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:07:10.360525 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:07:10.360525 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:07:10.360525 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:07:10.360525 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:07:10.360525 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:07:10.360525 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 17:07:10.360525 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 17:07:10.360525 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 17:07:10.366019 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 17:07:10.366019 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:07:10.366019 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:07:10.366019 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:07:10.366019 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:07:10.366019 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:07:10.366019 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:07:10.366019 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:07:10.366019 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application with Lock( Jun 16 17:07:10.366019 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:07:10.366019 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:07:10.366019 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:07:10.366019 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:07:10.366019 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:07:10.366019 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:07:10.366019 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:07:10.366019 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:07:10.366916 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 17:07:10.366916 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 17:07:10.366916 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:07:10.366916 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Jun 16 17:07:10.366916 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 282/553] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 17:07:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 17:07:10.366916 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67bbb2b-fd35-4f46-879d-94a6efaad11a None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:10.367259 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67bbb2b-fd35-4f46-879d-94a6efaad11a None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:10.367325 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67bbb2b-fd35-4f46-879d-94a6efaad11a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:10.386283 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-d67bbb2b-fd35-4f46-879d-94a6efaad11a None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:07:10.387543 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-d67bbb2b-fd35-4f46-879d-94a6efaad11a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:07:10.455678 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:10.466291 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 283/554] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 17:07:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 17:07:10.466291 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67bbb2b-fd35-4f46-879d-94a6efaad11a None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:10.479553 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4da4f1-9d1d-4ff5-8886-cfb631b252f9 None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:10.524268 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:10.536229 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bae1c3-533a-4d21-a6ba-3e51e2712833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:10.539342 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bae1c3-533a-4d21-a6ba-3e51e2712833 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:10.539342 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bae1c3-533a-4d21-a6ba-3e51e2712833 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:10.539342 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bae1c3-533a-4d21-a6ba-3e51e2712833 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:10.549472 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bae1c3-533a-4d21-a6ba-3e51e2712833 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:10.551829 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bae1c3-533a-4d21-a6ba-3e51e2712833 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:10.573303 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application [None req-60bae1c3-533a-4d21-a6ba-3e51e2712833 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 16 17:07:10.573303 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:07:10.573303 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:07:10.573303 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:07:10.573303 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:07:10.573303 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:07:10.573303 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:07:10.573303 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:07:10.573303 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:07:10.573303 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:07:10.573303 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:07:10.573303 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:07:10.573303 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 17:07:10.573303 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 17:07:10.573303 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 17:07:10.573303 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 17:07:10.574534 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:07:10.574534 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:07:10.574534 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 17:07:10.574534 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 17:07:10.574534 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 17:07:10.574534 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 17:07:10.574534 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:07:10.574534 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:07:10.574534 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:07:10.574534 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:07:10.574534 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:07:10.574534 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application with Lock( Jun 16 17:07:10.574534 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:07:10.574534 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:07:10.574534 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:07:10.574534 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:07:10.574534 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:07:10.574534 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:07:10.576212 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:07:10.576212 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:07:10.576212 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 17:07:10.576212 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 17:07:10.576212 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 17:07:10.576212 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 17:07:10.576212 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 17:07:10.576212 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 17:07:10.576212 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 16 17:07:10.576212 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Jun 16 17:07:10.576753 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67bbb2b-fd35-4f46-879d-94a6efaad11a None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:10.578746 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 272/555] 10.222.0.39 () {56 vars in 1096 bytes} [Thu Jun 16 17:07:10 2022] GET /identity/v3/users/swift => generated 83 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:07:10.580654 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bae1c3-533a-4d21-a6ba-3e51e2712833 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:10.630651 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cbe434-3e87-4de6-a2ab-d78e31a80d26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:10.631448 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cbe434-3e87-4de6-a2ab-d78e31a80d26 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:10.631811 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cbe434-3e87-4de6-a2ab-d78e31a80d26 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:10.632173 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cbe434-3e87-4de6-a2ab-d78e31a80d26 None admin] PATH_INFO: `/v3/domains` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:10.632997 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cbe434-3e87-4de6-a2ab-d78e31a80d26 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:07:10.633381 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cbe434-3e87-4de6-a2ab-d78e31a80d26 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:10.635448 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cbe434-3e87-4de6-a2ab-d78e31a80d26 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:10.661846 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 284/556] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 16 17:07:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:07:10.662761 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cbe434-3e87-4de6-a2ab-d78e31a80d26 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:10.724230 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bae1c3-533a-4d21-a6ba-3e51e2712833 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:10.729901 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:10.777657 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cbe434-3e87-4de6-a2ab-d78e31a80d26 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:10.777876 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037e6692-ffd0-4da2-a736-bf2b1515612a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:10.779388 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037e6692-ffd0-4da2-a736-bf2b1515612a None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:10.779688 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037e6692-ffd0-4da2-a736-bf2b1515612a None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:10.779973 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037e6692-ffd0-4da2-a736-bf2b1515612a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:10.799239 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037e6692-ffd0-4da2-a736-bf2b1515612a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 17:07:10.810743 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application [None req-037e6692-ffd0-4da2-a736-bf2b1515612a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 17:07:10.810743 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:07:10.810743 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:07:10.810743 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:07:10.810743 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:07:10.810743 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:07:10.810743 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:07:10.810743 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:07:10.810743 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:07:10.810743 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:07:10.810743 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:07:10.810743 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:07:10.810743 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 17:07:10.810743 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 17:07:10.810743 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 17:07:10.810743 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 17:07:10.811749 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 17:07:10.811749 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 17:07:10.811749 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 17:07:10.811749 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 17:07:10.811749 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:07:10.811749 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:07:10.811749 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:07:10.811749 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:07:10.811749 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:07:10.811749 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:07:10.811749 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:07:10.811749 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application with Lock( Jun 16 17:07:10.811749 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:07:10.811749 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:07:10.811749 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:07:10.811749 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:07:10.813042 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:07:10.813042 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:07:10.813042 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:07:10.813042 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:07:10.813042 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 17:07:10.813042 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 17:07:10.813042 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 17:07:10.813042 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 17:07:10.813042 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 17:07:10.813042 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 17:07:10.813042 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 17:07:10.813042 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Jun 16 17:07:10.813693 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 273/557] 10.222.0.39 () {56 vars in 1102 bytes} [Thu Jun 16 17:07:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:07:10.814284 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037e6692-ffd0-4da2-a736-bf2b1515612a None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:10.817943 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b45e899-16ce-417d-8efa-da7cffc4e32c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:10.817943 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b45e899-16ce-417d-8efa-da7cffc4e32c None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:10.817943 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b45e899-16ce-417d-8efa-da7cffc4e32c None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:10.817943 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b45e899-16ce-417d-8efa-da7cffc4e32c None admin] PATH_INFO: `/v3/users` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:10.818516 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b45e899-16ce-417d-8efa-da7cffc4e32c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:07:10.818832 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b45e899-16ce-417d-8efa-da7cffc4e32c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:10.820376 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b45e899-16ce-417d-8efa-da7cffc4e32c None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:10.839703 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 285/558] 10.222.0.39 () {56 vars in 1135 bytes} [Thu Jun 16 17:07:10 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:07:10.842154 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3e31ba-1e1d-4df2-9764-5c21ccf82ed3 None None] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:10.842669 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3e31ba-1e1d-4df2-9764-5c21ccf82ed3 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:10.843306 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3e31ba-1e1d-4df2-9764-5c21ccf82ed3 None None] PATH_INFO: `/` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:10.845314 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 286/559] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 17:07:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:07:10.846311 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3e31ba-1e1d-4df2-9764-5c21ccf82ed3 None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:10.871782 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:10.928961 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037e6692-ffd0-4da2-a736-bf2b1515612a None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:10.964872 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64220f6-b05f-475a-a2d7-651c2d4b810e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:10.965079 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3e31ba-1e1d-4df2-9764-5c21ccf82ed3 None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:10.966389 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64220f6-b05f-475a-a2d7-651c2d4b810e None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:10.966677 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64220f6-b05f-475a-a2d7-651c2d4b810e None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:10.967141 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64220f6-b05f-475a-a2d7-651c2d4b810e None admin] PATH_INFO: `/v3/users/glance` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:10.976046 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64220f6-b05f-475a-a2d7-651c2d4b810e None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:10.977507 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64220f6-b05f-475a-a2d7-651c2d4b810e None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:10.985044 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:10.992547 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application [None req-b64220f6-b05f-475a-a2d7-651c2d4b810e None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 16 17:07:10.992547 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:07:10.992547 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:07:10.992547 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:07:10.992547 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:07:10.992547 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:07:10.992547 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:07:10.992547 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:07:10.992547 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:07:10.992547 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:07:10.992547 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:07:10.992547 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:07:10.992547 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 17:07:10.992547 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 17:07:10.992547 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 17:07:10.992547 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 17:07:10.993572 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:07:10.993572 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:07:10.993572 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 17:07:10.993572 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 17:07:10.993572 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 17:07:10.993572 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 17:07:10.993572 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:07:10.993572 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:07:10.993572 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:07:10.993572 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:07:10.993572 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:07:10.993572 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application with Lock( Jun 16 17:07:10.993572 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:07:10.993572 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:07:10.993572 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:07:10.993572 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:07:10.993572 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:07:10.993572 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:07:10.994570 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:07:10.994570 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:07:10.994570 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 17:07:10.994570 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 17:07:10.994570 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 17:07:10.994570 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 17:07:10.994570 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 17:07:10.994570 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 17:07:10.994570 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 16 17:07:10.994570 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Jun 16 17:07:10.994570 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 274/560] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 16 17:07:10 2022] GET /identity/v3/users/glance => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:07:10.994570 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64220f6-b05f-475a-a2d7-651c2d4b810e None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:11.009050 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb698d5-0fe7-4157-94d8-8b2cfe5f6645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:11.010045 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb698d5-0fe7-4157-94d8-8b2cfe5f6645 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:11.010339 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb698d5-0fe7-4157-94d8-8b2cfe5f6645 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:11.010617 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb698d5-0fe7-4157-94d8-8b2cfe5f6645 None admin] PATH_INFO: `/v3/roles` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:11.011381 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb698d5-0fe7-4157-94d8-8b2cfe5f6645 None admin] RBAC: Adding query filter params (name=service) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:07:11.011696 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb698d5-0fe7-4157-94d8-8b2cfe5f6645 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:11.013216 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb698d5-0fe7-4157-94d8-8b2cfe5f6645 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:11.023180 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 287/561] 10.222.0.39 () {56 vars in 1103 bytes} [Thu Jun 16 17:07:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:07:11.024401 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ba881c-930b-476a-934a-1b81d41d0fb9 None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:11.024698 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ba881c-930b-476a-934a-1b81d41d0fb9 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:11.024988 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ba881c-930b-476a-934a-1b81d41d0fb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:11.043102 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-88ba881c-930b-476a-934a-1b81d41d0fb9 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:07:11.045292 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-88ba881c-930b-476a-934a-1b81d41d0fb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:07:11.111522 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64220f6-b05f-475a-a2d7-651c2d4b810e None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:11.121524 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:11.127771 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 288/562] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 17:07:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 17:07:11.128620 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ba881c-930b-476a-934a-1b81d41d0fb9 None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:11.162532 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653e0e12-6f90-455b-9985-5d737cf11838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:11.163195 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653e0e12-6f90-455b-9985-5d737cf11838 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:11.163487 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653e0e12-6f90-455b-9985-5d737cf11838 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:11.163770 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653e0e12-6f90-455b-9985-5d737cf11838 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:11.226145 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ba881c-930b-476a-934a-1b81d41d0fb9 None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:11.230224 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653e0e12-6f90-455b-9985-5d737cf11838 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:11.231716 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653e0e12-6f90-455b-9985-5d737cf11838 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:11.235448 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:11.260271 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d44d946-af8b-402c-82c4-0fd6ca5d5b02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:11.260946 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d44d946-af8b-402c-82c4-0fd6ca5d5b02 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:11.261233 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d44d946-af8b-402c-82c4-0fd6ca5d5b02 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:11.261519 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d44d946-af8b-402c-82c4-0fd6ca5d5b02 None admin] PATH_INFO: `/v3/users` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:11.262409 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d44d946-af8b-402c-82c4-0fd6ca5d5b02 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:07:11.263370 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d44d946-af8b-402c-82c4-0fd6ca5d5b02 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:11.265492 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d44d946-af8b-402c-82c4-0fd6ca5d5b02 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:11.282729 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 289/563] 10.222.0.39 () {56 vars in 1137 bytes} [Thu Jun 16 17:07:11 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:07:11.283582 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d44d946-af8b-402c-82c4-0fd6ca5d5b02 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:11.340281 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 275/564] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 16 17:07:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 17:07:11.341790 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03dabfa-c46f-4ba6-bfbf-e05fe3ded424 None None] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:11.342094 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03dabfa-c46f-4ba6-bfbf-e05fe3ded424 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:11.342375 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03dabfa-c46f-4ba6-bfbf-e05fe3ded424 None None] PATH_INFO: `/` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:11.343697 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 276/565] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 17:07:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:07:11.344399 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03dabfa-c46f-4ba6-bfbf-e05fe3ded424 None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:11.358357 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:11.409254 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d44d946-af8b-402c-82c4-0fd6ca5d5b02 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:11.446555 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cec4880-90bd-4d31-ad57-fa932675ef21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:11.447668 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cec4880-90bd-4d31-ad57-fa932675ef21 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:11.447668 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cec4880-90bd-4d31-ad57-fa932675ef21 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:11.447922 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cec4880-90bd-4d31-ad57-fa932675ef21 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:11.455709 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03dabfa-c46f-4ba6-bfbf-e05fe3ded424 None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:11.459239 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cec4880-90bd-4d31-ad57-fa932675ef21 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:11.460708 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cec4880-90bd-4d31-ad57-fa932675ef21 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:11.479530 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application [None req-5cec4880-90bd-4d31-ad57-fa932675ef21 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:07:11.479530 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:07:11.479530 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:07:11.479530 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:07:11.479530 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:07:11.479530 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:07:11.479530 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:07:11.479530 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:07:11.479530 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:07:11.479530 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:07:11.479530 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:07:11.479530 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:07:11.479530 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 17:07:11.479530 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 17:07:11.479530 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 17:07:11.480710 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 17:07:11.480710 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:07:11.480710 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:07:11.480710 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:07:11.480710 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:07:11.480710 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:07:11.480710 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:07:11.480710 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:07:11.480710 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application with Lock( Jun 16 17:07:11.480710 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:07:11.480710 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:07:11.480710 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:07:11.480710 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:07:11.480710 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:07:11.480710 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:07:11.480710 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:07:11.480710 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:07:11.481615 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 17:07:11.481615 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 17:07:11.481615 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:07:11.481615 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Jun 16 17:07:11.481615 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 290/566] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 17:07:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:07:11.482135 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cec4880-90bd-4d31-ad57-fa932675ef21 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:11.497179 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2b7e85-e600-44cc-92ff-7c0fb4d5aad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:11.497938 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2b7e85-e600-44cc-92ff-7c0fb4d5aad9 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:11.498229 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2b7e85-e600-44cc-92ff-7c0fb4d5aad9 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:11.498509 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2b7e85-e600-44cc-92ff-7c0fb4d5aad9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:11.501043 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:11.509910 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2b7e85-e600-44cc-92ff-7c0fb4d5aad9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 17:07:11.518312 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application [None req-fb2b7e85-e600-44cc-92ff-7c0fb4d5aad9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 17:07:11.518312 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:07:11.518312 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:07:11.518312 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:07:11.518312 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:07:11.518312 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:07:11.518312 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:07:11.518312 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:07:11.518312 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:07:11.518312 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:07:11.518312 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:07:11.518312 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:07:11.518312 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 17:07:11.518312 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 17:07:11.518312 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 17:07:11.518312 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 17:07:11.519339 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 17:07:11.519339 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 17:07:11.519339 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 17:07:11.519339 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 17:07:11.519339 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:07:11.519339 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:07:11.519339 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:07:11.519339 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:07:11.519339 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:07:11.519339 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:07:11.519339 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:07:11.519339 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application with Lock( Jun 16 17:07:11.519339 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:07:11.519339 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:07:11.519339 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:07:11.519339 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:07:11.525592 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:07:11.525592 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:07:11.525592 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:07:11.525592 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:07:11.525592 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 17:07:11.525592 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 17:07:11.525592 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 17:07:11.525592 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 17:07:11.525592 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 17:07:11.525592 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 17:07:11.525592 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 17:07:11.525592 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Jun 16 17:07:11.525592 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 277/567] 10.222.0.39 () {56 vars in 1102 bytes} [Thu Jun 16 17:07:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:07:11.525592 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2b7e85-e600-44cc-92ff-7c0fb4d5aad9 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:11.586552 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cec4880-90bd-4d31-ad57-fa932675ef21 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:11.597232 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:11.627430 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c92966-f5ec-4a40-b2a2-68c278a939e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:11.628235 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c92966-f5ec-4a40-b2a2-68c278a939e6 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:11.628524 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c92966-f5ec-4a40-b2a2-68c278a939e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:11.628809 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c92966-f5ec-4a40-b2a2-68c278a939e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:11.635634 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2b7e85-e600-44cc-92ff-7c0fb4d5aad9 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:11.641625 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c92966-f5ec-4a40-b2a2-68c278a939e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:11.643140 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c92966-f5ec-4a40-b2a2-68c278a939e6 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:11.662405 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application [None req-d2c92966-f5ec-4a40-b2a2-68c278a939e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:07:11.662405 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:07:11.662405 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:07:11.662405 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:07:11.662405 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:07:11.662405 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:07:11.662405 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:07:11.662405 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:07:11.662405 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:07:11.662405 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:07:11.662405 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:07:11.662405 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:07:11.662405 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 17:07:11.662405 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 17:07:11.662405 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 17:07:11.663377 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 17:07:11.663377 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:07:11.663377 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:07:11.663377 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:07:11.663377 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:07:11.663377 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:07:11.663377 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:07:11.663377 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:07:11.663377 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application with Lock( Jun 16 17:07:11.663377 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:07:11.663377 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:07:11.663377 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:07:11.663377 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:07:11.663377 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:07:11.663377 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:07:11.663377 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:07:11.663377 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:07:11.664264 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 17:07:11.664264 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 17:07:11.664264 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:07:11.664264 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Jun 16 17:07:11.664264 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 291/568] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 17:07:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:07:11.664880 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bac366-d6fa-4265-9225-738300c64c99 None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:11.665167 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bac366-d6fa-4265-9225-738300c64c99 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:11.665446 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bac366-d6fa-4265-9225-738300c64c99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:11.678238 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e323d7c-49d9-4a81-949c-99d0eda17ab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:11.679040 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e323d7c-49d9-4a81-949c-99d0eda17ab8 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:11.679333 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e323d7c-49d9-4a81-949c-99d0eda17ab8 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:11.679618 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e323d7c-49d9-4a81-949c-99d0eda17ab8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:11.687358 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-12bac366-d6fa-4265-9225-738300c64c99 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:07:11.688597 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-12bac366-d6fa-4265-9225-738300c64c99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:07:11.696769 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e323d7c-49d9-4a81-949c-99d0eda17ab8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:11.698326 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e323d7c-49d9-4a81-949c-99d0eda17ab8 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:11.717471 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application [None req-9e323d7c-49d9-4a81-949c-99d0eda17ab8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:07:11.717471 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:07:11.717471 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:07:11.717471 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:07:11.717471 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:07:11.717471 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:07:11.717471 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:07:11.717471 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:07:11.717471 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:07:11.717471 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:07:11.717471 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:07:11.717471 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:07:11.717471 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 17:07:11.717471 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 17:07:11.717471 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 17:07:11.718483 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 17:07:11.718483 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:07:11.718483 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:07:11.718483 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:07:11.718483 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:07:11.718483 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:07:11.718483 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:07:11.718483 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:07:11.718483 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application with Lock( Jun 16 17:07:11.718483 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:07:11.718483 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:07:11.718483 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:07:11.718483 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:07:11.718483 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:07:11.718483 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:07:11.718483 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:07:11.718483 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:07:11.719395 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 17:07:11.719395 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 17:07:11.719395 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:07:11.719395 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Jun 16 17:07:11.719395 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 278/569] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 17:07:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:07:11.719675 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e323d7c-49d9-4a81-949c-99d0eda17ab8 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:11.757132 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:11.761970 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 292/570] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 17:07:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 17:07:11.763383 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bac366-d6fa-4265-9225-738300c64c99 None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:11.830876 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e323d7c-49d9-4a81-949c-99d0eda17ab8 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:11.851542 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:11.866199 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88567151-405b-4deb-81b6-c6cd405fcccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:11.866861 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88567151-405b-4deb-81b6-c6cd405fcccd None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:11.867147 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88567151-405b-4deb-81b6-c6cd405fcccd None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:11.867429 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88567151-405b-4deb-81b6-c6cd405fcccd None admin] PATH_INFO: `/v3/domains` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:11.868151 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88567151-405b-4deb-81b6-c6cd405fcccd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80873) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:07:11.868462 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88567151-405b-4deb-81b6-c6cd405fcccd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:11.869152 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bac366-d6fa-4265-9225-738300c64c99 None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:11.869848 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88567151-405b-4deb-81b6-c6cd405fcccd None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:11.883765 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 279/571] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 16 17:07:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:07:11.884158 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88567151-405b-4deb-81b6-c6cd405fcccd None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:11.909358 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e48dd4-69d5-4623-a583-f69df15e94f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:11.910057 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e48dd4-69d5-4623-a583-f69df15e94f3 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:11.910347 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e48dd4-69d5-4623-a583-f69df15e94f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:11.910629 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e48dd4-69d5-4623-a583-f69df15e94f3 None admin] PATH_INFO: `/v3/roles` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:11.911384 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e48dd4-69d5-4623-a583-f69df15e94f3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:07:11.911696 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e48dd4-69d5-4623-a583-f69df15e94f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:11.913060 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e48dd4-69d5-4623-a583-f69df15e94f3 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:11.921738 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 293/572] 10.222.0.39 () {56 vars in 1103 bytes} [Thu Jun 16 17:07:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:07:11.922551 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e48dd4-69d5-4623-a583-f69df15e94f3 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:11.984224 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:11.988669 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88567151-405b-4deb-81b6-c6cd405fcccd None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:12.023330 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e48dd4-69d5-4623-a583-f69df15e94f3 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:12.023506 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bfe3fc-9bd6-48e5-911c-01caf0749b6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:12.023956 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bfe3fc-9bd6-48e5-911c-01caf0749b6d None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:12.024242 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bfe3fc-9bd6-48e5-911c-01caf0749b6d None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:12.024518 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bfe3fc-9bd6-48e5-911c-01caf0749b6d None admin] PATH_INFO: `/v3/domains` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:12.025240 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bfe3fc-9bd6-48e5-911c-01caf0749b6d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80873) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:07:12.025546 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bfe3fc-9bd6-48e5-911c-01caf0749b6d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:12.026936 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bfe3fc-9bd6-48e5-911c-01caf0749b6d None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:12.038137 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 280/573] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 16 17:07:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:07:12.038923 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bfe3fc-9bd6-48e5-911c-01caf0749b6d None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:12.058060 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3fb7f2-c80b-4030-96e7-56a0533e8eb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:12.058726 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3fb7f2-c80b-4030-96e7-56a0533e8eb2 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:12.059015 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3fb7f2-c80b-4030-96e7-56a0533e8eb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:12.059306 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3fb7f2-c80b-4030-96e7-56a0533e8eb2 None admin] PATH_INFO: `/v3/domains` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:12.060679 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3fb7f2-c80b-4030-96e7-56a0533e8eb2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:07:12.061032 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3fb7f2-c80b-4030-96e7-56a0533e8eb2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:12.062400 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3fb7f2-c80b-4030-96e7-56a0533e8eb2 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:12.074108 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 294/574] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 16 17:07:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:07:12.074903 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3fb7f2-c80b-4030-96e7-56a0533e8eb2 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:12.085443 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:12.144155 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bfe3fc-9bd6-48e5-911c-01caf0749b6d None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:12.172840 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3fb7f2-c80b-4030-96e7-56a0533e8eb2 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:12.177107 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ea4e21-2a9f-49c1-9d5c-32fc61854d8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:12.177941 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ea4e21-2a9f-49c1-9d5c-32fc61854d8d None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:12.178234 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ea4e21-2a9f-49c1-9d5c-32fc61854d8d None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:12.178519 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ea4e21-2a9f-49c1-9d5c-32fc61854d8d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:12.189304 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ea4e21-2a9f-49c1-9d5c-32fc61854d8d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 17:07:12.195098 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:12.197055 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application [None req-98ea4e21-2a9f-49c1-9d5c-32fc61854d8d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 17:07:12.197055 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:07:12.197055 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:07:12.197055 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:07:12.197055 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:07:12.197055 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:07:12.197055 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:07:12.197055 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:07:12.197055 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:07:12.197055 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:07:12.197055 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:07:12.197055 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:07:12.197055 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 17:07:12.197055 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 17:07:12.197055 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 17:07:12.197055 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 17:07:12.198206 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 17:07:12.198206 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 17:07:12.198206 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 17:07:12.198206 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 17:07:12.198206 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:07:12.198206 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:07:12.198206 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:07:12.198206 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:07:12.198206 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:07:12.198206 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:07:12.198206 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:07:12.198206 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application with Lock( Jun 16 17:07:12.198206 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:07:12.198206 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:07:12.198206 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:07:12.198206 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:07:12.199057 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:07:12.199057 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:07:12.199057 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:07:12.199057 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:07:12.199057 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 17:07:12.199057 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 17:07:12.199057 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 17:07:12.199057 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 17:07:12.199057 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 17:07:12.199057 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 17:07:12.199057 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 17:07:12.199057 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Jun 16 17:07:12.199057 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 281/575] 10.222.0.39 () {56 vars in 1102 bytes} [Thu Jun 16 17:07:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:07:12.199057 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ea4e21-2a9f-49c1-9d5c-32fc61854d8d None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:12.211316 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87365cc1-8f55-49ee-89a0-c795b7eb8be5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:12.212114 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87365cc1-8f55-49ee-89a0-c795b7eb8be5 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:12.212406 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87365cc1-8f55-49ee-89a0-c795b7eb8be5 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:12.212689 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87365cc1-8f55-49ee-89a0-c795b7eb8be5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:12.220498 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87365cc1-8f55-49ee-89a0-c795b7eb8be5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:12.221998 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87365cc1-8f55-49ee-89a0-c795b7eb8be5 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:12.237027 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application [None req-87365cc1-8f55-49ee-89a0-c795b7eb8be5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 16 17:07:12.237027 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:07:12.237027 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:07:12.237027 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:07:12.237027 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:07:12.237027 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:07:12.237027 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:07:12.237027 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:07:12.237027 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:07:12.237027 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:07:12.237027 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:07:12.237027 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:07:12.237027 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 17:07:12.237027 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 17:07:12.237027 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 17:07:12.237027 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 17:07:12.238045 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:07:12.238045 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:07:12.238045 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 17:07:12.238045 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 17:07:12.238045 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 17:07:12.238045 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 17:07:12.238045 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:07:12.238045 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:07:12.238045 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:07:12.238045 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:07:12.238045 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:07:12.238045 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application with Lock( Jun 16 17:07:12.238045 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:07:12.238045 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:07:12.238045 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:07:12.238045 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:07:12.238045 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:07:12.238045 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:07:12.239004 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:07:12.239004 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:07:12.239004 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 17:07:12.239004 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 17:07:12.239004 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 17:07:12.239004 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 17:07:12.239004 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 17:07:12.239004 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 17:07:12.239004 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 16 17:07:12.239004 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Jun 16 17:07:12.239004 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 295/576] 10.222.0.39 () {56 vars in 1093 bytes} [Thu Jun 16 17:07:12 2022] GET /identity/v3/users/nova => generated 82 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:07:12.239004 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87365cc1-8f55-49ee-89a0-c795b7eb8be5 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:12.299792 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:12.302607 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ea4e21-2a9f-49c1-9d5c-32fc61854d8d None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:12.337540 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feae6a7e-3dea-4d04-b3b2-6e93be0e7d41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:12.338375 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feae6a7e-3dea-4d04-b3b2-6e93be0e7d41 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:12.338667 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feae6a7e-3dea-4d04-b3b2-6e93be0e7d41 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:12.338949 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feae6a7e-3dea-4d04-b3b2-6e93be0e7d41 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:12.339504 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87365cc1-8f55-49ee-89a0-c795b7eb8be5 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:12.351039 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feae6a7e-3dea-4d04-b3b2-6e93be0e7d41 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:12.352554 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feae6a7e-3dea-4d04-b3b2-6e93be0e7d41 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:12.370800 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application [None req-feae6a7e-3dea-4d04-b3b2-6e93be0e7d41 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:07:12.370800 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:07:12.370800 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:07:12.370800 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:07:12.370800 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:07:12.370800 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:07:12.370800 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:07:12.370800 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:07:12.370800 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:07:12.370800 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:07:12.370800 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:07:12.370800 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:07:12.370800 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 17:07:12.370800 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 17:07:12.370800 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 17:07:12.372754 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 17:07:12.372754 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:07:12.372754 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:07:12.372754 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:07:12.372754 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:07:12.372754 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:07:12.372754 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:07:12.372754 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:07:12.372754 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application with Lock( Jun 16 17:07:12.372754 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:07:12.372754 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:07:12.372754 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:07:12.372754 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:07:12.372754 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:07:12.372754 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:07:12.372754 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:07:12.372754 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:07:12.374136 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 17:07:12.374136 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 17:07:12.374136 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:07:12.374136 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Jun 16 17:07:12.374136 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 282/577] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 17:07:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:07:12.374136 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feae6a7e-3dea-4d04-b3b2-6e93be0e7d41 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:12.386144 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48305f27-b928-4e95-9fc1-f3a806cac1f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:12.387026 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48305f27-b928-4e95-9fc1-f3a806cac1f9 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:12.387321 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48305f27-b928-4e95-9fc1-f3a806cac1f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:12.388241 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48305f27-b928-4e95-9fc1-f3a806cac1f9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:12.395223 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48305f27-b928-4e95-9fc1-f3a806cac1f9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:12.399634 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48305f27-b928-4e95-9fc1-f3a806cac1f9 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:12.410418 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application [None req-48305f27-b928-4e95-9fc1-f3a806cac1f9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 17:07:12.410418 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:07:12.410418 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:07:12.410418 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:07:12.410418 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:07:12.410418 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:07:12.410418 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:07:12.410418 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:07:12.410418 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:07:12.410418 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:07:12.410418 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:07:12.410418 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:07:12.410418 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 17:07:12.410418 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 17:07:12.410418 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 17:07:12.411504 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 17:07:12.411504 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:07:12.411504 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:07:12.411504 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:07:12.411504 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:07:12.411504 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:07:12.411504 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:07:12.411504 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:07:12.411504 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application with Lock( Jun 16 17:07:12.411504 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:07:12.411504 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:07:12.411504 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:07:12.411504 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:07:12.411504 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:07:12.411504 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:07:12.411504 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:07:12.411504 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:07:12.412452 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 17:07:12.412452 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 17:07:12.412452 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 17:07:12.412452 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 17:07:12.412452 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 17:07:12.412452 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 17:07:12.412452 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 17:07:12.412452 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Jun 16 17:07:12.412452 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 296/578] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 16 17:07:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:07:12.412987 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48305f27-b928-4e95-9fc1-f3a806cac1f9 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:12.499382 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:12.526530 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feae6a7e-3dea-4d04-b3b2-6e93be0e7d41 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:12.557725 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48305f27-b928-4e95-9fc1-f3a806cac1f9 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:12.560066 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf83f9b-536c-4a24-ae9c-302f07189a74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:12.560863 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf83f9b-536c-4a24-ae9c-302f07189a74 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:12.561150 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf83f9b-536c-4a24-ae9c-302f07189a74 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:12.561430 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf83f9b-536c-4a24-ae9c-302f07189a74 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:12.568112 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf83f9b-536c-4a24-ae9c-302f07189a74 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:12.569581 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf83f9b-536c-4a24-ae9c-302f07189a74 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:12.584082 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application [None req-fbf83f9b-536c-4a24-ae9c-302f07189a74 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 17:07:12.584082 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:07:12.584082 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:07:12.584082 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:07:12.584082 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:07:12.584082 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:07:12.584082 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:07:12.584082 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:07:12.584082 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:07:12.584082 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:07:12.584082 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:07:12.584082 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:07:12.584082 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 17:07:12.584082 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 17:07:12.584082 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 17:07:12.585005 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 17:07:12.585005 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:07:12.585005 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:07:12.585005 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:07:12.585005 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:07:12.585005 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:07:12.585005 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:07:12.585005 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:07:12.585005 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application with Lock( Jun 16 17:07:12.585005 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:07:12.585005 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:07:12.585005 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:07:12.585005 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:07:12.585005 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:07:12.585005 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:07:12.585005 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:07:12.585005 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:07:12.586496 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 17:07:12.586496 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 17:07:12.586496 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 17:07:12.586496 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 17:07:12.586496 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 17:07:12.586496 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 17:07:12.586496 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 17:07:12.586496 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Jun 16 17:07:12.586496 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 283/579] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 16 17:07:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:07:12.586496 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf83f9b-536c-4a24-ae9c-302f07189a74 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:12.596488 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5debfdd9-d023-4068-98ba-c140ca26d0b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:12.597154 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5debfdd9-d023-4068-98ba-c140ca26d0b8 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:12.597444 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5debfdd9-d023-4068-98ba-c140ca26d0b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:12.598094 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5debfdd9-d023-4068-98ba-c140ca26d0b8 None admin] PATH_INFO: `/v3/roles` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:12.598842 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5debfdd9-d023-4068-98ba-c140ca26d0b8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:07:12.599463 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5debfdd9-d023-4068-98ba-c140ca26d0b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:12.601108 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5debfdd9-d023-4068-98ba-c140ca26d0b8 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:12.601916 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:12.609387 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 297/580] 10.222.0.39 () {56 vars in 1103 bytes} [Thu Jun 16 17:07:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:07:12.611656 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5debfdd9-d023-4068-98ba-c140ca26d0b8 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:12.692400 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf83f9b-536c-4a24-ae9c-302f07189a74 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:12.725955 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5debfdd9-d023-4068-98ba-c140ca26d0b8 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:12.728396 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:12.728905 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a0a24a-3af5-41d3-8cd5-64393fb0965d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:12.729594 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a0a24a-3af5-41d3-8cd5-64393fb0965d None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:12.729913 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a0a24a-3af5-41d3-8cd5-64393fb0965d None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:12.730192 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a0a24a-3af5-41d3-8cd5-64393fb0965d None admin] PATH_INFO: `/v3/users` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:12.731032 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a0a24a-3af5-41d3-8cd5-64393fb0965d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80873) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:07:12.731996 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a0a24a-3af5-41d3-8cd5-64393fb0965d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:12.733402 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a0a24a-3af5-41d3-8cd5-64393fb0965d None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:12.750800 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 284/581] 10.222.0.39 () {56 vars in 1133 bytes} [Thu Jun 16 17:07:12 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:07:12.751619 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a0a24a-3af5-41d3-8cd5-64393fb0965d None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:12.759416 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56929918-4e6d-4610-940a-a910759caa00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:12.760125 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56929918-4e6d-4610-940a-a910759caa00 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:12.760676 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56929918-4e6d-4610-940a-a910759caa00 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:12.760954 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56929918-4e6d-4610-940a-a910759caa00 None admin] PATH_INFO: `/v3/domains` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:12.761676 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56929918-4e6d-4610-940a-a910759caa00 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:07:12.762266 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56929918-4e6d-4610-940a-a910759caa00 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:12.764740 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56929918-4e6d-4610-940a-a910759caa00 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:12.780474 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 298/582] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 16 17:07:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:07:12.780474 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56929918-4e6d-4610-940a-a910759caa00 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:12.821373 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:12.850797 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a0a24a-3af5-41d3-8cd5-64393fb0965d None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:12.877028 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56929918-4e6d-4610-940a-a910759caa00 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:12.890354 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dfea42-c7da-4105-a8ab-e414534c4081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:12.891113 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dfea42-c7da-4105-a8ab-e414534c4081 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:12.891307 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dfea42-c7da-4105-a8ab-e414534c4081 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:12.891873 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dfea42-c7da-4105-a8ab-e414534c4081 None admin] PATH_INFO: `/v3/projects` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:12.892384 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dfea42-c7da-4105-a8ab-e414534c4081 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80873) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:07:12.892704 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dfea42-c7da-4105-a8ab-e414534c4081 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:12.894160 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dfea42-c7da-4105-a8ab-e414534c4081 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:12.906582 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 285/583] 10.222.0.39 () {56 vars in 1148 bytes} [Thu Jun 16 17:07:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:07:12.907414 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dfea42-c7da-4105-a8ab-e414534c4081 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:12.913538 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14cc823-f0cf-4aad-a935-c45ce8020dcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:12.914242 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14cc823-f0cf-4aad-a935-c45ce8020dcd None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:12.914537 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14cc823-f0cf-4aad-a935-c45ce8020dcd None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:12.914819 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14cc823-f0cf-4aad-a935-c45ce8020dcd None admin] PATH_INFO: `/v3/projects` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:12.915639 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14cc823-f0cf-4aad-a935-c45ce8020dcd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:07:12.915960 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14cc823-f0cf-4aad-a935-c45ce8020dcd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:12.917384 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14cc823-f0cf-4aad-a935-c45ce8020dcd None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:12.934053 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 299/584] 10.222.0.39 () {56 vars in 1148 bytes} [Thu Jun 16 17:07:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:07:12.934053 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14cc823-f0cf-4aad-a935-c45ce8020dcd None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:12.962939 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:13.006363 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dfea42-c7da-4105-a8ab-e414534c4081 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:13.034926 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:13.038987 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14cc823-f0cf-4aad-a935-c45ce8020dcd None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:13.040301 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a102f019-1502-4ef6-b339-f84e51399e56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:13.041086 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a102f019-1502-4ef6-b339-f84e51399e56 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:13.041375 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a102f019-1502-4ef6-b339-f84e51399e56 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:13.041653 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a102f019-1502-4ef6-b339-f84e51399e56 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:13.052236 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a102f019-1502-4ef6-b339-f84e51399e56 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:13.057813 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a102f019-1502-4ef6-b339-f84e51399e56 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:13.070224 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application [None req-a102f019-1502-4ef6-b339-f84e51399e56 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:07:13.070224 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:07:13.070224 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:07:13.070224 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:07:13.070224 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:07:13.070224 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:07:13.070224 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:07:13.070224 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:07:13.070224 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:07:13.070224 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:07:13.070224 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:07:13.070224 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:07:13.070224 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 17:07:13.070224 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 17:07:13.070224 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 17:07:13.071364 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 17:07:13.071364 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:07:13.071364 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:07:13.071364 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:07:13.071364 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:07:13.071364 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:07:13.071364 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:07:13.071364 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:07:13.071364 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application with Lock( Jun 16 17:07:13.071364 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:07:13.071364 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:07:13.071364 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:07:13.071364 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:07:13.071364 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:07:13.071364 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:07:13.071364 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:07:13.071364 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:07:13.072297 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 17:07:13.072297 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 17:07:13.072297 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:07:13.072297 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Jun 16 17:07:13.072297 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 286/585] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 17:07:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:07:13.072606 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3d593d-0e5b-431f-b86f-7bd1ab8644df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:13.072697 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a102f019-1502-4ef6-b339-f84e51399e56 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:13.072774 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3d593d-0e5b-431f-b86f-7bd1ab8644df None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:13.073035 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3d593d-0e5b-431f-b86f-7bd1ab8644df None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:13.073259 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3d593d-0e5b-431f-b86f-7bd1ab8644df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:13.087225 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3d593d-0e5b-431f-b86f-7bd1ab8644df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:13.088677 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3d593d-0e5b-431f-b86f-7bd1ab8644df None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:13.106624 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application [None req-ef3d593d-0e5b-431f-b86f-7bd1ab8644df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:07:13.106624 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:07:13.106624 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:07:13.106624 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:07:13.106624 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:07:13.106624 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:07:13.106624 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:07:13.106624 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:07:13.106624 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:07:13.106624 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:07:13.106624 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:07:13.106624 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:07:13.106624 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 17:07:13.106624 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 17:07:13.106624 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 17:07:13.107549 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 17:07:13.107549 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:07:13.107549 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:07:13.107549 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:07:13.107549 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:07:13.107549 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:07:13.107549 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:07:13.107549 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:07:13.107549 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application with Lock( Jun 16 17:07:13.107549 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:07:13.107549 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:07:13.107549 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:07:13.107549 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:07:13.107549 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:07:13.107549 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:07:13.107549 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:07:13.107549 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:07:13.108438 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 17:07:13.108438 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 17:07:13.108438 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:07:13.108438 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Jun 16 17:07:13.108438 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 300/586] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 17:07:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:07:13.108873 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3d593d-0e5b-431f-b86f-7bd1ab8644df None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:13.178169 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a102f019-1502-4ef6-b339-f84e51399e56 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:13.184952 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:13.207480 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3d593d-0e5b-431f-b86f-7bd1ab8644df None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:13.212366 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3069765d-d96d-4919-8670-16a7d27206d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:13.213165 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3069765d-d96d-4919-8670-16a7d27206d9 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:13.213456 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3069765d-d96d-4919-8670-16a7d27206d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:13.213742 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3069765d-d96d-4919-8670-16a7d27206d9 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:13.222868 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3069765d-d96d-4919-8670-16a7d27206d9 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:13.224302 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3069765d-d96d-4919-8670-16a7d27206d9 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:13.239395 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application [None req-3069765d-d96d-4919-8670-16a7d27206d9 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 16 17:07:13.239395 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:07:13.239395 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:07:13.239395 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:07:13.239395 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:07:13.239395 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:07:13.239395 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:07:13.239395 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:07:13.239395 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:07:13.239395 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:07:13.239395 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:07:13.239395 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:07:13.239395 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 17:07:13.239395 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 17:07:13.239395 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 17:07:13.239395 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 17:07:13.240363 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:07:13.240363 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:07:13.240363 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 17:07:13.240363 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 17:07:13.240363 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 17:07:13.240363 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 17:07:13.240363 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:07:13.240363 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:07:13.240363 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:07:13.240363 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:07:13.240363 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:07:13.240363 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application with Lock( Jun 16 17:07:13.240363 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:07:13.240363 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:07:13.240363 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:07:13.240363 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:07:13.240363 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:07:13.240363 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:07:13.241346 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:07:13.241346 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:07:13.241346 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 17:07:13.241346 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 17:07:13.241346 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 17:07:13.241346 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 17:07:13.241346 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 17:07:13.241346 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 17:07:13.241346 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 16 17:07:13.241346 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Jun 16 17:07:13.241346 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 287/587] 10.222.0.39 () {56 vars in 1102 bytes} [Thu Jun 16 17:07:13 2022] GET /identity/v3/users/neutron => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:07:13.241346 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3069765d-d96d-4919-8670-16a7d27206d9 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:13.246398 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac1afbd-e1cc-4cdb-a1e6-80ed6b3f49ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:13.247296 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac1afbd-e1cc-4cdb-a1e6-80ed6b3f49ad None admin] REQUEST_METHOD: `PUT` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:13.247584 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac1afbd-e1cc-4cdb-a1e6-80ed6b3f49ad None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:13.247867 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac1afbd-e1cc-4cdb-a1e6-80ed6b3f49ad None admin] PATH_INFO: `/v3/projects/73015da4de1f48c29f57fff1040d2c10/users/3985eae1ec3240129eec8d1f4d8d21e8/roles/a12797d48dac420cb2eaadbe537f60ef` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:13.262215 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac1afbd-e1cc-4cdb-a1e6-80ed6b3f49ad None admin] RBAC: Authorizing `identity:create_grant(project_id=73015da4de1f48c29f57fff1040d2c10, user_id=3985eae1ec3240129eec8d1f4d8d21e8, role_id=a12797d48dac420cb2eaadbe537f60ef)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:13.263691 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac1afbd-e1cc-4cdb-a1e6-80ed6b3f49ad None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:13.287052 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:13.332894 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 301/588] 10.222.0.39 () {58 vars in 1439 bytes} [Thu Jun 16 17:07:13 2022] PUT /identity/v3/projects/73015da4de1f48c29f57fff1040d2c10/users/3985eae1ec3240129eec8d1f4d8d21e8/roles/a12797d48dac420cb2eaadbe537f60ef => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:07:13.333641 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac1afbd-e1cc-4cdb-a1e6-80ed6b3f49ad None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:13.344936 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3069765d-d96d-4919-8670-16a7d27206d9 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:13.385918 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a725ac-fc25-4955-a931-b458dc7c1f94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:13.386740 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a725ac-fc25-4955-a931-b458dc7c1f94 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:13.387037 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a725ac-fc25-4955-a931-b458dc7c1f94 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:13.387325 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a725ac-fc25-4955-a931-b458dc7c1f94 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:13.388853 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a725ac-fc25-4955-a931-b458dc7c1f94 None admin] RBAC: Adding query filter params (role.id=a12797d48dac420cb2eaadbe537f60ef, scope.project.id=73015da4de1f48c29f57fff1040d2c10, user.id=bbec2dfe63764ed88a23e172ead0afa4) {{(pid=80873) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:07:13.389180 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a725ac-fc25-4955-a931-b458dc7c1f94 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:13.390694 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a725ac-fc25-4955-a931-b458dc7c1f94 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:13.401985 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 288/589] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jun 16 17:07:13 2022] GET /identity/v3/role_assignments?user.id=bbec2dfe63764ed88a23e172ead0afa4&scope.project.id=73015da4de1f48c29f57fff1040d2c10&role.id=a12797d48dac420cb2eaadbe537f60ef => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:07:13.403131 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a725ac-fc25-4955-a931-b458dc7c1f94 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:13.486421 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac1afbd-e1cc-4cdb-a1e6-80ed6b3f49ad None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:13.532619 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:13.543489 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c7732b-e717-4b8c-ab5e-d24e6fd04462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:13.545030 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c7732b-e717-4b8c-ab5e-d24e6fd04462 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:13.545620 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c7732b-e717-4b8c-ab5e-d24e6fd04462 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:13.545741 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c7732b-e717-4b8c-ab5e-d24e6fd04462 None admin] PATH_INFO: `/v3/domains` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:13.546426 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c7732b-e717-4b8c-ab5e-d24e6fd04462 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:07:13.546740 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c7732b-e717-4b8c-ab5e-d24e6fd04462 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:13.548168 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c7732b-e717-4b8c-ab5e-d24e6fd04462 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:13.553482 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a725ac-fc25-4955-a931-b458dc7c1f94 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:13.562415 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:13.564982 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 302/590] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 16 17:07:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:07:13.566389 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c7732b-e717-4b8c-ab5e-d24e6fd04462 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:13.598732 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675921c4-2a1b-45cb-971b-c72997170535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:13.599757 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675921c4-2a1b-45cb-971b-c72997170535 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:13.600517 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675921c4-2a1b-45cb-971b-c72997170535 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:13.601019 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675921c4-2a1b-45cb-971b-c72997170535 None admin] PATH_INFO: `/v3/domains` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:13.602034 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675921c4-2a1b-45cb-971b-c72997170535 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80873) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:07:13.602564 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675921c4-2a1b-45cb-971b-c72997170535 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:13.604167 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675921c4-2a1b-45cb-971b-c72997170535 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:13.618067 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 289/591] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 16 17:07:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:07:13.619381 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675921c4-2a1b-45cb-971b-c72997170535 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:13.675242 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c7732b-e717-4b8c-ab5e-d24e6fd04462 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:13.711239 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaae363-88f8-4c3d-a2b6-d408701a701e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:13.711921 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaae363-88f8-4c3d-a2b6-d408701a701e None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:13.712269 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaae363-88f8-4c3d-a2b6-d408701a701e None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:13.712561 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaae363-88f8-4c3d-a2b6-d408701a701e None admin] PATH_INFO: `/v3/users` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:13.713417 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feaae363-88f8-4c3d-a2b6-d408701a701e None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:07:13.713735 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feaae363-88f8-4c3d-a2b6-d408701a701e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:13.715208 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feaae363-88f8-4c3d-a2b6-d408701a701e None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:13.732694 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675921c4-2a1b-45cb-971b-c72997170535 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:13.735122 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 303/592] 10.222.0.39 () {56 vars in 1139 bytes} [Thu Jun 16 17:07:13 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:07:13.736427 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaae363-88f8-4c3d-a2b6-d408701a701e None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:13.775774 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059b00b2-165c-4b25-8e92-a04a0178695e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:13.776930 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059b00b2-165c-4b25-8e92-a04a0178695e None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:13.777433 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059b00b2-165c-4b25-8e92-a04a0178695e None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:13.779168 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059b00b2-165c-4b25-8e92-a04a0178695e None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:13.785132 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:13.789208 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059b00b2-165c-4b25-8e92-a04a0178695e None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:13.791181 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059b00b2-165c-4b25-8e92-a04a0178695e None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:13.811340 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application [None req-059b00b2-165c-4b25-8e92-a04a0178695e None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 16 17:07:13.811340 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:07:13.811340 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:07:13.811340 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:07:13.811340 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:07:13.811340 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:07:13.811340 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:07:13.811340 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:07:13.811340 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:07:13.811340 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:07:13.811340 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:07:13.811340 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:07:13.811340 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 17:07:13.811340 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 17:07:13.811340 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 17:07:13.811340 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 17:07:13.812381 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:07:13.812381 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:07:13.812381 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 17:07:13.812381 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 17:07:13.812381 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 17:07:13.812381 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 17:07:13.812381 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:07:13.812381 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:07:13.812381 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:07:13.812381 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:07:13.812381 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:07:13.812381 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application with Lock( Jun 16 17:07:13.812381 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:07:13.812381 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:07:13.812381 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:07:13.812381 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:07:13.812381 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:07:13.812381 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:07:13.813326 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:07:13.813326 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:07:13.813326 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 17:07:13.813326 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 17:07:13.813326 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 17:07:13.813326 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 17:07:13.813326 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 17:07:13.813326 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 17:07:13.813326 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 16 17:07:13.813326 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Jun 16 17:07:13.815328 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 290/593] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 16 17:07:13 2022] GET /identity/v3/users/cinder => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:07:13.816046 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059b00b2-165c-4b25-8e92-a04a0178695e None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:13.848391 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaae363-88f8-4c3d-a2b6-d408701a701e None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:13.858201 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:13.890445 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45a77ee-f4ae-4ee7-92e8-a257246c2bc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:13.891272 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45a77ee-f4ae-4ee7-92e8-a257246c2bc3 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:13.891565 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45a77ee-f4ae-4ee7-92e8-a257246c2bc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:13.891852 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45a77ee-f4ae-4ee7-92e8-a257246c2bc3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:13.909479 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45a77ee-f4ae-4ee7-92e8-a257246c2bc3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:13.911091 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45a77ee-f4ae-4ee7-92e8-a257246c2bc3 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:13.930196 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application [None req-d45a77ee-f4ae-4ee7-92e8-a257246c2bc3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 17:07:13.930196 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:07:13.930196 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:07:13.930196 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:07:13.930196 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:07:13.930196 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:07:13.930196 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:07:13.930196 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:07:13.930196 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:07:13.930196 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:07:13.930196 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:07:13.930196 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:07:13.930196 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 17:07:13.930196 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 17:07:13.930196 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 17:07:13.931164 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 17:07:13.931164 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:07:13.931164 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:07:13.931164 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:07:13.931164 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:07:13.931164 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:07:13.931164 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:07:13.931164 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:07:13.931164 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application with Lock( Jun 16 17:07:13.931164 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:07:13.931164 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:07:13.931164 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:07:13.931164 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:07:13.931164 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:07:13.931164 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:07:13.931164 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:07:13.931164 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:07:13.932640 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 17:07:13.932640 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 17:07:13.932640 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 17:07:13.932640 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 17:07:13.932640 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 17:07:13.932640 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 17:07:13.932640 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 17:07:13.932640 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Jun 16 17:07:13.932640 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 304/594] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 16 17:07:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:07:13.932640 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45a77ee-f4ae-4ee7-92e8-a257246c2bc3 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:13.950533 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059b00b2-165c-4b25-8e92-a04a0178695e None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:13.989256 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12b2d8a-e2bc-4c58-9d7a-ddb632a6d650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:13.990681 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12b2d8a-e2bc-4c58-9d7a-ddb632a6d650 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:13.991307 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12b2d8a-e2bc-4c58-9d7a-ddb632a6d650 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:13.991785 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12b2d8a-e2bc-4c58-9d7a-ddb632a6d650 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:14.003351 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12b2d8a-e2bc-4c58-9d7a-ddb632a6d650 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:14.005033 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12b2d8a-e2bc-4c58-9d7a-ddb632a6d650 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:14.024449 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application [None req-a12b2d8a-e2bc-4c58-9d7a-ddb632a6d650 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:07:14.024449 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:07:14.024449 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:07:14.024449 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:07:14.024449 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:07:14.024449 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:07:14.024449 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:07:14.024449 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:07:14.024449 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:07:14.024449 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:07:14.024449 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:07:14.024449 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:07:14.024449 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 17:07:14.024449 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 17:07:14.024449 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 17:07:14.025432 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 17:07:14.025432 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:07:14.025432 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:07:14.025432 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:07:14.025432 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:07:14.025432 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:07:14.025432 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:07:14.025432 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:07:14.025432 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application with Lock( Jun 16 17:07:14.025432 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:07:14.025432 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:07:14.025432 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:07:14.025432 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:07:14.025432 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:07:14.025432 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:07:14.025432 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:07:14.025432 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:07:14.026396 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 17:07:14.026396 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 17:07:14.026396 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:07:14.026396 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Jun 16 17:07:14.026396 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 291/595] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 17:07:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:07:14.027322 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12b2d8a-e2bc-4c58-9d7a-ddb632a6d650 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:14.055231 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45a77ee-f4ae-4ee7-92e8-a257246c2bc3 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:14.058920 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:14.102356 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b6fc33-2291-4c07-ba1a-ffb57dfbcacd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:14.103963 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b6fc33-2291-4c07-ba1a-ffb57dfbcacd None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:14.104454 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b6fc33-2291-4c07-ba1a-ffb57dfbcacd None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:14.105208 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b6fc33-2291-4c07-ba1a-ffb57dfbcacd None admin] PATH_INFO: `/v3/users` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:14.106870 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b6fc33-2291-4c07-ba1a-ffb57dfbcacd None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:07:14.107727 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b6fc33-2291-4c07-ba1a-ffb57dfbcacd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:14.110460 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b6fc33-2291-4c07-ba1a-ffb57dfbcacd None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:14.117654 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:14.134151 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 305/596] 10.222.0.39 () {56 vars in 1137 bytes} [Thu Jun 16 17:07:13 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:07:14.135857 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b6fc33-2291-4c07-ba1a-ffb57dfbcacd None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:14.141192 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12b2d8a-e2bc-4c58-9d7a-ddb632a6d650 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:14.181273 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0abac5e-355b-4c53-bb03-969c93add1c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:14.182056 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0abac5e-355b-4c53-bb03-969c93add1c0 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:14.182448 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0abac5e-355b-4c53-bb03-969c93add1c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:14.182818 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0abac5e-355b-4c53-bb03-969c93add1c0 None admin] PATH_INFO: `/v3/projects` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:14.183679 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0abac5e-355b-4c53-bb03-969c93add1c0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80873) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:07:14.184058 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0abac5e-355b-4c53-bb03-969c93add1c0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:14.186244 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0abac5e-355b-4c53-bb03-969c93add1c0 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:14.204082 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 292/597] 10.222.0.39 () {56 vars in 1148 bytes} [Thu Jun 16 17:07:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:07:14.204082 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0abac5e-355b-4c53-bb03-969c93add1c0 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:14.283108 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b6fc33-2291-4c07-ba1a-ffb57dfbcacd None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:14.329581 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d7c9ef-ebce-4bd9-8cdb-a0da05981b3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:14.338209 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0abac5e-355b-4c53-bb03-969c93add1c0 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:14.338347 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d7c9ef-ebce-4bd9-8cdb-a0da05981b3f None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:14.338347 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d7c9ef-ebce-4bd9-8cdb-a0da05981b3f None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:14.338347 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d7c9ef-ebce-4bd9-8cdb-a0da05981b3f None admin] PATH_INFO: `/v3/domains` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:14.338347 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d7c9ef-ebce-4bd9-8cdb-a0da05981b3f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:07:14.338347 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d7c9ef-ebce-4bd9-8cdb-a0da05981b3f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:14.338347 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d7c9ef-ebce-4bd9-8cdb-a0da05981b3f None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:14.349863 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 306/598] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 16 17:07:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:07:14.351022 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d7c9ef-ebce-4bd9-8cdb-a0da05981b3f None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:14.377241 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30099f4-fb6d-43a1-a8c5-3ecce25ca207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:14.378481 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30099f4-fb6d-43a1-a8c5-3ecce25ca207 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:14.379588 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30099f4-fb6d-43a1-a8c5-3ecce25ca207 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:14.379588 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30099f4-fb6d-43a1-a8c5-3ecce25ca207 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:14.384736 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:14.389993 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:14.396333 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30099f4-fb6d-43a1-a8c5-3ecce25ca207 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:14.397806 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30099f4-fb6d-43a1-a8c5-3ecce25ca207 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:14.423238 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application [None req-c30099f4-fb6d-43a1-a8c5-3ecce25ca207 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:07:14.423238 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:07:14.423238 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:07:14.423238 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:07:14.423238 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:07:14.423238 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:07:14.423238 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:07:14.423238 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:07:14.423238 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:07:14.423238 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:07:14.423238 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:07:14.423238 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:07:14.423238 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 17:07:14.423238 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 17:07:14.423238 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 17:07:14.424184 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 17:07:14.424184 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:07:14.424184 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:07:14.424184 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:07:14.424184 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:07:14.424184 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:07:14.424184 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:07:14.424184 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:07:14.424184 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application with Lock( Jun 16 17:07:14.424184 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:07:14.424184 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:07:14.424184 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:07:14.424184 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:07:14.424184 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:07:14.424184 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:07:14.424184 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:07:14.424184 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:07:14.425108 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 17:07:14.425108 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 17:07:14.425108 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:07:14.425108 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Jun 16 17:07:14.427649 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 293/599] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 17:07:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:07:14.429125 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30099f4-fb6d-43a1-a8c5-3ecce25ca207 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:14.473950 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d7c9ef-ebce-4bd9-8cdb-a0da05981b3f None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:14.511231 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fef248-beef-4ef6-b0d0-ef453b458403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:14.512940 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fef248-beef-4ef6-b0d0-ef453b458403 None admin] REQUEST_METHOD: `PUT` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:14.513318 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fef248-beef-4ef6-b0d0-ef453b458403 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:14.513698 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fef248-beef-4ef6-b0d0-ef453b458403 None admin] PATH_INFO: `/v3/projects/73015da4de1f48c29f57fff1040d2c10/users/3d381bb41dea4f1e90c3cf3815ac88dc/roles/a12797d48dac420cb2eaadbe537f60ef` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:14.529641 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fef248-beef-4ef6-b0d0-ef453b458403 None admin] RBAC: Authorizing `identity:create_grant(project_id=73015da4de1f48c29f57fff1040d2c10, user_id=3d381bb41dea4f1e90c3cf3815ac88dc, role_id=a12797d48dac420cb2eaadbe537f60ef)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:14.531223 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fef248-beef-4ef6-b0d0-ef453b458403 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:14.537926 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30099f4-fb6d-43a1-a8c5-3ecce25ca207 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:14.577578 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25d92ac-604d-46f3-88f3-0ea710cea109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:14.578470 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25d92ac-604d-46f3-88f3-0ea710cea109 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:14.578763 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25d92ac-604d-46f3-88f3-0ea710cea109 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:14.579043 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25d92ac-604d-46f3-88f3-0ea710cea109 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:14.586780 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25d92ac-604d-46f3-88f3-0ea710cea109 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:14.588214 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25d92ac-604d-46f3-88f3-0ea710cea109 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:14.607763 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application [None req-d25d92ac-604d-46f3-88f3-0ea710cea109 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 17:07:14.607763 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:07:14.607763 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:07:14.607763 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:07:14.607763 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:07:14.607763 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:07:14.607763 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:07:14.607763 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:07:14.607763 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:07:14.607763 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:07:14.607763 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:07:14.607763 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:07:14.607763 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 17:07:14.607763 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 17:07:14.607763 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 17:07:14.608751 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 17:07:14.608751 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:07:14.608751 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:07:14.608751 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:07:14.608751 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:07:14.608751 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:07:14.608751 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:07:14.608751 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:07:14.608751 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application with Lock( Jun 16 17:07:14.608751 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:07:14.608751 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:07:14.608751 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:07:14.608751 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:07:14.608751 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:07:14.608751 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:07:14.608751 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:07:14.608751 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:07:14.609637 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 17:07:14.609637 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 17:07:14.609637 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 17:07:14.609637 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 17:07:14.609637 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 17:07:14.609637 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 17:07:14.609637 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 17:07:14.609637 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Jun 16 17:07:14.610853 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 307/601] 10.222.0.39 () {58 vars in 1439 bytes} [Thu Jun 16 17:07:14 2022] PUT /identity/v3/projects/73015da4de1f48c29f57fff1040d2c10/users/3d381bb41dea4f1e90c3cf3815ac88dc/roles/a12797d48dac420cb2eaadbe537f60ef => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:07:14.613045 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 294/601] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 16 17:07:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:07:14.613045 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25d92ac-604d-46f3-88f3-0ea710cea109 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:14.614485 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fef248-beef-4ef6-b0d0-ef453b458403 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:14.699473 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:14.765839 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25d92ac-604d-46f3-88f3-0ea710cea109 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:14.807407 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d41ed11-228d-4cd3-a35c-9a9083f57f9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:14.808533 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d41ed11-228d-4cd3-a35c-9a9083f57f9e None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:14.809072 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d41ed11-228d-4cd3-a35c-9a9083f57f9e None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:14.810111 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d41ed11-228d-4cd3-a35c-9a9083f57f9e None admin] PATH_INFO: `/v3/domains` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:14.811635 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d41ed11-228d-4cd3-a35c-9a9083f57f9e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80873) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:07:14.812203 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d41ed11-228d-4cd3-a35c-9a9083f57f9e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:14.813847 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d41ed11-228d-4cd3-a35c-9a9083f57f9e None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:14.829687 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 295/602] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 16 17:07:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:07:14.837920 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d41ed11-228d-4cd3-a35c-9a9083f57f9e None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:14.839447 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:14.900896 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fef248-beef-4ef6-b0d0-ef453b458403 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:14.955987 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ca13bd-e12f-4c1b-bec0-a85ab024980a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:14.956889 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ca13bd-e12f-4c1b-bec0-a85ab024980a None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:14.957328 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ca13bd-e12f-4c1b-bec0-a85ab024980a None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:14.966100 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ca13bd-e12f-4c1b-bec0-a85ab024980a None admin] PATH_INFO: `/v3/projects` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:14.967525 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ca13bd-e12f-4c1b-bec0-a85ab024980a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:07:14.967652 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d41ed11-228d-4cd3-a35c-9a9083f57f9e None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:14.968212 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ca13bd-e12f-4c1b-bec0-a85ab024980a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:14.970850 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ca13bd-e12f-4c1b-bec0-a85ab024980a None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:14.979616 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:14.994369 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 308/603] 10.222.0.39 () {56 vars in 1148 bytes} [Thu Jun 16 17:07:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 380 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:07:15.007161 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ca13bd-e12f-4c1b-bec0-a85ab024980a None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:15.012200 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f16765-74d9-4da7-bc45-be74b122210e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:15.013851 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f16765-74d9-4da7-bc45-be74b122210e None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:15.014306 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f16765-74d9-4da7-bc45-be74b122210e None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:15.014785 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f16765-74d9-4da7-bc45-be74b122210e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:15.023593 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f16765-74d9-4da7-bc45-be74b122210e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:15.025791 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f16765-74d9-4da7-bc45-be74b122210e None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:15.046234 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application [None req-98f16765-74d9-4da7-bc45-be74b122210e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 17:07:15.046234 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:07:15.046234 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:07:15.046234 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:07:15.046234 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:07:15.046234 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:07:15.046234 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:07:15.046234 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:07:15.046234 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:07:15.046234 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:07:15.046234 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:07:15.046234 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:07:15.046234 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 17:07:15.046234 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 17:07:15.046234 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 17:07:15.047202 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 17:07:15.047202 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:07:15.047202 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:07:15.047202 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:07:15.047202 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:07:15.047202 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:07:15.047202 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:07:15.047202 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:07:15.047202 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application with Lock( Jun 16 17:07:15.047202 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:07:15.047202 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:07:15.047202 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:07:15.047202 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:07:15.047202 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:07:15.047202 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:07:15.047202 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:07:15.047202 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:07:15.048087 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 17:07:15.048087 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 17:07:15.048087 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 17:07:15.048087 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 17:07:15.048087 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 17:07:15.048087 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 17:07:15.048087 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 17:07:15.048087 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Jun 16 17:07:15.048087 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 296/604] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 16 17:07:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:07:15.054299 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f16765-74d9-4da7-bc45-be74b122210e None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:15.199211 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ca13bd-e12f-4c1b-bec0-a85ab024980a None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:15.265527 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:15.269057 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f16765-74d9-4da7-bc45-be74b122210e None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:15.291088 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f619612-9a75-416f-8b3e-438358c07c1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:15.292684 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f619612-9a75-416f-8b3e-438358c07c1d None admin] REQUEST_METHOD: `PUT` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:15.293205 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f619612-9a75-416f-8b3e-438358c07c1d None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:15.294273 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f619612-9a75-416f-8b3e-438358c07c1d None admin] PATH_INFO: `/v3/projects/73015da4de1f48c29f57fff1040d2c10/users/b5d25bfa8dc042329d57cd55fa7b7b23/roles/a12797d48dac420cb2eaadbe537f60ef` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:15.305081 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6880601d-5280-4d94-af64-1289effdd9af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:15.305813 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6880601d-5280-4d94-af64-1289effdd9af None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:15.306456 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6880601d-5280-4d94-af64-1289effdd9af None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:15.306833 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6880601d-5280-4d94-af64-1289effdd9af None admin] PATH_INFO: `/v3/projects` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:15.307835 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6880601d-5280-4d94-af64-1289effdd9af None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80873) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:07:15.308151 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6880601d-5280-4d94-af64-1289effdd9af None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:15.312824 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6880601d-5280-4d94-af64-1289effdd9af None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:15.328003 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 297/605] 10.222.0.39 () {56 vars in 1148 bytes} [Thu Jun 16 17:07:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:07:15.334826 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6880601d-5280-4d94-af64-1289effdd9af None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:15.342818 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f619612-9a75-416f-8b3e-438358c07c1d None admin] RBAC: Authorizing `identity:create_grant(project_id=73015da4de1f48c29f57fff1040d2c10, user_id=b5d25bfa8dc042329d57cd55fa7b7b23, role_id=a12797d48dac420cb2eaadbe537f60ef)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:15.344302 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f619612-9a75-416f-8b3e-438358c07c1d None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:15.390595 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:15.442078 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 309/606] 10.222.0.39 () {58 vars in 1439 bytes} [Thu Jun 16 17:07:15 2022] PUT /identity/v3/projects/73015da4de1f48c29f57fff1040d2c10/users/b5d25bfa8dc042329d57cd55fa7b7b23/roles/a12797d48dac420cb2eaadbe537f60ef => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 17:07:15.459216 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6880601d-5280-4d94-af64-1289effdd9af None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:15.500559 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2051bdaa-5610-4e3d-80fe-66488af77246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:15.501488 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2051bdaa-5610-4e3d-80fe-66488af77246 None admin] REQUEST_METHOD: `PUT` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:15.501802 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2051bdaa-5610-4e3d-80fe-66488af77246 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:15.502119 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2051bdaa-5610-4e3d-80fe-66488af77246 None admin] PATH_INFO: `/v3/projects/73015da4de1f48c29f57fff1040d2c10/users/ef37136b89d34edc9cd94c7aa81b2095/roles/a12797d48dac420cb2eaadbe537f60ef` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:15.519639 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2051bdaa-5610-4e3d-80fe-66488af77246 None admin] RBAC: Authorizing `identity:create_grant(project_id=73015da4de1f48c29f57fff1040d2c10, user_id=ef37136b89d34edc9cd94c7aa81b2095, role_id=a12797d48dac420cb2eaadbe537f60ef)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:15.521074 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2051bdaa-5610-4e3d-80fe-66488af77246 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:15.604563 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 298/607] 10.222.0.39 () {58 vars in 1439 bytes} [Thu Jun 16 17:07:15 2022] PUT /identity/v3/projects/73015da4de1f48c29f57fff1040d2c10/users/ef37136b89d34edc9cd94c7aa81b2095/roles/a12797d48dac420cb2eaadbe537f60ef => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:07:15.744697 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529bb501-8199-466f-82ea-c17828344b8b None None] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:15.745329 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529bb501-8199-466f-82ea-c17828344b8b None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:15.745804 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529bb501-8199-466f-82ea-c17828344b8b None None] PATH_INFO: `/` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:15.748093 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 310/608] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 17:07:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:07:15.754271 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d96d6d-f434-46f0-84c8-9c2cc81ad675 None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:15.754954 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d96d6d-f434-46f0-84c8-9c2cc81ad675 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:15.755467 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d96d6d-f434-46f0-84c8-9c2cc81ad675 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:15.775678 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-20d96d6d-f434-46f0-84c8-9c2cc81ad675 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:07:15.777298 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-20d96d6d-f434-46f0-84c8-9c2cc81ad675 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:07:15.841565 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6f62da-9cd2-4ee6-bcaa-03681c6a5dd2 None None] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:15.842241 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6f62da-9cd2-4ee6-bcaa-03681c6a5dd2 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:15.842752 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6f62da-9cd2-4ee6-bcaa-03681c6a5dd2 None None] PATH_INFO: `/` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:15.844569 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 311/609] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 17:07:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:07:15.851102 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa6711d-475f-4a92-8dfb-685ae57e317a None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:15.851401 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa6711d-475f-4a92-8dfb-685ae57e317a None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:15.851690 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa6711d-475f-4a92-8dfb-685ae57e317a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:15.860889 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 299/610] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 17:07:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 17:07:15.879560 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-2fa6711d-475f-4a92-8dfb-685ae57e317a None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:07:15.881218 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-2fa6711d-475f-4a92-8dfb-685ae57e317a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:07:15.888888 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d96d6d-f434-46f0-84c8-9c2cc81ad675 None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:15.910521 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:15.970406 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 312/611] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 17:07:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 17:07:15.999656 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa6711d-475f-4a92-8dfb-685ae57e317a None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:16.026106 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d96d6d-f434-46f0-84c8-9c2cc81ad675 None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:16.098301 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51e27dc-87c5-4084-b342-fe74991239f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:16.099107 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51e27dc-87c5-4084-b342-fe74991239f0 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:16.099393 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51e27dc-87c5-4084-b342-fe74991239f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:16.099673 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51e27dc-87c5-4084-b342-fe74991239f0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:16.118944 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51e27dc-87c5-4084-b342-fe74991239f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 17:07:16.127323 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application [None req-b51e27dc-87c5-4084-b342-fe74991239f0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 17:07:16.127323 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:07:16.127323 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:07:16.127323 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:07:16.127323 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:07:16.127323 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:07:16.127323 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:07:16.127323 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:07:16.127323 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:07:16.127323 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:07:16.127323 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:07:16.127323 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:07:16.127323 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 17:07:16.127323 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 17:07:16.127323 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 17:07:16.127323 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 17:07:16.128286 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 17:07:16.128286 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 17:07:16.128286 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 17:07:16.128286 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 17:07:16.128286 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:07:16.128286 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:07:16.128286 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:07:16.128286 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:07:16.128286 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:07:16.128286 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:07:16.128286 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:07:16.128286 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application with Lock( Jun 16 17:07:16.128286 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:07:16.128286 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:07:16.128286 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:07:16.128286 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:07:16.129149 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:07:16.129149 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:07:16.129149 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:07:16.129149 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:07:16.129149 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 17:07:16.129149 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 17:07:16.129149 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 17:07:16.129149 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 17:07:16.129149 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 17:07:16.129149 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 17:07:16.129149 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 17:07:16.129149 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Jun 16 17:07:16.129149 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 300/612] 10.222.0.39 () {56 vars in 1102 bytes} [Thu Jun 16 17:07:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 17:07:16.140352 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51e27dc-87c5-4084-b342-fe74991239f0 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:16.180993 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa6711d-475f-4a92-8dfb-685ae57e317a None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:16.198041 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:16.242842 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3da7144-88c8-4e88-a8f5-ffeb9437fd6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:16.243653 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3da7144-88c8-4e88-a8f5-ffeb9437fd6c None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:16.243936 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3da7144-88c8-4e88-a8f5-ffeb9437fd6c None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:16.244217 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3da7144-88c8-4e88-a8f5-ffeb9437fd6c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:16.267366 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3da7144-88c8-4e88-a8f5-ffeb9437fd6c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 17:07:16.275371 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application [None req-b3da7144-88c8-4e88-a8f5-ffeb9437fd6c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 17:07:16.275371 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:07:16.275371 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:07:16.275371 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:07:16.275371 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:07:16.275371 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:07:16.275371 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:07:16.275371 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:07:16.275371 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:07:16.275371 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:07:16.275371 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:07:16.275371 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:07:16.275371 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 17:07:16.275371 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 17:07:16.275371 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 17:07:16.275371 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 17:07:16.277609 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 17:07:16.277609 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 17:07:16.277609 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 17:07:16.277609 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 17:07:16.277609 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:07:16.277609 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:07:16.277609 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:07:16.277609 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:07:16.277609 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:07:16.277609 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:07:16.277609 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:07:16.277609 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application with Lock( Jun 16 17:07:16.277609 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:07:16.277609 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:07:16.277609 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:07:16.277609 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:07:16.280716 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:07:16.280716 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:07:16.280716 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:07:16.280716 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:07:16.280716 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 17:07:16.280716 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 17:07:16.280716 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 17:07:16.280716 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 17:07:16.280716 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 17:07:16.280716 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 17:07:16.280716 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 17:07:16.280716 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Jun 16 17:07:16.285976 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:16.294321 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 313/613] 10.222.0.39 () {56 vars in 1102 bytes} [Thu Jun 16 17:07:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:07:16.294321 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3da7144-88c8-4e88-a8f5-ffeb9437fd6c None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:16.319663 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51e27dc-87c5-4084-b342-fe74991239f0 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:16.357715 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678ff767-75fb-4509-b381-7273bf82fd31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:16.358512 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678ff767-75fb-4509-b381-7273bf82fd31 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:16.358802 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678ff767-75fb-4509-b381-7273bf82fd31 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:16.359082 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678ff767-75fb-4509-b381-7273bf82fd31 None admin] PATH_INFO: `/v3/roles` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:16.359838 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678ff767-75fb-4509-b381-7273bf82fd31 None admin] RBAC: Adding query filter params (name=service) {{(pid=80873) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:07:16.360151 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678ff767-75fb-4509-b381-7273bf82fd31 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:16.361933 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678ff767-75fb-4509-b381-7273bf82fd31 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:16.371104 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 301/614] 10.222.0.39 () {56 vars in 1103 bytes} [Thu Jun 16 17:07:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:07:16.377438 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678ff767-75fb-4509-b381-7273bf82fd31 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:16.483902 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3da7144-88c8-4e88-a8f5-ffeb9437fd6c None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:16.531699 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678ff767-75fb-4509-b381-7273bf82fd31 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:16.533793 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0e224a-5aae-4692-891b-9f9cf6bb4e95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:16.534467 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0e224a-5aae-4692-891b-9f9cf6bb4e95 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:16.534774 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0e224a-5aae-4692-891b-9f9cf6bb4e95 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:16.535023 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0e224a-5aae-4692-891b-9f9cf6bb4e95 None admin] PATH_INFO: `/v3/roles` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:16.535773 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0e224a-5aae-4692-891b-9f9cf6bb4e95 None admin] RBAC: Adding query filter params (name=service) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:07:16.536082 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0e224a-5aae-4692-891b-9f9cf6bb4e95 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:16.537459 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0e224a-5aae-4692-891b-9f9cf6bb4e95 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:16.557194 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 314/615] 10.222.0.39 () {56 vars in 1103 bytes} [Thu Jun 16 17:07:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:07:16.563575 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0e224a-5aae-4692-891b-9f9cf6bb4e95 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:16.576171 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bb7f0d-1f35-4e1a-bb1d-892c9d5a89de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:16.576968 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bb7f0d-1f35-4e1a-bb1d-892c9d5a89de None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:16.577251 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bb7f0d-1f35-4e1a-bb1d-892c9d5a89de None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:16.577541 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bb7f0d-1f35-4e1a-bb1d-892c9d5a89de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:16.588545 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bb7f0d-1f35-4e1a-bb1d-892c9d5a89de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:16.590085 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bb7f0d-1f35-4e1a-bb1d-892c9d5a89de None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:16.608933 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application [None req-09bb7f0d-1f35-4e1a-bb1d-892c9d5a89de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:07:16.608933 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:07:16.608933 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:07:16.608933 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:07:16.608933 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:07:16.608933 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:07:16.608933 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:07:16.608933 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:07:16.608933 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:07:16.608933 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:07:16.608933 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:07:16.608933 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:07:16.608933 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 17:07:16.608933 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 17:07:16.608933 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 17:07:16.609924 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 17:07:16.609924 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:07:16.609924 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:07:16.609924 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:07:16.609924 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:07:16.609924 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:07:16.609924 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:07:16.609924 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:07:16.609924 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application with Lock( Jun 16 17:07:16.609924 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:07:16.609924 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:07:16.609924 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:07:16.609924 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:07:16.609924 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:07:16.609924 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:07:16.609924 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:07:16.609924 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:07:16.610845 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 17:07:16.610845 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 17:07:16.610845 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:07:16.610845 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Jun 16 17:07:16.610845 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 302/616] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 17:07:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 17:07:16.611423 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:16.616471 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bb7f0d-1f35-4e1a-bb1d-892c9d5a89de None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:16.633402 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:16.762510 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0e224a-5aae-4692-891b-9f9cf6bb4e95 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:16.820128 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7c35a0-47ad-4730-8afa-297bda82fa4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:16.820855 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7c35a0-47ad-4730-8afa-297bda82fa4f None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:16.821145 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7c35a0-47ad-4730-8afa-297bda82fa4f None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:16.821430 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7c35a0-47ad-4730-8afa-297bda82fa4f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:16.826031 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bb7f0d-1f35-4e1a-bb1d-892c9d5a89de None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:16.843764 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7c35a0-47ad-4730-8afa-297bda82fa4f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:16.845263 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7c35a0-47ad-4730-8afa-297bda82fa4f None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:16.880342 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application [None req-cb7c35a0-47ad-4730-8afa-297bda82fa4f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:07:16.880342 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:07:16.880342 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:07:16.880342 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:07:16.880342 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:07:16.880342 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:07:16.880342 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:07:16.880342 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:07:16.880342 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:07:16.880342 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:07:16.880342 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:07:16.880342 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:07:16.880342 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 17:07:16.880342 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 17:07:16.880342 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 17:07:16.881324 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 17:07:16.881324 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:07:16.881324 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:07:16.881324 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:07:16.881324 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:07:16.881324 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:07:16.881324 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:07:16.881324 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:07:16.881324 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application with Lock( Jun 16 17:07:16.881324 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:07:16.881324 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:07:16.881324 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:07:16.881324 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:07:16.881324 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:07:16.881324 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:07:16.881324 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:07:16.881324 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:07:16.882267 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 17:07:16.882267 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 17:07:16.882267 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:07:16.882267 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Jun 16 17:07:16.898601 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 315/617] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 17:07:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 335 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 17:07:16.906707 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7c35a0-47ad-4730-8afa-297bda82fa4f None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:16.917890 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b1e051-8c7f-46d3-a1ef-9efd93515515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:16.919161 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b1e051-8c7f-46d3-a1ef-9efd93515515 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:16.919449 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b1e051-8c7f-46d3-a1ef-9efd93515515 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:16.919737 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b1e051-8c7f-46d3-a1ef-9efd93515515 None admin] PATH_INFO: `/v3/domains` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:16.920903 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b1e051-8c7f-46d3-a1ef-9efd93515515 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80873) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:07:16.921232 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b1e051-8c7f-46d3-a1ef-9efd93515515 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:16.922977 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b1e051-8c7f-46d3-a1ef-9efd93515515 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:16.955996 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 303/618] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 16 17:07:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:07:16.957726 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b1e051-8c7f-46d3-a1ef-9efd93515515 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:17.009965 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:17.077131 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b1e051-8c7f-46d3-a1ef-9efd93515515 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:17.115475 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21db9021-b949-4c78-b3f6-816bcb624bae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:17.116640 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21db9021-b949-4c78-b3f6-816bcb624bae None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:17.117092 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21db9021-b949-4c78-b3f6-816bcb624bae None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:17.117514 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21db9021-b949-4c78-b3f6-816bcb624bae None admin] PATH_INFO: `/v3/users/glance` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:17.125714 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21db9021-b949-4c78-b3f6-816bcb624bae None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:17.127367 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21db9021-b949-4c78-b3f6-816bcb624bae None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:17.144006 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application [None req-21db9021-b949-4c78-b3f6-816bcb624bae None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 16 17:07:17.144006 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:07:17.144006 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:07:17.144006 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:07:17.144006 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:07:17.144006 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:07:17.144006 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:07:17.144006 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:07:17.144006 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:07:17.144006 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:07:17.144006 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:07:17.144006 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:07:17.144006 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 17:07:17.144006 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 17:07:17.144006 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 17:07:17.144006 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 17:07:17.145224 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:07:17.145224 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:07:17.145224 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 17:07:17.145224 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 17:07:17.145224 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 17:07:17.145224 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 17:07:17.145224 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:07:17.145224 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:07:17.145224 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:07:17.145224 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:07:17.145224 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:07:17.145224 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application with Lock( Jun 16 17:07:17.145224 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:07:17.145224 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:07:17.145224 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:07:17.145224 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:07:17.145224 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:07:17.145224 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:07:17.146472 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:07:17.146472 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:07:17.146472 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 17:07:17.146472 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 17:07:17.146472 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 17:07:17.146472 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 17:07:17.146472 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 17:07:17.146472 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 17:07:17.146472 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 16 17:07:17.146472 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Jun 16 17:07:17.148827 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 304/619] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 16 17:07:16 2022] GET /identity/v3/users/glance => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:07:17.154600 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21db9021-b949-4c78-b3f6-816bcb624bae None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:17.192529 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:17.247420 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7c35a0-47ad-4730-8afa-297bda82fa4f None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:17.266576 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21db9021-b949-4c78-b3f6-816bcb624bae None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:17.270145 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:17.300743 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b821324c-7571-458b-b9ea-e696c92ec736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:17.301426 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b821324c-7571-458b-b9ea-e696c92ec736 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:17.301719 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b821324c-7571-458b-b9ea-e696c92ec736 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:17.308733 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b821324c-7571-458b-b9ea-e696c92ec736 None admin] PATH_INFO: `/v3/domains` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:17.308733 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b821324c-7571-458b-b9ea-e696c92ec736 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:07:17.308733 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b821324c-7571-458b-b9ea-e696c92ec736 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:17.308733 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b821324c-7571-458b-b9ea-e696c92ec736 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:17.319669 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 316/620] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 16 17:07:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 413 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:07:17.338070 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b821324c-7571-458b-b9ea-e696c92ec736 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:17.348662 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5829917-cce8-41c5-85e4-6df741ac4696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:17.349408 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5829917-cce8-41c5-85e4-6df741ac4696 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:17.349696 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5829917-cce8-41c5-85e4-6df741ac4696 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:17.350262 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5829917-cce8-41c5-85e4-6df741ac4696 None admin] PATH_INFO: `/v3/users` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:17.351132 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5829917-cce8-41c5-85e4-6df741ac4696 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80873) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:07:17.351446 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5829917-cce8-41c5-85e4-6df741ac4696 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:17.352903 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5829917-cce8-41c5-85e4-6df741ac4696 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:17.389872 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 305/621] 10.222.0.39 () {56 vars in 1137 bytes} [Thu Jun 16 17:07:17 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 17:07:17.394121 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5829917-cce8-41c5-85e4-6df741ac4696 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:17.467591 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b821324c-7571-458b-b9ea-e696c92ec736 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:17.504399 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff119a0-faa3-4078-86d2-c6ec53910a6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:17.505206 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff119a0-faa3-4078-86d2-c6ec53910a6c None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:17.505495 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff119a0-faa3-4078-86d2-c6ec53910a6c None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:17.505794 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff119a0-faa3-4078-86d2-c6ec53910a6c None admin] PATH_INFO: `/v3/users/swift` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:17.513788 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff119a0-faa3-4078-86d2-c6ec53910a6c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:17.515246 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff119a0-faa3-4078-86d2-c6ec53910a6c None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:17.532300 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5829917-cce8-41c5-85e4-6df741ac4696 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:17.533226 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application [None req-7ff119a0-faa3-4078-86d2-c6ec53910a6c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 16 17:07:17.533226 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:07:17.533226 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:07:17.533226 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:07:17.533226 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:07:17.533226 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:07:17.533226 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:07:17.533226 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:07:17.533226 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:07:17.533226 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:07:17.533226 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:07:17.533226 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:07:17.533226 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 17:07:17.533226 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 17:07:17.533226 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 17:07:17.533226 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 17:07:17.534194 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:07:17.534194 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:07:17.534194 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 17:07:17.534194 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 17:07:17.534194 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 17:07:17.534194 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 17:07:17.534194 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:07:17.534194 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:07:17.534194 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:07:17.534194 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:07:17.534194 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:07:17.534194 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application with Lock( Jun 16 17:07:17.534194 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:07:17.534194 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:07:17.534194 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:07:17.534194 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:07:17.534194 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:07:17.534194 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:07:17.535132 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:07:17.535132 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:07:17.535132 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 17:07:17.535132 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 17:07:17.535132 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 17:07:17.535132 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 17:07:17.535132 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 17:07:17.535132 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 17:07:17.535132 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 16 17:07:17.535132 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Jun 16 17:07:17.535132 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 317/622] 10.222.0.39 () {56 vars in 1096 bytes} [Thu Jun 16 17:07:17 2022] GET /identity/v3/users/swift => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:07:17.536198 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f82f0c5-36fa-449c-abb6-792dd3bdc2ec None None] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:17.536295 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f82f0c5-36fa-449c-abb6-792dd3bdc2ec None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:17.536585 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f82f0c5-36fa-449c-abb6-792dd3bdc2ec None None] PATH_INFO: `/` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:17.541837 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 318/623] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 17:07:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:07:17.542889 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f82f0c5-36fa-449c-abb6-792dd3bdc2ec None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:17.556458 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:17.578223 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a01bf2-ae8d-4648-8536-3cd836f04d5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:17.578880 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a01bf2-ae8d-4648-8536-3cd836f04d5e None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:17.579169 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a01bf2-ae8d-4648-8536-3cd836f04d5e None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:17.579450 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a01bf2-ae8d-4648-8536-3cd836f04d5e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:17.612364 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:17.653239 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a01bf2-ae8d-4648-8536-3cd836f04d5e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:17.654844 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a01bf2-ae8d-4648-8536-3cd836f04d5e None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:17.688404 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f82f0c5-36fa-449c-abb6-792dd3bdc2ec None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:17.732590 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76877049-7f7b-4a10-a749-c69ca7f39246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:17.733322 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76877049-7f7b-4a10-a749-c69ca7f39246 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:17.733543 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76877049-7f7b-4a10-a749-c69ca7f39246 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:17.733877 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76877049-7f7b-4a10-a749-c69ca7f39246 None admin] PATH_INFO: `/v3/users` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:17.735652 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76877049-7f7b-4a10-a749-c69ca7f39246 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:07:17.735974 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76877049-7f7b-4a10-a749-c69ca7f39246 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:17.737423 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76877049-7f7b-4a10-a749-c69ca7f39246 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:17.757348 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 319/624] 10.222.0.39 () {56 vars in 1135 bytes} [Thu Jun 16 17:07:17 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:07:17.759238 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3de1245-0b7e-4ff8-ba1b-d79f89f84927 None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:17.759743 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3de1245-0b7e-4ff8-ba1b-d79f89f84927 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:17.760252 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3de1245-0b7e-4ff8-ba1b-d79f89f84927 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:17.773954 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 306/625] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 16 17:07:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 17:07:17.775208 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a01bf2-ae8d-4648-8536-3cd836f04d5e None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:17.779222 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-d3de1245-0b7e-4ff8-ba1b-d79f89f84927 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:07:17.780667 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-d3de1245-0b7e-4ff8-ba1b-d79f89f84927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:07:17.842988 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:17.860997 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:17.879729 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 320/626] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 17:07:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 17:07:17.879729 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3de1245-0b7e-4ff8-ba1b-d79f89f84927 None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:17.915994 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a01bf2-ae8d-4648-8536-3cd836f04d5e None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:17.956965 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1832df0b-040c-4176-a976-259060aa85f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:17.958125 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1832df0b-040c-4176-a976-259060aa85f1 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:17.958412 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1832df0b-040c-4176-a976-259060aa85f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:17.958691 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1832df0b-040c-4176-a976-259060aa85f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:17.973553 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1832df0b-040c-4176-a976-259060aa85f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:17.975830 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1832df0b-040c-4176-a976-259060aa85f1 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:18.001304 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application [None req-1832df0b-040c-4176-a976-259060aa85f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:07:18.001304 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:07:18.001304 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:07:18.001304 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:07:18.001304 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:07:18.001304 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:07:18.001304 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:07:18.001304 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:07:18.001304 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:07:18.001304 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:07:18.001304 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:07:18.001304 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:07:18.001304 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 17:07:18.001304 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 17:07:18.001304 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 17:07:18.002457 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 17:07:18.002457 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:07:18.002457 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:07:18.002457 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:07:18.002457 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:07:18.002457 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:07:18.002457 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:07:18.002457 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:07:18.002457 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application with Lock( Jun 16 17:07:18.002457 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:07:18.002457 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:07:18.002457 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:07:18.002457 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:07:18.002457 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:07:18.002457 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:07:18.002457 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:07:18.002457 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:07:18.003397 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 17:07:18.003397 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 17:07:18.003397 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:07:18.003397 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Jun 16 17:07:18.005837 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 307/627] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 17:07:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:07:18.006930 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1832df0b-040c-4176-a976-259060aa85f1 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:18.033323 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3de1245-0b7e-4ff8-ba1b-d79f89f84927 None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:18.069172 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00dd059-695a-4a82-9d83-4922d7c05d91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:18.070026 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00dd059-695a-4a82-9d83-4922d7c05d91 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:18.070312 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00dd059-695a-4a82-9d83-4922d7c05d91 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:18.070592 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00dd059-695a-4a82-9d83-4922d7c05d91 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:18.082768 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00dd059-695a-4a82-9d83-4922d7c05d91 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:18.084248 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00dd059-695a-4a82-9d83-4922d7c05d91 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:18.104172 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application [None req-a00dd059-695a-4a82-9d83-4922d7c05d91 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:07:18.104172 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:07:18.104172 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:07:18.104172 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:07:18.104172 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:07:18.104172 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:07:18.104172 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:07:18.104172 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:07:18.104172 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:07:18.104172 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:07:18.104172 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:07:18.104172 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:07:18.104172 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 17:07:18.104172 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 17:07:18.104172 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 17:07:18.105155 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 17:07:18.105155 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:07:18.105155 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:07:18.105155 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:07:18.105155 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:07:18.105155 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:07:18.105155 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:07:18.105155 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:07:18.105155 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application with Lock( Jun 16 17:07:18.105155 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:07:18.105155 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:07:18.105155 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:07:18.105155 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:07:18.105155 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:07:18.105155 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:07:18.105155 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:07:18.105155 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:07:18.106202 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 17:07:18.106202 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 17:07:18.106202 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:07:18.106202 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Jun 16 17:07:18.106202 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 321/628] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 17:07:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:07:18.106502 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00dd059-695a-4a82-9d83-4922d7c05d91 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:18.131878 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1832df0b-040c-4176-a976-259060aa85f1 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:18.147412 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:18.157919 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:18.167751 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471e900d-7083-4fd0-9fac-fed9d140c487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:18.168586 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471e900d-7083-4fd0-9fac-fed9d140c487 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:18.168875 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471e900d-7083-4fd0-9fac-fed9d140c487 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:18.169161 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471e900d-7083-4fd0-9fac-fed9d140c487 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:18.179952 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471e900d-7083-4fd0-9fac-fed9d140c487 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 17:07:18.187893 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application [None req-471e900d-7083-4fd0-9fac-fed9d140c487 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 17:07:18.187893 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:07:18.187893 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:07:18.187893 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:07:18.187893 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:07:18.187893 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:07:18.187893 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:07:18.187893 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:07:18.187893 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:07:18.187893 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:07:18.187893 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:07:18.187893 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:07:18.187893 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 17:07:18.187893 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 17:07:18.187893 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 17:07:18.187893 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 17:07:18.189033 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 17:07:18.189033 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 17:07:18.189033 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 17:07:18.189033 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 17:07:18.189033 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:07:18.189033 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:07:18.189033 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:07:18.189033 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:07:18.189033 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:07:18.189033 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:07:18.189033 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:07:18.189033 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application with Lock( Jun 16 17:07:18.189033 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:07:18.189033 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:07:18.189033 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:07:18.189033 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:07:18.190231 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:07:18.190231 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:07:18.190231 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:07:18.190231 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:07:18.190231 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 17:07:18.190231 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 17:07:18.190231 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 17:07:18.190231 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 17:07:18.190231 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 17:07:18.190231 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 17:07:18.190231 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 17:07:18.190231 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Jun 16 17:07:18.190231 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 308/629] 10.222.0.39 () {56 vars in 1102 bytes} [Thu Jun 16 17:07:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:07:18.191100 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc5ec10-7bbe-44b5-8bb4-79122b7c05d6 None None] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:18.191100 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc5ec10-7bbe-44b5-8bb4-79122b7c05d6 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:18.191246 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc5ec10-7bbe-44b5-8bb4-79122b7c05d6 None None] PATH_INFO: `/` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:18.192414 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 309/630] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 17:07:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:07:18.193106 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc5ec10-7bbe-44b5-8bb4-79122b7c05d6 None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:18.219248 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00dd059-695a-4a82-9d83-4922d7c05d91 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:18.254107 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cf5737-29d7-42c2-9aa8-e1211ae81642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:18.254774 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cf5737-29d7-42c2-9aa8-e1211ae81642 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:18.255057 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cf5737-29d7-42c2-9aa8-e1211ae81642 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:18.255338 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cf5737-29d7-42c2-9aa8-e1211ae81642 None admin] PATH_INFO: `/v3/domains` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:18.256056 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cf5737-29d7-42c2-9aa8-e1211ae81642 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:07:18.256363 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cf5737-29d7-42c2-9aa8-e1211ae81642 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:18.257712 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cf5737-29d7-42c2-9aa8-e1211ae81642 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:18.269449 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 322/631] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 16 17:07:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:07:18.271061 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2a9f06-1b6f-4183-8982-4608bea37530 None None] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:18.271365 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2a9f06-1b6f-4183-8982-4608bea37530 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:18.271654 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2a9f06-1b6f-4183-8982-4608bea37530 None None] PATH_INFO: `/` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:18.274323 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 323/632] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 17:07:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:07:18.274323 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2a9f06-1b6f-4183-8982-4608bea37530 None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:18.300435 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc5ec10-7bbe-44b5-8bb4-79122b7c05d6 None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:18.346759 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb977eac-874e-4407-8a21-a21342679323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:18.347794 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb977eac-874e-4407-8a21-a21342679323 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:18.348261 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb977eac-874e-4407-8a21-a21342679323 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:18.348740 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb977eac-874e-4407-8a21-a21342679323 None admin] PATH_INFO: `/v3/domains` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:18.350155 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb977eac-874e-4407-8a21-a21342679323 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80873) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:07:18.350648 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb977eac-874e-4407-8a21-a21342679323 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:18.353012 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb977eac-874e-4407-8a21-a21342679323 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:18.367945 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 310/633] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 16 17:07:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:07:18.369189 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78424090-80e3-4cfc-908e-00ac182bd131 None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:18.369610 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78424090-80e3-4cfc-908e-00ac182bd131 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:18.369926 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78424090-80e3-4cfc-908e-00ac182bd131 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:18.385842 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-78424090-80e3-4cfc-908e-00ac182bd131 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:07:18.386963 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-78424090-80e3-4cfc-908e-00ac182bd131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:07:18.406411 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2a9f06-1b6f-4183-8982-4608bea37530 None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:18.413614 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:18.413734 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:18.440066 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04a69cd-a97b-48d5-b9b7-bd4f6a8ef01d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:18.440728 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04a69cd-a97b-48d5-b9b7-bd4f6a8ef01d None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:18.441016 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04a69cd-a97b-48d5-b9b7-bd4f6a8ef01d None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:18.441295 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04a69cd-a97b-48d5-b9b7-bd4f6a8ef01d None admin] PATH_INFO: `/v3/roles` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:18.442084 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04a69cd-a97b-48d5-b9b7-bd4f6a8ef01d None admin] RBAC: Adding query filter params (name=service) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:07:18.442447 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04a69cd-a97b-48d5-b9b7-bd4f6a8ef01d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:18.443822 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04a69cd-a97b-48d5-b9b7-bd4f6a8ef01d None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:18.452220 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 324/634] 10.222.0.39 () {56 vars in 1103 bytes} [Thu Jun 16 17:07:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:07:18.453208 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 311/635] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 17:07:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 17:07:18.454566 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04a69cd-a97b-48d5-b9b7-bd4f6a8ef01d None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:18.454666 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eebc477-facd-45ec-a314-7cef5983bd6e None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:18.454666 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eebc477-facd-45ec-a314-7cef5983bd6e None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:18.454967 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eebc477-facd-45ec-a314-7cef5983bd6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:18.472244 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-5eebc477-facd-45ec-a314-7cef5983bd6e None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:07:18.473437 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-5eebc477-facd-45ec-a314-7cef5983bd6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:07:18.542168 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 312/636] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 17:07:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 17:07:18.543008 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eebc477-facd-45ec-a314-7cef5983bd6e None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:18.573572 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04a69cd-a97b-48d5-b9b7-bd4f6a8ef01d None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:18.608370 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2512c5-8434-4fc2-a146-34f7b4746085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:18.609284 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2512c5-8434-4fc2-a146-34f7b4746085 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:18.609576 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2512c5-8434-4fc2-a146-34f7b4746085 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:18.609891 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2512c5-8434-4fc2-a146-34f7b4746085 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:18.617532 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2512c5-8434-4fc2-a146-34f7b4746085 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:18.619052 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2512c5-8434-4fc2-a146-34f7b4746085 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:18.633264 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application [None req-be2512c5-8434-4fc2-a146-34f7b4746085 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 17:07:18.633264 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:07:18.633264 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:07:18.633264 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:07:18.633264 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:07:18.633264 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:07:18.633264 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:07:18.633264 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:07:18.633264 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:07:18.633264 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:07:18.633264 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:07:18.633264 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:07:18.633264 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 17:07:18.633264 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 17:07:18.633264 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 17:07:18.634398 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 17:07:18.634398 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:07:18.634398 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:07:18.634398 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:07:18.634398 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:07:18.634398 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:07:18.634398 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:07:18.634398 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:07:18.634398 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application with Lock( Jun 16 17:07:18.634398 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:07:18.634398 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:07:18.634398 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:07:18.634398 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:07:18.634398 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:07:18.634398 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:07:18.634398 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:07:18.634398 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:07:18.635687 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 17:07:18.635687 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 17:07:18.635687 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 17:07:18.635687 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 17:07:18.635687 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 17:07:18.635687 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 17:07:18.635687 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 17:07:18.635687 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Jun 16 17:07:18.635687 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 325/637] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 16 17:07:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:07:18.635687 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2512c5-8434-4fc2-a146-34f7b4746085 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:18.638309 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:18.645236 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eebc477-facd-45ec-a314-7cef5983bd6e None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:18.663181 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:18.679924 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48315723-79c8-427d-8e6d-da8dffda2673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:18.680715 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48315723-79c8-427d-8e6d-da8dffda2673 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:18.680994 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48315723-79c8-427d-8e6d-da8dffda2673 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:18.681266 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48315723-79c8-427d-8e6d-da8dffda2673 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:18.688313 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48315723-79c8-427d-8e6d-da8dffda2673 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:18.689730 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48315723-79c8-427d-8e6d-da8dffda2673 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:18.704374 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application [None req-48315723-79c8-427d-8e6d-da8dffda2673 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 17:07:18.704374 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:07:18.704374 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:07:18.704374 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:07:18.704374 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:07:18.704374 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:07:18.704374 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:07:18.704374 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:07:18.704374 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:07:18.704374 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:07:18.704374 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:07:18.704374 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:07:18.704374 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 17:07:18.704374 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 17:07:18.704374 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 17:07:18.709524 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 17:07:18.709524 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:07:18.709524 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:07:18.709524 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:07:18.709524 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:07:18.709524 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:07:18.709524 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:07:18.709524 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:07:18.709524 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application with Lock( Jun 16 17:07:18.709524 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:07:18.709524 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:07:18.709524 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:07:18.709524 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:07:18.709524 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:07:18.709524 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:07:18.709524 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:07:18.709524 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:07:18.710987 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 17:07:18.710987 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 17:07:18.710987 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 17:07:18.710987 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 17:07:18.710987 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 17:07:18.710987 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 17:07:18.710987 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 17:07:18.710987 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Jun 16 17:07:18.710987 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 313/638] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 16 17:07:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:07:18.710987 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48315723-79c8-427d-8e6d-da8dffda2673 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:18.735442 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2512c5-8434-4fc2-a146-34f7b4746085 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:18.777955 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e37fa2b-1282-4449-a1eb-46ed926ad10f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:18.778705 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e37fa2b-1282-4449-a1eb-46ed926ad10f None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:18.778990 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e37fa2b-1282-4449-a1eb-46ed926ad10f None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:18.779268 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e37fa2b-1282-4449-a1eb-46ed926ad10f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:18.789255 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e37fa2b-1282-4449-a1eb-46ed926ad10f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:18.790707 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e37fa2b-1282-4449-a1eb-46ed926ad10f None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:18.808150 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application [None req-6e37fa2b-1282-4449-a1eb-46ed926ad10f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:07:18.808150 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:07:18.808150 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:07:18.808150 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:07:18.808150 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:07:18.808150 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:07:18.808150 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:07:18.808150 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:07:18.808150 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:07:18.808150 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:07:18.808150 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:07:18.808150 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:07:18.808150 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 17:07:18.808150 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 17:07:18.808150 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 17:07:18.809957 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 17:07:18.809957 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:07:18.809957 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:07:18.809957 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:07:18.809957 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:07:18.809957 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:07:18.809957 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:07:18.809957 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:07:18.809957 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application with Lock( Jun 16 17:07:18.809957 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:07:18.809957 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:07:18.809957 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:07:18.809957 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:07:18.809957 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:07:18.809957 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:07:18.809957 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:07:18.809957 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:07:18.810873 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 17:07:18.810873 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 17:07:18.810873 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:07:18.810873 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Jun 16 17:07:18.810873 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 326/639] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 17:07:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:07:18.810873 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e37fa2b-1282-4449-a1eb-46ed926ad10f None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:18.811236 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48315723-79c8-427d-8e6d-da8dffda2673 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:18.846386 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be1a06c-8bb7-45f3-8900-2b196270eaf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:18.847179 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be1a06c-8bb7-45f3-8900-2b196270eaf2 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:18.847467 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be1a06c-8bb7-45f3-8900-2b196270eaf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:18.847748 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be1a06c-8bb7-45f3-8900-2b196270eaf2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:18.859757 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be1a06c-8bb7-45f3-8900-2b196270eaf2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 17:07:18.867474 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application [None req-2be1a06c-8bb7-45f3-8900-2b196270eaf2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 17:07:18.867474 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:07:18.867474 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:07:18.867474 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:07:18.867474 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:07:18.867474 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:07:18.867474 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:07:18.867474 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:07:18.867474 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:07:18.867474 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:07:18.867474 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:07:18.867474 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:07:18.867474 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 17:07:18.867474 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 17:07:18.867474 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 17:07:18.867474 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 17:07:18.868474 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 17:07:18.868474 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 17:07:18.868474 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 17:07:18.868474 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 17:07:18.868474 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:07:18.868474 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:07:18.868474 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:07:18.868474 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:07:18.868474 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:07:18.868474 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:07:18.868474 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:07:18.868474 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application with Lock( Jun 16 17:07:18.868474 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:07:18.868474 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:07:18.868474 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:07:18.868474 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:07:18.869369 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:07:18.869369 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:07:18.869369 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:07:18.869369 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:07:18.869369 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 17:07:18.869369 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 17:07:18.869369 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 17:07:18.869369 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 17:07:18.869369 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 17:07:18.869369 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 17:07:18.869369 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 17:07:18.869369 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Jun 16 17:07:18.869369 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 314/640] 10.222.0.39 () {56 vars in 1102 bytes} [Thu Jun 16 17:07:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:07:18.870116 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be1a06c-8bb7-45f3-8900-2b196270eaf2 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:18.890463 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:18.896811 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:18.916266 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e37fa2b-1282-4449-a1eb-46ed926ad10f None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:18.950760 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b50bab-9077-494d-ba11-ada8837cf33e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:18.951880 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b50bab-9077-494d-ba11-ada8837cf33e None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:18.952515 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b50bab-9077-494d-ba11-ada8837cf33e None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:18.952806 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b50bab-9077-494d-ba11-ada8837cf33e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:18.963645 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b50bab-9077-494d-ba11-ada8837cf33e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 17:07:18.971974 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application [None req-99b50bab-9077-494d-ba11-ada8837cf33e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 17:07:18.971974 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:07:18.971974 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:07:18.971974 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:07:18.971974 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:07:18.971974 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:07:18.971974 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:07:18.971974 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:07:18.971974 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:07:18.971974 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:07:18.971974 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:07:18.971974 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:07:18.971974 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 17:07:18.971974 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 17:07:18.971974 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 17:07:18.971974 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 17:07:18.973200 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 17:07:18.973200 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 17:07:18.973200 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 17:07:18.973200 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 17:07:18.973200 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:07:18.973200 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:07:18.973200 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:07:18.973200 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:07:18.973200 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:07:18.973200 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:07:18.973200 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:07:18.973200 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application with Lock( Jun 16 17:07:18.973200 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:07:18.973200 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:07:18.973200 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:07:18.973200 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:07:18.974151 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:07:18.974151 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:07:18.974151 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:07:18.974151 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:07:18.974151 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 17:07:18.974151 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 17:07:18.974151 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 17:07:18.974151 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 17:07:18.974151 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 17:07:18.974151 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 17:07:18.974151 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 17:07:18.974151 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Jun 16 17:07:18.974151 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 327/641] 10.222.0.39 () {56 vars in 1102 bytes} [Thu Jun 16 17:07:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:07:18.974151 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b50bab-9077-494d-ba11-ada8837cf33e None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:18.977668 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be1a06c-8bb7-45f3-8900-2b196270eaf2 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:19.011350 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bc66b5-bc50-4933-a286-a0fdb2f5f704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:19.012146 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bc66b5-bc50-4933-a286-a0fdb2f5f704 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:19.012438 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bc66b5-bc50-4933-a286-a0fdb2f5f704 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:19.012720 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bc66b5-bc50-4933-a286-a0fdb2f5f704 None admin] PATH_INFO: `/v3/projects` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:19.013508 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bc66b5-bc50-4933-a286-a0fdb2f5f704 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80873) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:07:19.013856 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bc66b5-bc50-4933-a286-a0fdb2f5f704 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:19.015283 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bc66b5-bc50-4933-a286-a0fdb2f5f704 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:19.027404 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 315/642] 10.222.0.39 () {56 vars in 1148 bytes} [Thu Jun 16 17:07:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:07:19.028205 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bc66b5-bc50-4933-a286-a0fdb2f5f704 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:19.075834 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b50bab-9077-494d-ba11-ada8837cf33e None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:19.106529 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:19.110098 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdd3b5a-35e5-4cbb-8f67-6f45834b98b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:19.110768 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdd3b5a-35e5-4cbb-8f67-6f45834b98b1 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:19.111060 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdd3b5a-35e5-4cbb-8f67-6f45834b98b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:19.111344 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdd3b5a-35e5-4cbb-8f67-6f45834b98b1 None admin] PATH_INFO: `/v3/projects` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:19.112135 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdd3b5a-35e5-4cbb-8f67-6f45834b98b1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:07:19.112452 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdd3b5a-35e5-4cbb-8f67-6f45834b98b1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:19.113910 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdd3b5a-35e5-4cbb-8f67-6f45834b98b1 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:19.123454 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:19.126859 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 328/643] 10.222.0.39 () {56 vars in 1148 bytes} [Thu Jun 16 17:07:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:07:19.127740 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdd3b5a-35e5-4cbb-8f67-6f45834b98b1 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:19.132293 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bc66b5-bc50-4933-a286-a0fdb2f5f704 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:19.167953 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ac13b0-82b2-4d3f-aade-24aeb520749e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:19.169130 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ac13b0-82b2-4d3f-aade-24aeb520749e None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:19.169411 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ac13b0-82b2-4d3f-aade-24aeb520749e None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:19.169692 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ac13b0-82b2-4d3f-aade-24aeb520749e None admin] PATH_INFO: `/v3/domains` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:19.170452 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ac13b0-82b2-4d3f-aade-24aeb520749e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80873) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:07:19.170766 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ac13b0-82b2-4d3f-aade-24aeb520749e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:19.172165 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ac13b0-82b2-4d3f-aade-24aeb520749e None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:19.183473 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 316/644] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 16 17:07:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:07:19.184267 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ac13b0-82b2-4d3f-aade-24aeb520749e None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:19.227975 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdd3b5a-35e5-4cbb-8f67-6f45834b98b1 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:19.261450 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37b0944-44e2-472b-ba78-3e2cd064a16f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:19.262242 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37b0944-44e2-472b-ba78-3e2cd064a16f None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:19.262538 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37b0944-44e2-472b-ba78-3e2cd064a16f None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:19.262985 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37b0944-44e2-472b-ba78-3e2cd064a16f None admin] PATH_INFO: `/v3/roles` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:19.263745 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37b0944-44e2-472b-ba78-3e2cd064a16f None admin] RBAC: Adding query filter params (name=service) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:07:19.264064 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37b0944-44e2-472b-ba78-3e2cd064a16f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:19.265433 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37b0944-44e2-472b-ba78-3e2cd064a16f None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:19.273926 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 329/645] 10.222.0.39 () {56 vars in 1103 bytes} [Thu Jun 16 17:07:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:07:19.274695 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37b0944-44e2-472b-ba78-3e2cd064a16f None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:19.284768 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ac13b0-82b2-4d3f-aade-24aeb520749e None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:19.317857 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ec9037-4447-4058-a278-5338948d5b11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:19.318530 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ec9037-4447-4058-a278-5338948d5b11 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:19.318820 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ec9037-4447-4058-a278-5338948d5b11 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:19.319104 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ec9037-4447-4058-a278-5338948d5b11 None admin] PATH_INFO: `/v3/roles` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:19.319859 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ec9037-4447-4058-a278-5338948d5b11 None admin] RBAC: Adding query filter params (name=service) {{(pid=80873) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:07:19.320176 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ec9037-4447-4058-a278-5338948d5b11 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:19.321544 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ec9037-4447-4058-a278-5338948d5b11 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:19.322988 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:19.330943 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 317/646] 10.222.0.39 () {56 vars in 1103 bytes} [Thu Jun 16 17:07:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:07:19.335640 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ec9037-4447-4058-a278-5338948d5b11 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:19.344577 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:19.383856 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37b0944-44e2-472b-ba78-3e2cd064a16f None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:19.418031 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7832c3f-63be-45fb-9162-6df7e91e7aec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:19.419668 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7832c3f-63be-45fb-9162-6df7e91e7aec None admin] REQUEST_METHOD: `PUT` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:19.419957 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7832c3f-63be-45fb-9162-6df7e91e7aec None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:19.420236 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7832c3f-63be-45fb-9162-6df7e91e7aec None admin] PATH_INFO: `/v3/projects/73015da4de1f48c29f57fff1040d2c10/users/bbec2dfe63764ed88a23e172ead0afa4/roles/a12797d48dac420cb2eaadbe537f60ef` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:19.435029 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ec9037-4447-4058-a278-5338948d5b11 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:19.435524 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7832c3f-63be-45fb-9162-6df7e91e7aec None admin] RBAC: Authorizing `identity:create_grant(project_id=73015da4de1f48c29f57fff1040d2c10, user_id=bbec2dfe63764ed88a23e172ead0afa4, role_id=a12797d48dac420cb2eaadbe537f60ef)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:19.436437 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7832c3f-63be-45fb-9162-6df7e91e7aec None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:19.469778 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463619a7-01ad-45f7-a17e-c711cdb1a065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:19.470428 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463619a7-01ad-45f7-a17e-c711cdb1a065 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:19.470721 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463619a7-01ad-45f7-a17e-c711cdb1a065 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:19.471040 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463619a7-01ad-45f7-a17e-c711cdb1a065 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:19.471874 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463619a7-01ad-45f7-a17e-c711cdb1a065 None admin] RBAC: Adding query filter params (role.id=a12797d48dac420cb2eaadbe537f60ef, scope.project.id=73015da4de1f48c29f57fff1040d2c10, user.id=3985eae1ec3240129eec8d1f4d8d21e8) {{(pid=80873) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:07:19.472193 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463619a7-01ad-45f7-a17e-c711cdb1a065 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:19.473610 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463619a7-01ad-45f7-a17e-c711cdb1a065 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:19.479615 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 318/647] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jun 16 17:07:19 2022] GET /identity/v3/role_assignments?user.id=3985eae1ec3240129eec8d1f4d8d21e8&scope.project.id=73015da4de1f48c29f57fff1040d2c10&role.id=a12797d48dac420cb2eaadbe537f60ef => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:07:19.480384 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463619a7-01ad-45f7-a17e-c711cdb1a065 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:19.519681 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 330/648] 10.222.0.39 () {58 vars in 1439 bytes} [Thu Jun 16 17:07:19 2022] PUT /identity/v3/projects/73015da4de1f48c29f57fff1040d2c10/users/bbec2dfe63764ed88a23e172ead0afa4/roles/a12797d48dac420cb2eaadbe537f60ef => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:07:19.520239 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7832c3f-63be-45fb-9162-6df7e91e7aec None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:19.566811 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:19.625642 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463619a7-01ad-45f7-a17e-c711cdb1a065 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:19.669058 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7832c3f-63be-45fb-9162-6df7e91e7aec None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:19.683747 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f25241-32eb-4921-a2f5-82f521eae32b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:19.685337 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f25241-32eb-4921-a2f5-82f521eae32b None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:19.685337 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f25241-32eb-4921-a2f5-82f521eae32b None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:19.685337 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f25241-32eb-4921-a2f5-82f521eae32b None admin] PATH_INFO: `/v3/users/nova` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:19.690319 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:19.695766 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f25241-32eb-4921-a2f5-82f521eae32b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:19.697989 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f25241-32eb-4921-a2f5-82f521eae32b None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:19.720648 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application [None req-84f25241-32eb-4921-a2f5-82f521eae32b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 16 17:07:19.720648 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:07:19.720648 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:07:19.720648 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:07:19.720648 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:07:19.720648 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:07:19.720648 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:07:19.720648 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:07:19.720648 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:07:19.720648 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:07:19.720648 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:07:19.720648 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:07:19.720648 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 17:07:19.720648 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 17:07:19.720648 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 17:07:19.720648 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 17:07:19.721685 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:07:19.721685 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:07:19.721685 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 17:07:19.721685 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 17:07:19.721685 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 17:07:19.721685 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 17:07:19.721685 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:07:19.721685 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:07:19.721685 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:07:19.721685 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:07:19.721685 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:07:19.721685 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application with Lock( Jun 16 17:07:19.721685 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:07:19.721685 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:07:19.721685 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:07:19.721685 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:07:19.721685 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:07:19.721685 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:07:19.722669 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:07:19.722669 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:07:19.722669 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 17:07:19.722669 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 17:07:19.722669 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 17:07:19.722669 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 17:07:19.722669 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 17:07:19.722669 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 17:07:19.722669 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 16 17:07:19.722669 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Jun 16 17:07:19.723224 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30619cdb-44b9-44d4-a2d7-af7b998bd3a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:19.723316 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 319/649] 10.222.0.39 () {56 vars in 1093 bytes} [Thu Jun 16 17:07:19 2022] GET /identity/v3/users/nova => generated 82 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:07:19.723386 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30619cdb-44b9-44d4-a2d7-af7b998bd3a3 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:19.723461 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f25241-32eb-4921-a2f5-82f521eae32b None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:19.723538 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30619cdb-44b9-44d4-a2d7-af7b998bd3a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:19.723538 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30619cdb-44b9-44d4-a2d7-af7b998bd3a3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:19.737603 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30619cdb-44b9-44d4-a2d7-af7b998bd3a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:19.739241 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30619cdb-44b9-44d4-a2d7-af7b998bd3a3 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:19.759217 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application [None req-30619cdb-44b9-44d4-a2d7-af7b998bd3a3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:07:19.759217 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:07:19.759217 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:07:19.759217 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:07:19.759217 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:07:19.759217 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:07:19.759217 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:07:19.759217 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:07:19.759217 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:07:19.759217 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:07:19.759217 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:07:19.759217 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:07:19.759217 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 17:07:19.759217 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 17:07:19.759217 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 17:07:19.760187 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 17:07:19.760187 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:07:19.760187 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:07:19.760187 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:07:19.760187 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:07:19.760187 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:07:19.760187 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:07:19.760187 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:07:19.760187 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application with Lock( Jun 16 17:07:19.760187 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:07:19.760187 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:07:19.760187 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:07:19.760187 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:07:19.760187 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:07:19.760187 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:07:19.760187 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:07:19.760187 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:07:19.761082 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 17:07:19.761082 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 17:07:19.761082 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:07:19.761082 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Jun 16 17:07:19.761082 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 331/650] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 17:07:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:07:19.761370 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30619cdb-44b9-44d4-a2d7-af7b998bd3a3 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:19.846900 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f25241-32eb-4921-a2f5-82f521eae32b None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:19.876890 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:19.885004 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30619cdb-44b9-44d4-a2d7-af7b998bd3a3 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:19.903064 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701a7254-dc41-410d-909e-f0564a598d77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:19.904997 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701a7254-dc41-410d-909e-f0564a598d77 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:19.905507 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701a7254-dc41-410d-909e-f0564a598d77 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:19.906278 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701a7254-dc41-410d-909e-f0564a598d77 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:19.921012 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701a7254-dc41-410d-909e-f0564a598d77 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:19.923839 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701a7254-dc41-410d-909e-f0564a598d77 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:19.928104 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8837ef9c-6235-47ba-8fce-62a1ce596081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:19.928784 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8837ef9c-6235-47ba-8fce-62a1ce596081 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:19.929072 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8837ef9c-6235-47ba-8fce-62a1ce596081 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:19.929355 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8837ef9c-6235-47ba-8fce-62a1ce596081 None admin] PATH_INFO: `/v3/users` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:19.930232 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8837ef9c-6235-47ba-8fce-62a1ce596081 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:07:19.930555 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8837ef9c-6235-47ba-8fce-62a1ce596081 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:19.931960 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8837ef9c-6235-47ba-8fce-62a1ce596081 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:19.948583 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application [None req-701a7254-dc41-410d-909e-f0564a598d77 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:07:19.948583 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:07:19.948583 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:07:19.948583 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:07:19.948583 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:07:19.948583 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:07:19.948583 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:07:19.948583 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:07:19.948583 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:07:19.948583 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:07:19.948583 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:07:19.948583 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:07:19.948583 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 17:07:19.948583 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 17:07:19.948583 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 17:07:19.950145 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 17:07:19.950145 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:07:19.950145 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:07:19.950145 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:07:19.950145 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:07:19.950145 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:07:19.950145 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:07:19.950145 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:07:19.950145 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application with Lock( Jun 16 17:07:19.950145 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:07:19.950145 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:07:19.950145 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:07:19.950145 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:07:19.950145 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:07:19.950145 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:07:19.950145 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:07:19.950145 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:07:19.951056 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 17:07:19.951056 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 17:07:19.951056 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:07:19.951056 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Jun 16 17:07:19.952424 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 320/651] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 17:07:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:07:19.954654 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701a7254-dc41-410d-909e-f0564a598d77 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:19.959568 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 332/652] 10.222.0.39 () {56 vars in 1133 bytes} [Thu Jun 16 17:07:19 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:07:19.959962 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8837ef9c-6235-47ba-8fce-62a1ce596081 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:19.985363 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:20.085323 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8837ef9c-6235-47ba-8fce-62a1ce596081 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:20.089733 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701a7254-dc41-410d-909e-f0564a598d77 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:20.130966 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e2e9ae-5016-46d5-ba80-2c29895e00e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:20.131735 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e2e9ae-5016-46d5-ba80-2c29895e00e9 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:20.132094 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e2e9ae-5016-46d5-ba80-2c29895e00e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:20.132450 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e2e9ae-5016-46d5-ba80-2c29895e00e9 None admin] PATH_INFO: `/v3/domains` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:20.133246 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e2e9ae-5016-46d5-ba80-2c29895e00e9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:07:20.133633 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e2e9ae-5016-46d5-ba80-2c29895e00e9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:20.135444 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e2e9ae-5016-46d5-ba80-2c29895e00e9 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:20.137727 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159d88c1-d76a-4cf9-87b8-cc39e20a05bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:20.139199 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159d88c1-d76a-4cf9-87b8-cc39e20a05bd None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:20.139708 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159d88c1-d76a-4cf9-87b8-cc39e20a05bd None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:20.140220 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159d88c1-d76a-4cf9-87b8-cc39e20a05bd None admin] PATH_INFO: `/v3/domains` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:20.141152 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159d88c1-d76a-4cf9-87b8-cc39e20a05bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80873) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:07:20.141657 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159d88c1-d76a-4cf9-87b8-cc39e20a05bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:20.143789 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159d88c1-d76a-4cf9-87b8-cc39e20a05bd None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:20.148781 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 333/653] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 16 17:07:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:07:20.149928 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e2e9ae-5016-46d5-ba80-2c29895e00e9 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:20.159956 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 321/654] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 16 17:07:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:07:20.161064 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159d88c1-d76a-4cf9-87b8-cc39e20a05bd None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:20.205051 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:20.248311 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:20.272223 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e2e9ae-5016-46d5-ba80-2c29895e00e9 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:20.283066 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159d88c1-d76a-4cf9-87b8-cc39e20a05bd None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:20.317749 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f7162c-4439-4034-b676-a12e7819d309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:20.318987 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f7162c-4439-4034-b676-a12e7819d309 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:20.319530 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f7162c-4439-4034-b676-a12e7819d309 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:20.319966 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f7162c-4439-4034-b676-a12e7819d309 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:20.320563 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80a7fe0-07db-41dc-bed7-450f706cb396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:20.321682 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80a7fe0-07db-41dc-bed7-450f706cb396 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:20.322093 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80a7fe0-07db-41dc-bed7-450f706cb396 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:20.322473 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80a7fe0-07db-41dc-bed7-450f706cb396 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:20.338424 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80a7fe0-07db-41dc-bed7-450f706cb396 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:20.341086 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80a7fe0-07db-41dc-bed7-450f706cb396 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:20.361416 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application [None req-d80a7fe0-07db-41dc-bed7-450f706cb396 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 16 17:07:20.361416 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:07:20.361416 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:07:20.361416 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:07:20.361416 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:07:20.361416 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:07:20.361416 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:07:20.361416 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:07:20.361416 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:07:20.361416 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:07:20.361416 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:07:20.361416 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:07:20.361416 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 17:07:20.361416 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 17:07:20.361416 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 17:07:20.361416 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 17:07:20.362681 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:07:20.362681 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:07:20.362681 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 17:07:20.362681 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 17:07:20.362681 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 17:07:20.362681 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 17:07:20.362681 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:07:20.362681 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:07:20.362681 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:07:20.362681 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:07:20.362681 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:07:20.362681 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application with Lock( Jun 16 17:07:20.362681 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:07:20.362681 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:07:20.362681 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:07:20.362681 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:07:20.362681 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:07:20.362681 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:07:20.363912 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:07:20.363912 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:07:20.363912 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 17:07:20.363912 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 17:07:20.363912 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 17:07:20.363912 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 17:07:20.363912 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 17:07:20.363912 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 17:07:20.363912 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 16 17:07:20.363912 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Jun 16 17:07:20.365973 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 322/655] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 16 17:07:20 2022] GET /identity/v3/users/cinder => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:07:20.366927 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80a7fe0-07db-41dc-bed7-450f706cb396 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:20.401467 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f7162c-4439-4034-b676-a12e7819d309 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:20.403840 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f7162c-4439-4034-b676-a12e7819d309 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:20.487868 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:20.497919 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:20.500255 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80a7fe0-07db-41dc-bed7-450f706cb396 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:20.522968 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 334/656] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 16 17:07:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 17:07:20.524154 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f7162c-4439-4034-b676-a12e7819d309 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:20.540818 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01df378-0987-4c0c-ad9f-f1a3c6dbffca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:20.541738 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01df378-0987-4c0c-ad9f-f1a3c6dbffca None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:20.542060 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01df378-0987-4c0c-ad9f-f1a3c6dbffca None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:20.542345 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01df378-0987-4c0c-ad9f-f1a3c6dbffca None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:20.552578 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01df378-0987-4c0c-ad9f-f1a3c6dbffca None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:20.554657 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01df378-0987-4c0c-ad9f-f1a3c6dbffca None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:20.576913 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application [None req-b01df378-0987-4c0c-ad9f-f1a3c6dbffca None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 16 17:07:20.576913 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:07:20.576913 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:07:20.576913 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:07:20.576913 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:07:20.576913 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:07:20.576913 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:07:20.576913 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:07:20.576913 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:07:20.576913 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:07:20.576913 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:07:20.576913 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:07:20.576913 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 17:07:20.576913 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 17:07:20.576913 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 17:07:20.576913 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 17:07:20.577946 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:07:20.577946 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:07:20.577946 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 17:07:20.577946 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 17:07:20.577946 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 17:07:20.577946 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 17:07:20.577946 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:07:20.577946 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:07:20.577946 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:07:20.577946 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:07:20.577946 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:07:20.577946 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application with Lock( Jun 16 17:07:20.577946 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:07:20.577946 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:07:20.577946 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:07:20.577946 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:07:20.577946 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:07:20.577946 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:07:20.579490 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:07:20.579490 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:07:20.579490 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 17:07:20.579490 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 17:07:20.579490 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 17:07:20.579490 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 17:07:20.579490 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 17:07:20.579490 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 17:07:20.579490 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 16 17:07:20.579490 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Jun 16 17:07:20.579490 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 323/657] 10.222.0.39 () {56 vars in 1102 bytes} [Thu Jun 16 17:07:20 2022] GET /identity/v3/users/neutron => generated 85 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:07:20.579490 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01df378-0987-4c0c-ad9f-f1a3c6dbffca None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:20.635050 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f7162c-4439-4034-b676-a12e7819d309 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:20.697666 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccaa35e-620c-4845-89d4-a48953f0a877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:20.698766 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccaa35e-620c-4845-89d4-a48953f0a877 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:20.699315 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccaa35e-620c-4845-89d4-a48953f0a877 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:20.699891 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccaa35e-620c-4845-89d4-a48953f0a877 None admin] PATH_INFO: `/v3/users` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:20.700968 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccaa35e-620c-4845-89d4-a48953f0a877 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:07:20.701504 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccaa35e-620c-4845-89d4-a48953f0a877 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:20.703171 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccaa35e-620c-4845-89d4-a48953f0a877 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:20.710379 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01df378-0987-4c0c-ad9f-f1a3c6dbffca None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:20.723138 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 335/658] 10.222.0.39 () {56 vars in 1137 bytes} [Thu Jun 16 17:07:20 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:07:20.724446 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccaa35e-620c-4845-89d4-a48953f0a877 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:20.751679 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f2c44f-f9c1-4e0a-9e0d-eae3e3df29d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:20.752435 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f2c44f-f9c1-4e0a-9e0d-eae3e3df29d8 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:20.752723 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f2c44f-f9c1-4e0a-9e0d-eae3e3df29d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:20.753009 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f2c44f-f9c1-4e0a-9e0d-eae3e3df29d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:20.765663 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f2c44f-f9c1-4e0a-9e0d-eae3e3df29d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:20.767270 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f2c44f-f9c1-4e0a-9e0d-eae3e3df29d8 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:20.774550 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:20.790227 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application [None req-b0f2c44f-f9c1-4e0a-9e0d-eae3e3df29d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:07:20.790227 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:07:20.790227 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:07:20.790227 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:07:20.790227 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:07:20.790227 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:07:20.790227 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:07:20.790227 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:07:20.790227 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:07:20.790227 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:07:20.790227 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:07:20.790227 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:07:20.790227 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 17:07:20.790227 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 17:07:20.790227 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 17:07:20.802581 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 17:07:20.802581 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:07:20.802581 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:07:20.802581 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:07:20.802581 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:07:20.802581 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:07:20.802581 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:07:20.802581 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:07:20.802581 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application with Lock( Jun 16 17:07:20.802581 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:07:20.802581 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:07:20.802581 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:07:20.802581 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:07:20.802581 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:07:20.802581 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:07:20.802581 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:07:20.802581 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:07:20.803840 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 17:07:20.803840 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 17:07:20.803840 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:07:20.803840 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Jun 16 17:07:20.804779 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 324/659] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 17:07:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:07:20.805926 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f2c44f-f9c1-4e0a-9e0d-eae3e3df29d8 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:20.822139 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:20.841179 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccaa35e-620c-4845-89d4-a48953f0a877 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:20.889880 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2b5a58-1028-4fb5-9b73-c3f6cd38cd66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:20.891488 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2b5a58-1028-4fb5-9b73-c3f6cd38cd66 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:20.891781 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2b5a58-1028-4fb5-9b73-c3f6cd38cd66 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:20.892061 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2b5a58-1028-4fb5-9b73-c3f6cd38cd66 None admin] PATH_INFO: `/v3/users` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:20.892909 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2b5a58-1028-4fb5-9b73-c3f6cd38cd66 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:07:20.893223 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2b5a58-1028-4fb5-9b73-c3f6cd38cd66 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:20.895391 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2b5a58-1028-4fb5-9b73-c3f6cd38cd66 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:20.919125 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 336/660] 10.222.0.39 () {56 vars in 1139 bytes} [Thu Jun 16 17:07:20 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:07:20.920270 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2b5a58-1028-4fb5-9b73-c3f6cd38cd66 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:20.946167 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f2c44f-f9c1-4e0a-9e0d-eae3e3df29d8 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:20.982961 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba774ad-7ce3-48e7-b5c2-ab5d8c6be0a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:20.983621 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba774ad-7ce3-48e7-b5c2-ab5d8c6be0a4 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:20.983908 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba774ad-7ce3-48e7-b5c2-ab5d8c6be0a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:20.984189 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba774ad-7ce3-48e7-b5c2-ab5d8c6be0a4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:21.033165 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:21.041133 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2b5a58-1028-4fb5-9b73-c3f6cd38cd66 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:21.063854 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba774ad-7ce3-48e7-b5c2-ab5d8c6be0a4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:21.065665 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba774ad-7ce3-48e7-b5c2-ab5d8c6be0a4 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:21.068976 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:21.086880 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b1a351-c250-4438-a23e-d5f65b20421a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:21.087871 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b1a351-c250-4438-a23e-d5f65b20421a None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:21.088329 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b1a351-c250-4438-a23e-d5f65b20421a None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:21.091498 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b1a351-c250-4438-a23e-d5f65b20421a None admin] PATH_INFO: `/v3/domains` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:21.091498 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b1a351-c250-4438-a23e-d5f65b20421a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:07:21.091498 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b1a351-c250-4438-a23e-d5f65b20421a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:21.093503 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b1a351-c250-4438-a23e-d5f65b20421a None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:21.108389 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 337/661] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 16 17:07:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:07:21.109565 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b1a351-c250-4438-a23e-d5f65b20421a None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:21.174053 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 325/662] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 16 17:07:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 17:07:21.175045 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba774ad-7ce3-48e7-b5c2-ab5d8c6be0a4 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:21.220023 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b1a351-c250-4438-a23e-d5f65b20421a None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:21.264465 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2272af8-c0ad-44bd-bc12-a7161c2d960e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:21.265144 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2272af8-c0ad-44bd-bc12-a7161c2d960e None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:21.265434 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2272af8-c0ad-44bd-bc12-a7161c2d960e None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:21.265716 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2272af8-c0ad-44bd-bc12-a7161c2d960e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:21.292494 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba774ad-7ce3-48e7-b5c2-ab5d8c6be0a4 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:21.300675 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:21.322219 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:21.334575 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc09d35-a815-4176-87e7-762a923f7e0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:21.336187 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc09d35-a815-4176-87e7-762a923f7e0e None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:21.337000 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc09d35-a815-4176-87e7-762a923f7e0e None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:21.337495 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc09d35-a815-4176-87e7-762a923f7e0e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:21.349089 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc09d35-a815-4176-87e7-762a923f7e0e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:21.350796 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2272af8-c0ad-44bd-bc12-a7161c2d960e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:21.351709 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc09d35-a815-4176-87e7-762a923f7e0e None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:21.352251 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2272af8-c0ad-44bd-bc12-a7161c2d960e None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:21.382098 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application [None req-ebc09d35-a815-4176-87e7-762a923f7e0e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 17:07:21.382098 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:07:21.382098 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:07:21.382098 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:07:21.382098 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:07:21.382098 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:07:21.382098 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:07:21.382098 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:07:21.382098 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:07:21.382098 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:07:21.382098 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:07:21.382098 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:07:21.382098 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 17:07:21.382098 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 17:07:21.382098 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 17:07:21.383096 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 17:07:21.383096 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:07:21.383096 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:07:21.383096 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:07:21.383096 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:07:21.383096 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:07:21.383096 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:07:21.383096 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:07:21.383096 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application with Lock( Jun 16 17:07:21.383096 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:07:21.383096 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:07:21.383096 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:07:21.383096 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:07:21.383096 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:07:21.383096 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:07:21.383096 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:07:21.383096 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:07:21.384028 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 17:07:21.384028 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 17:07:21.384028 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 17:07:21.384028 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 17:07:21.384028 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 17:07:21.384028 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 17:07:21.384028 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 17:07:21.384028 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Jun 16 17:07:21.384028 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 326/663] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 16 17:07:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:07:21.385267 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc09d35-a815-4176-87e7-762a923f7e0e None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:21.486728 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 338/664] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 16 17:07:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 17:07:21.487940 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2272af8-c0ad-44bd-bc12-a7161c2d960e None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:21.529698 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc09d35-a815-4176-87e7-762a923f7e0e None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:21.567726 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6d1ccd-4125-49e9-9c69-2d51e73c63e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:21.568454 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6d1ccd-4125-49e9-9c69-2d51e73c63e2 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:21.568745 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6d1ccd-4125-49e9-9c69-2d51e73c63e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:21.569028 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6d1ccd-4125-49e9-9c69-2d51e73c63e2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:21.573579 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:21.582642 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6d1ccd-4125-49e9-9c69-2d51e73c63e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:21.584332 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6d1ccd-4125-49e9-9c69-2d51e73c63e2 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:21.604617 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application [None req-2e6d1ccd-4125-49e9-9c69-2d51e73c63e2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:07:21.604617 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:07:21.604617 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:07:21.604617 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:07:21.604617 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:07:21.604617 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:07:21.604617 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:07:21.604617 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:07:21.604617 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:07:21.604617 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:07:21.604617 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:07:21.604617 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:07:21.604617 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 17:07:21.604617 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 17:07:21.604617 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 17:07:21.605593 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 17:07:21.605593 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:07:21.605593 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:07:21.605593 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:07:21.605593 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:07:21.605593 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:07:21.605593 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:07:21.605593 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:07:21.605593 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application with Lock( Jun 16 17:07:21.605593 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:07:21.605593 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:07:21.605593 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:07:21.605593 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:07:21.605593 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:07:21.605593 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:07:21.605593 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:07:21.605593 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:07:21.607153 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 17:07:21.607153 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 17:07:21.607153 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:07:21.607153 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Jun 16 17:07:21.609455 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 327/665] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 17:07:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:07:21.610586 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6d1ccd-4125-49e9-9c69-2d51e73c63e2 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:21.624983 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2272af8-c0ad-44bd-bc12-a7161c2d960e None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:21.631347 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:21.676017 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fa3795-fce7-40ff-9d87-683d7ec07595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:21.676918 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fa3795-fce7-40ff-9d87-683d7ec07595 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:21.677457 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fa3795-fce7-40ff-9d87-683d7ec07595 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:21.677817 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fa3795-fce7-40ff-9d87-683d7ec07595 None admin] PATH_INFO: `/v3/projects` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:21.679061 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fa3795-fce7-40ff-9d87-683d7ec07595 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:07:21.679384 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fa3795-fce7-40ff-9d87-683d7ec07595 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:21.681484 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fa3795-fce7-40ff-9d87-683d7ec07595 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:21.699999 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 339/666] 10.222.0.39 () {56 vars in 1148 bytes} [Thu Jun 16 17:07:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:07:21.700918 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fa3795-fce7-40ff-9d87-683d7ec07595 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:21.733028 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6d1ccd-4125-49e9-9c69-2d51e73c63e2 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:21.772494 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ebfa11-7a55-485f-bdfd-6fe69c46ef39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:21.773304 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ebfa11-7a55-485f-bdfd-6fe69c46ef39 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:21.773593 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ebfa11-7a55-485f-bdfd-6fe69c46ef39 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:21.773909 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ebfa11-7a55-485f-bdfd-6fe69c46ef39 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:21.787099 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ebfa11-7a55-485f-bdfd-6fe69c46ef39 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:21.788626 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ebfa11-7a55-485f-bdfd-6fe69c46ef39 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:21.810008 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application [None req-18ebfa11-7a55-485f-bdfd-6fe69c46ef39 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:07:21.810008 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:07:21.810008 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:07:21.810008 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:07:21.810008 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:07:21.810008 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:07:21.810008 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:07:21.810008 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:07:21.810008 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:07:21.810008 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:07:21.810008 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:07:21.810008 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:07:21.810008 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 17:07:21.810008 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 17:07:21.810008 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 17:07:21.810985 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 17:07:21.810985 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:07:21.810985 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:07:21.810985 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:07:21.810985 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:07:21.810985 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:07:21.810985 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:07:21.810985 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:07:21.810985 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application with Lock( Jun 16 17:07:21.810985 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:07:21.810985 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:07:21.810985 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:07:21.810985 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:07:21.810985 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:07:21.810985 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:07:21.810985 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:07:21.810985 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:07:21.811990 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 17:07:21.811990 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 17:07:21.811990 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:07:21.811990 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Jun 16 17:07:21.811990 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 328/667] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 17:07:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:07:21.812279 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ebfa11-7a55-485f-bdfd-6fe69c46ef39 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:21.834644 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fa3795-fce7-40ff-9d87-683d7ec07595 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:21.857669 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:21.875320 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c42253-6d26-47d8-a45c-0c575712b5ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:21.875985 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c42253-6d26-47d8-a45c-0c575712b5ac None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:21.876278 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c42253-6d26-47d8-a45c-0c575712b5ac None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:21.876590 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c42253-6d26-47d8-a45c-0c575712b5ac None admin] PATH_INFO: `/v3/domains` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:21.877284 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c42253-6d26-47d8-a45c-0c575712b5ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:07:21.877591 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c42253-6d26-47d8-a45c-0c575712b5ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:21.879012 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c42253-6d26-47d8-a45c-0c575712b5ac None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:21.883019 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:21.892696 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 340/668] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 16 17:07:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:07:21.894062 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848dd98d-2229-4f56-b002-fde626d51632 None None] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:21.894359 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848dd98d-2229-4f56-b002-fde626d51632 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:21.894640 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848dd98d-2229-4f56-b002-fde626d51632 None None] PATH_INFO: `/` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:21.895864 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 341/669] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 17:07:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:07:21.896551 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848dd98d-2229-4f56-b002-fde626d51632 None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:21.920440 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ebfa11-7a55-485f-bdfd-6fe69c46ef39 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:21.954068 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0183c7-f648-48de-b7d0-7eebc61b279a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:21.954720 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0183c7-f648-48de-b7d0-7eebc61b279a None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:21.955005 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0183c7-f648-48de-b7d0-7eebc61b279a None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:21.955285 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0183c7-f648-48de-b7d0-7eebc61b279a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:21.956117 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0183c7-f648-48de-b7d0-7eebc61b279a None admin] RBAC: Adding query filter params (role.id=a12797d48dac420cb2eaadbe537f60ef, scope.project.id=73015da4de1f48c29f57fff1040d2c10, user.id=3d381bb41dea4f1e90c3cf3815ac88dc) {{(pid=80873) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:07:21.956437 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0183c7-f648-48de-b7d0-7eebc61b279a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:21.957887 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0183c7-f648-48de-b7d0-7eebc61b279a None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:21.963655 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 329/670] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jun 16 17:07:21 2022] GET /identity/v3/role_assignments?user.id=3d381bb41dea4f1e90c3cf3815ac88dc&scope.project.id=73015da4de1f48c29f57fff1040d2c10&role.id=a12797d48dac420cb2eaadbe537f60ef => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:07:21.964842 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42e494c-bcbd-43ba-8477-f718b9aff3cd None None] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:21.965367 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42e494c-bcbd-43ba-8477-f718b9aff3cd None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:21.965477 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42e494c-bcbd-43ba-8477-f718b9aff3cd None None] PATH_INFO: `/` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:21.966737 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 330/671] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 17:07:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:07:21.967439 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42e494c-bcbd-43ba-8477-f718b9aff3cd None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:22.012510 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848dd98d-2229-4f56-b002-fde626d51632 None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:22.051873 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085e34fb-4226-4ab8-9f54-154af61a55e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:22.052681 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085e34fb-4226-4ab8-9f54-154af61a55e9 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:22.053036 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085e34fb-4226-4ab8-9f54-154af61a55e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:22.053386 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085e34fb-4226-4ab8-9f54-154af61a55e9 None admin] PATH_INFO: `/v3/domains` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:22.054185 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085e34fb-4226-4ab8-9f54-154af61a55e9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:07:22.054500 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085e34fb-4226-4ab8-9f54-154af61a55e9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:22.055926 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085e34fb-4226-4ab8-9f54-154af61a55e9 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:22.069237 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 342/672] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 16 17:07:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:07:22.072487 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11211a05-f271-4fb7-a4b3-8eb83136029f None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:22.072790 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11211a05-f271-4fb7-a4b3-8eb83136029f None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:22.073076 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11211a05-f271-4fb7-a4b3-8eb83136029f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:22.096167 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-11211a05-f271-4fb7-a4b3-8eb83136029f None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:07:22.097679 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-11211a05-f271-4fb7-a4b3-8eb83136029f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:07:22.098458 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42e494c-bcbd-43ba-8477-f718b9aff3cd None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:22.132583 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:22.138745 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:22.140441 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f083d31-4302-4f79-a713-9e9614860f52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:22.141280 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f083d31-4302-4f79-a713-9e9614860f52 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:22.147962 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f083d31-4302-4f79-a713-9e9614860f52 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:22.147962 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f083d31-4302-4f79-a713-9e9614860f52 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:22.149826 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f083d31-4302-4f79-a713-9e9614860f52 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:22.150961 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f083d31-4302-4f79-a713-9e9614860f52 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:22.166724 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application [None req-0f083d31-4302-4f79-a713-9e9614860f52 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 17:07:22.166724 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:07:22.166724 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:07:22.166724 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:07:22.166724 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:07:22.166724 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:07:22.166724 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:07:22.166724 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:07:22.166724 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:07:22.166724 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:07:22.166724 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:07:22.166724 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:07:22.166724 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 17:07:22.166724 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 17:07:22.166724 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 17:07:22.173846 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 17:07:22.173846 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:07:22.173846 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:07:22.173846 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:07:22.173846 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:07:22.173846 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:07:22.173846 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:07:22.173846 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:07:22.173846 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application with Lock( Jun 16 17:07:22.173846 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:07:22.173846 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:07:22.173846 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:07:22.173846 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:07:22.173846 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:07:22.173846 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:07:22.173846 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:07:22.173846 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:07:22.174743 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 17:07:22.174743 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 17:07:22.174743 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 17:07:22.174743 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 17:07:22.174743 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 17:07:22.174743 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 17:07:22.174743 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 17:07:22.174743 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Jun 16 17:07:22.174743 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 331/673] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 16 17:07:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:07:22.174743 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88211774-373b-4902-90c2-433dabeda036 None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:22.174743 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88211774-373b-4902-90c2-433dabeda036 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:22.175329 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88211774-373b-4902-90c2-433dabeda036 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:22.183575 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 343/674] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 17:07:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 17:07:22.185120 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11211a05-f271-4fb7-a4b3-8eb83136029f None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:22.194273 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-88211774-373b-4902-90c2-433dabeda036 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:07:22.195683 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-88211774-373b-4902-90c2-433dabeda036 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:07:22.272033 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 332/675] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 17:07:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 17:07:22.272902 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88211774-373b-4902-90c2-433dabeda036 None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:22.309722 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11211a05-f271-4fb7-a4b3-8eb83136029f None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:22.344967 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505d60b7-bfc5-4c06-b153-2e9c2a0dde67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:22.345777 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505d60b7-bfc5-4c06-b153-2e9c2a0dde67 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:22.346068 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505d60b7-bfc5-4c06-b153-2e9c2a0dde67 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:22.346397 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505d60b7-bfc5-4c06-b153-2e9c2a0dde67 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:22.353952 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505d60b7-bfc5-4c06-b153-2e9c2a0dde67 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:22.355385 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505d60b7-bfc5-4c06-b153-2e9c2a0dde67 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:22.369364 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application [None req-505d60b7-bfc5-4c06-b153-2e9c2a0dde67 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 17:07:22.369364 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:07:22.369364 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:07:22.369364 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:07:22.369364 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:07:22.369364 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:07:22.369364 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:07:22.369364 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:07:22.369364 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:07:22.369364 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:07:22.369364 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:07:22.369364 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:07:22.369364 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 17:07:22.369364 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 17:07:22.369364 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 17:07:22.370311 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 17:07:22.370311 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:07:22.370311 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:07:22.370311 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:07:22.370311 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:07:22.370311 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:07:22.370311 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:07:22.370311 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:07:22.370311 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application with Lock( Jun 16 17:07:22.370311 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:07:22.370311 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:07:22.370311 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:07:22.370311 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:07:22.370311 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:07:22.370311 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:07:22.370311 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:07:22.370311 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:07:22.371858 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 17:07:22.371858 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 17:07:22.371858 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 17:07:22.371858 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 17:07:22.371858 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 17:07:22.371858 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 17:07:22.371858 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 17:07:22.371858 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Jun 16 17:07:22.371858 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 344/676] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 16 17:07:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:07:22.373832 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505d60b7-bfc5-4c06-b153-2e9c2a0dde67 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:22.396136 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88211774-373b-4902-90c2-433dabeda036 None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:22.401305 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:22.424106 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:22.436399 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46d6415-a798-4100-bc2f-3de661c3259e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:22.437077 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46d6415-a798-4100-bc2f-3de661c3259e None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:22.437365 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46d6415-a798-4100-bc2f-3de661c3259e None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:22.437736 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46d6415-a798-4100-bc2f-3de661c3259e None admin] PATH_INFO: `/v3/projects` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:22.438596 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46d6415-a798-4100-bc2f-3de661c3259e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80873) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:07:22.438912 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46d6415-a798-4100-bc2f-3de661c3259e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:22.440393 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46d6415-a798-4100-bc2f-3de661c3259e None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:22.459964 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 333/677] 10.222.0.39 () {56 vars in 1148 bytes} [Thu Jun 16 17:07:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:07:22.459964 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46d6415-a798-4100-bc2f-3de661c3259e None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:22.486329 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505d60b7-bfc5-4c06-b153-2e9c2a0dde67 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:22.522168 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffed158-c1bd-4a27-8e49-d6d18fbc95b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:22.522970 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffed158-c1bd-4a27-8e49-d6d18fbc95b8 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:22.523257 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffed158-c1bd-4a27-8e49-d6d18fbc95b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:22.523539 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffed158-c1bd-4a27-8e49-d6d18fbc95b8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:22.534220 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffed158-c1bd-4a27-8e49-d6d18fbc95b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 17:07:22.542023 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application [None req-1ffed158-c1bd-4a27-8e49-d6d18fbc95b8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 17:07:22.542023 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:07:22.542023 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:07:22.542023 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:07:22.542023 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:07:22.542023 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:07:22.542023 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:07:22.542023 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:07:22.542023 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:07:22.542023 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:07:22.542023 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:07:22.542023 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:07:22.542023 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 17:07:22.542023 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 17:07:22.542023 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 17:07:22.542023 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 17:07:22.543888 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 17:07:22.543888 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 17:07:22.543888 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 17:07:22.543888 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 17:07:22.543888 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:07:22.543888 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:07:22.543888 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:07:22.543888 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:07:22.543888 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:07:22.543888 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:07:22.543888 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:07:22.543888 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application with Lock( Jun 16 17:07:22.543888 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:07:22.543888 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:07:22.543888 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:07:22.543888 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:07:22.544838 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:07:22.544838 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:07:22.544838 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:07:22.544838 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:07:22.544838 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 17:07:22.544838 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 17:07:22.544838 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 17:07:22.544838 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 17:07:22.544838 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 17:07:22.544838 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 17:07:22.544838 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 17:07:22.544838 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Jun 16 17:07:22.544838 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 345/678] 10.222.0.39 () {56 vars in 1102 bytes} [Thu Jun 16 17:07:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:07:22.545864 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffed158-c1bd-4a27-8e49-d6d18fbc95b8 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:22.573233 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46d6415-a798-4100-bc2f-3de661c3259e None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:22.611171 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ea11dc-d398-41fa-a54a-ee2e7d3535ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:22.611886 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ea11dc-d398-41fa-a54a-ee2e7d3535ff None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:22.612170 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ea11dc-d398-41fa-a54a-ee2e7d3535ff None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:22.612455 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ea11dc-d398-41fa-a54a-ee2e7d3535ff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:22.624245 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ea11dc-d398-41fa-a54a-ee2e7d3535ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:22.625670 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ea11dc-d398-41fa-a54a-ee2e7d3535ff None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:22.640623 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:22.642663 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application [None req-59ea11dc-d398-41fa-a54a-ee2e7d3535ff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:07:22.642663 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:07:22.642663 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:07:22.642663 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:07:22.642663 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:07:22.642663 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:07:22.642663 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:07:22.642663 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:07:22.642663 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:07:22.642663 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:07:22.642663 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:07:22.642663 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:07:22.642663 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 17:07:22.642663 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 17:07:22.642663 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 17:07:22.643544 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 17:07:22.643544 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:07:22.643544 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:07:22.643544 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:07:22.643544 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:07:22.643544 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:07:22.643544 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:07:22.643544 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:07:22.643544 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application with Lock( Jun 16 17:07:22.643544 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:07:22.643544 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:07:22.643544 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:07:22.643544 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:07:22.643544 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:07:22.643544 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:07:22.643544 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:07:22.643544 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:07:22.644449 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 17:07:22.644449 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 17:07:22.644449 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:07:22.644449 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Jun 16 17:07:22.644449 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 334/679] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 17:07:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:07:22.644720 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ea11dc-d398-41fa-a54a-ee2e7d3535ff None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:22.659118 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffed158-c1bd-4a27-8e49-d6d18fbc95b8 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:22.682070 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:22.696370 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208e8a35-1128-447a-ad97-d7ad857b5c91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:22.697159 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208e8a35-1128-447a-ad97-d7ad857b5c91 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:22.697448 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208e8a35-1128-447a-ad97-d7ad857b5c91 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:22.697725 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208e8a35-1128-447a-ad97-d7ad857b5c91 None admin] PATH_INFO: `/v3/projects` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:22.698557 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208e8a35-1128-447a-ad97-d7ad857b5c91 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:07:22.698887 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208e8a35-1128-447a-ad97-d7ad857b5c91 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:22.700525 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208e8a35-1128-447a-ad97-d7ad857b5c91 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:22.718104 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 346/680] 10.222.0.39 () {56 vars in 1148 bytes} [Thu Jun 16 17:07:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:07:22.720222 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208e8a35-1128-447a-ad97-d7ad857b5c91 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:22.757605 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ea11dc-d398-41fa-a54a-ee2e7d3535ff None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:22.804410 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b057c3-f25b-4476-ae13-2497e0108408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:22.805072 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b057c3-f25b-4476-ae13-2497e0108408 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:22.805357 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b057c3-f25b-4476-ae13-2497e0108408 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:22.805637 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b057c3-f25b-4476-ae13-2497e0108408 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:22.806931 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b057c3-f25b-4476-ae13-2497e0108408 None admin] RBAC: Adding query filter params (role.id=a12797d48dac420cb2eaadbe537f60ef, scope.project.id=73015da4de1f48c29f57fff1040d2c10, user.id=ef37136b89d34edc9cd94c7aa81b2095) {{(pid=80873) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:07:22.808196 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b057c3-f25b-4476-ae13-2497e0108408 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:22.810599 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b057c3-f25b-4476-ae13-2497e0108408 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:22.819839 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 335/681] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jun 16 17:07:22 2022] GET /identity/v3/role_assignments?user.id=ef37136b89d34edc9cd94c7aa81b2095&scope.project.id=73015da4de1f48c29f57fff1040d2c10&role.id=a12797d48dac420cb2eaadbe537f60ef => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:07:22.820705 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b057c3-f25b-4476-ae13-2497e0108408 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:22.862195 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208e8a35-1128-447a-ad97-d7ad857b5c91 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:22.911540 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978bc59b-cd99-40c7-a484-07cbe7587c17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:22.912805 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978bc59b-cd99-40c7-a484-07cbe7587c17 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:22.913338 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978bc59b-cd99-40c7-a484-07cbe7587c17 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:22.913855 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978bc59b-cd99-40c7-a484-07cbe7587c17 None admin] PATH_INFO: `/v3/roles` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:22.915180 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978bc59b-cd99-40c7-a484-07cbe7587c17 None admin] RBAC: Adding query filter params (name=service) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:07:22.915721 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978bc59b-cd99-40c7-a484-07cbe7587c17 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:22.918458 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978bc59b-cd99-40c7-a484-07cbe7587c17 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:22.936926 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 347/682] 10.222.0.39 () {56 vars in 1103 bytes} [Thu Jun 16 17:07:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:07:22.937938 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978bc59b-cd99-40c7-a484-07cbe7587c17 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:22.952412 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:22.960918 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:22.970627 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b057c3-f25b-4476-ae13-2497e0108408 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:23.016029 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ab5940-fa1e-4518-8680-c4cfa24ea35c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:23.016951 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ab5940-fa1e-4518-8680-c4cfa24ea35c None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:23.017518 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ab5940-fa1e-4518-8680-c4cfa24ea35c None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:23.018709 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ab5940-fa1e-4518-8680-c4cfa24ea35c None admin] PATH_INFO: `/v3/domains` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:23.019644 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ab5940-fa1e-4518-8680-c4cfa24ea35c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80873) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:07:23.020102 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ab5940-fa1e-4518-8680-c4cfa24ea35c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:23.021722 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ab5940-fa1e-4518-8680-c4cfa24ea35c None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:23.036817 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 336/683] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 16 17:07:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:07:23.037976 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ab5940-fa1e-4518-8680-c4cfa24ea35c None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:23.067319 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978bc59b-cd99-40c7-a484-07cbe7587c17 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:23.102910 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb8129d-c102-45dc-a0d7-5c99efb1e890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:23.103566 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb8129d-c102-45dc-a0d7-5c99efb1e890 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:23.103850 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb8129d-c102-45dc-a0d7-5c99efb1e890 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:23.104125 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb8129d-c102-45dc-a0d7-5c99efb1e890 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:23.104962 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb8129d-c102-45dc-a0d7-5c99efb1e890 None admin] RBAC: Adding query filter params (role.id=a12797d48dac420cb2eaadbe537f60ef, scope.project.id=73015da4de1f48c29f57fff1040d2c10, user.id=b5d25bfa8dc042329d57cd55fa7b7b23) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:07:23.105272 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb8129d-c102-45dc-a0d7-5c99efb1e890 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:23.108048 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb8129d-c102-45dc-a0d7-5c99efb1e890 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:23.114749 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 348/684] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jun 16 17:07:22 2022] GET /identity/v3/role_assignments?user.id=b5d25bfa8dc042329d57cd55fa7b7b23&scope.project.id=73015da4de1f48c29f57fff1040d2c10&role.id=a12797d48dac420cb2eaadbe537f60ef => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:07:23.115370 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb8129d-c102-45dc-a0d7-5c99efb1e890 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:23.175618 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ab5940-fa1e-4518-8680-c4cfa24ea35c None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:23.220989 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7ac8cd-0b26-4e14-91f5-d1c78adbec60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:23.222670 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7ac8cd-0b26-4e14-91f5-d1c78adbec60 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:23.223219 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7ac8cd-0b26-4e14-91f5-d1c78adbec60 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:23.223712 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7ac8cd-0b26-4e14-91f5-d1c78adbec60 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:23.239568 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7ac8cd-0b26-4e14-91f5-d1c78adbec60 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:23.242152 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7ac8cd-0b26-4e14-91f5-d1c78adbec60 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:23.265422 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application [None req-dc7ac8cd-0b26-4e14-91f5-d1c78adbec60 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:07:23.265422 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:07:23.265422 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:07:23.265422 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:07:23.265422 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:07:23.265422 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:07:23.265422 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:07:23.265422 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:07:23.265422 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:07:23.265422 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:07:23.265422 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:07:23.265422 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:07:23.265422 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 17:07:23.265422 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 17:07:23.265422 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 17:07:23.266432 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 17:07:23.266432 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:07:23.266432 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:07:23.266432 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:07:23.266432 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:07:23.266432 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:07:23.266432 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:07:23.266432 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:07:23.266432 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application with Lock( Jun 16 17:07:23.266432 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:07:23.266432 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:07:23.266432 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:07:23.266432 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:07:23.266432 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:07:23.266432 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:07:23.266432 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:07:23.266432 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:07:23.267340 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 17:07:23.267340 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 17:07:23.267340 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:07:23.267340 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Jun 16 17:07:23.270356 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 337/685] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 17:07:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:07:23.278236 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7ac8cd-0b26-4e14-91f5-d1c78adbec60 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:23.304439 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:23.314420 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:23.345952 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb8129d-c102-45dc-a0d7-5c99efb1e890 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:23.397623 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54716c17-cd75-49e3-8bff-539431485b0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:23.398719 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54716c17-cd75-49e3-8bff-539431485b0e None admin] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:23.399242 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54716c17-cd75-49e3-8bff-539431485b0e None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:23.400276 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54716c17-cd75-49e3-8bff-539431485b0e None admin] PATH_INFO: `/v3/users` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:23.401190 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54716c17-cd75-49e3-8bff-539431485b0e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:23.403881 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54716c17-cd75-49e3-8bff-539431485b0e None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:23.432364 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7ac8cd-0b26-4e14-91f5-d1c78adbec60 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:23.475254 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9138e9-51d7-4ef8-9290-af29085f3bb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:23.475928 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9138e9-51d7-4ef8-9290-af29085f3bb2 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:23.476267 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9138e9-51d7-4ef8-9290-af29085f3bb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:23.476549 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9138e9-51d7-4ef8-9290-af29085f3bb2 None admin] PATH_INFO: `/v3/domains` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:23.477281 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9138e9-51d7-4ef8-9290-af29085f3bb2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80873) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:07:23.477590 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9138e9-51d7-4ef8-9290-af29085f3bb2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:23.478978 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9138e9-51d7-4ef8-9290-af29085f3bb2 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:23.492505 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 338/686] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 16 17:07:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 17:07:23.498960 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9138e9-51d7-4ef8-9290-af29085f3bb2 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:23.510391 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 349/687] 10.222.0.39 () {60 vars in 1132 bytes} [Thu Jun 16 17:07:23 2022] POST /identity/v3/users => generated 254 bytes in 395 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:07:23.590157 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:23.640255 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9138e9-51d7-4ef8-9290-af29085f3bb2 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:23.684653 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1e9893-ce8e-4b29-8c24-b45033597a96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:23.685391 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1e9893-ce8e-4b29-8c24-b45033597a96 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:23.685680 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1e9893-ce8e-4b29-8c24-b45033597a96 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:23.685992 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1e9893-ce8e-4b29-8c24-b45033597a96 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:23.695887 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1e9893-ce8e-4b29-8c24-b45033597a96 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:23.697358 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1e9893-ce8e-4b29-8c24-b45033597a96 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:23.712986 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application [None req-8b1e9893-ce8e-4b29-8c24-b45033597a96 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 16 17:07:23.712986 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:07:23.712986 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:07:23.712986 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:07:23.712986 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:07:23.712986 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:07:23.712986 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:07:23.712986 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:07:23.712986 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:07:23.712986 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:07:23.712986 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:07:23.712986 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:07:23.712986 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 17:07:23.712986 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 17:07:23.712986 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 17:07:23.712986 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 17:07:23.714042 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:07:23.714042 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:07:23.714042 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 17:07:23.714042 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 17:07:23.714042 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 17:07:23.714042 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 17:07:23.714042 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:07:23.714042 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:07:23.714042 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:07:23.714042 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:07:23.714042 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:07:23.714042 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application with Lock( Jun 16 17:07:23.714042 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:07:23.714042 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:07:23.714042 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:07:23.714042 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:07:23.714042 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:07:23.714042 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:07:23.715670 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:07:23.715670 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:07:23.715670 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 17:07:23.715670 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 17:07:23.715670 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 17:07:23.715670 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 17:07:23.715670 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 17:07:23.715670 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 17:07:23.715670 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 16 17:07:23.715670 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Jun 16 17:07:23.715670 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 339/688] 10.222.0.39 () {56 vars in 1096 bytes} [Thu Jun 16 17:07:23 2022] GET /identity/v3/users/swift => generated 83 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 17:07:23.722085 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54716c17-cd75-49e3-8bff-539431485b0e None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:23.863946 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54716c17-cd75-49e3-8bff-539431485b0e None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:23.897253 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:23.904241 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd7092f-f1d7-4c5c-a8ec-36bda90b1ec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:23.905226 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd7092f-f1d7-4c5c-a8ec-36bda90b1ec9 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:23.905892 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd7092f-f1d7-4c5c-a8ec-36bda90b1ec9 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:23.906363 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd7092f-f1d7-4c5c-a8ec-36bda90b1ec9 None admin] PATH_INFO: `/v3/users` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:23.907373 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd7092f-f1d7-4c5c-a8ec-36bda90b1ec9 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:07:23.907847 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd7092f-f1d7-4c5c-a8ec-36bda90b1ec9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:23.909426 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd7092f-f1d7-4c5c-a8ec-36bda90b1ec9 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:23.929292 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 350/689] 10.222.0.39 () {56 vars in 1135 bytes} [Thu Jun 16 17:07:23 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:07:23.935614 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1e9893-ce8e-4b29-8c24-b45033597a96 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:24.066389 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1e9893-ce8e-4b29-8c24-b45033597a96 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:24.098161 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:24.105185 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc5da2e-0dc8-422a-9599-b8b258a316e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:24.106483 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc5da2e-0dc8-422a-9599-b8b258a316e7 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:24.106768 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc5da2e-0dc8-422a-9599-b8b258a316e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:24.107067 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc5da2e-0dc8-422a-9599-b8b258a316e7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:24.196082 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc5da2e-0dc8-422a-9599-b8b258a316e7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:24.197817 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc5da2e-0dc8-422a-9599-b8b258a316e7 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:24.304241 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 340/690] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 16 17:07:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 17:07:24.309902 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd7092f-f1d7-4c5c-a8ec-36bda90b1ec9 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:24.464757 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd7092f-f1d7-4c5c-a8ec-36bda90b1ec9 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:24.517683 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8540390-f8f0-485b-852f-4e99fbd70ece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:24.518516 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8540390-f8f0-485b-852f-4e99fbd70ece None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:24.518802 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8540390-f8f0-485b-852f-4e99fbd70ece None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:24.519076 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8540390-f8f0-485b-852f-4e99fbd70ece None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:24.521007 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf6f5e3-bfc5-4bc1-9fa2-3698ba153928 None None] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:24.521311 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf6f5e3-bfc5-4bc1-9fa2-3698ba153928 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:24.521594 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf6f5e3-bfc5-4bc1-9fa2-3698ba153928 None None] PATH_INFO: `/` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:24.526828 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 341/691] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 17:07:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:07:24.528898 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032e1b9f-05b3-4471-8acf-04523d7c5f05 None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:24.529194 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032e1b9f-05b3-4471-8acf-04523d7c5f05 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:24.529479 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032e1b9f-05b3-4471-8acf-04523d7c5f05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:24.536326 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8540390-f8f0-485b-852f-4e99fbd70ece None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:24.537813 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8540390-f8f0-485b-852f-4e99fbd70ece None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:24.566817 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-032e1b9f-05b3-4471-8acf-04523d7c5f05 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:07:24.568031 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-032e1b9f-05b3-4471-8acf-04523d7c5f05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:07:24.576976 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application [None req-f8540390-f8f0-485b-852f-4e99fbd70ece None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:07:24.576976 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:07:24.576976 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:07:24.576976 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:07:24.576976 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:07:24.576976 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:07:24.576976 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:07:24.576976 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:07:24.576976 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:07:24.576976 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:07:24.576976 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:07:24.576976 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:07:24.576976 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 17:07:24.576976 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 17:07:24.576976 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 17:07:24.577898 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 17:07:24.577898 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:07:24.577898 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:07:24.577898 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:07:24.577898 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:07:24.577898 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:07:24.577898 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:07:24.577898 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:07:24.577898 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application with Lock( Jun 16 17:07:24.577898 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:07:24.577898 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:07:24.577898 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:07:24.577898 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:07:24.577898 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:07:24.577898 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:07:24.577898 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:07:24.577898 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:07:24.578797 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 17:07:24.578797 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 17:07:24.578797 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:07:24.578797 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Jun 16 17:07:24.578797 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 351/692] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 17:07:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:07:24.589469 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8540390-f8f0-485b-852f-4e99fbd70ece None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:24.610688 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:24.664911 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:24.688918 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 342/693] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 17:07:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 17:07:24.732516 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032e1b9f-05b3-4471-8acf-04523d7c5f05 None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:24.751194 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8540390-f8f0-485b-852f-4e99fbd70ece None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:24.826457 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55edbf94-f91d-47f4-9a64-55046f93f31c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:24.827175 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55edbf94-f91d-47f4-9a64-55046f93f31c None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:24.827456 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55edbf94-f91d-47f4-9a64-55046f93f31c None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:24.827735 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55edbf94-f91d-47f4-9a64-55046f93f31c None admin] PATH_INFO: `/v3/domains` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:24.828532 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55edbf94-f91d-47f4-9a64-55046f93f31c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:07:24.828840 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55edbf94-f91d-47f4-9a64-55046f93f31c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:24.833009 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55edbf94-f91d-47f4-9a64-55046f93f31c None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:24.860803 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 352/694] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 16 17:07:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 17:07:24.866976 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55edbf94-f91d-47f4-9a64-55046f93f31c None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:24.920953 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032e1b9f-05b3-4471-8acf-04523d7c5f05 None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:24.985686 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79351a9-2a3d-46db-a4b7-8739d12f1049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:24.986525 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79351a9-2a3d-46db-a4b7-8739d12f1049 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:24.986811 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79351a9-2a3d-46db-a4b7-8739d12f1049 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:24.987092 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79351a9-2a3d-46db-a4b7-8739d12f1049 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:25.013995 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79351a9-2a3d-46db-a4b7-8739d12f1049 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 17:07:25.029672 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application [None req-e79351a9-2a3d-46db-a4b7-8739d12f1049 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 17:07:25.029672 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:07:25.029672 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:07:25.029672 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:07:25.029672 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:07:25.029672 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:07:25.029672 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:07:25.029672 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:07:25.029672 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:07:25.029672 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:07:25.029672 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:07:25.029672 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:07:25.029672 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 17:07:25.029672 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 17:07:25.029672 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 17:07:25.029672 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 17:07:25.030647 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 17:07:25.030647 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 17:07:25.030647 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 17:07:25.030647 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 17:07:25.030647 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:07:25.030647 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:07:25.030647 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:07:25.030647 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:07:25.030647 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:07:25.030647 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:07:25.030647 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:07:25.030647 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application with Lock( Jun 16 17:07:25.030647 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:07:25.030647 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:07:25.030647 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:07:25.030647 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:07:25.031483 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:07:25.031483 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:07:25.031483 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:07:25.031483 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:07:25.031483 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 17:07:25.031483 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 17:07:25.031483 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 17:07:25.031483 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 17:07:25.031483 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 17:07:25.031483 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 17:07:25.031483 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 17:07:25.031483 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Jun 16 17:07:25.034322 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 343/695] 10.222.0.39 () {56 vars in 1096 bytes} [Thu Jun 16 17:07:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 17:07:25.036773 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79351a9-2a3d-46db-a4b7-8739d12f1049 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:25.055064 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:25.058281 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55edbf94-f91d-47f4-9a64-55046f93f31c None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:25.078994 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:25.128265 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf574e6-30b4-4027-9130-e06af81f375f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:25.129075 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf574e6-30b4-4027-9130-e06af81f375f None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:25.129358 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf574e6-30b4-4027-9130-e06af81f375f None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:25.129636 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf574e6-30b4-4027-9130-e06af81f375f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:25.144099 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf574e6-30b4-4027-9130-e06af81f375f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:25.145547 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf574e6-30b4-4027-9130-e06af81f375f None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:25.173232 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application [None req-1bf574e6-30b4-4027-9130-e06af81f375f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 17:07:25.173232 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:07:25.173232 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:07:25.173232 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:07:25.173232 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:07:25.173232 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:07:25.173232 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:07:25.173232 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:07:25.173232 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:07:25.173232 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:07:25.173232 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:07:25.173232 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:07:25.173232 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 17:07:25.173232 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 17:07:25.173232 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 17:07:25.174455 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 17:07:25.174455 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:07:25.174455 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:07:25.174455 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:07:25.174455 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:07:25.174455 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:07:25.174455 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:07:25.174455 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:07:25.174455 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application with Lock( Jun 16 17:07:25.174455 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:07:25.174455 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:07:25.174455 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:07:25.174455 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:07:25.174455 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:07:25.174455 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:07:25.174455 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:07:25.174455 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:07:25.176095 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 17:07:25.176095 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 17:07:25.176095 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 17:07:25.176095 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 17:07:25.176095 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 17:07:25.176095 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 17:07:25.176095 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 17:07:25.176095 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Jun 16 17:07:25.176095 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 353/696] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 16 17:07:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:07:25.188440 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf574e6-30b4-4027-9130-e06af81f375f None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:25.233855 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79351a9-2a3d-46db-a4b7-8739d12f1049 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:25.312053 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d11ec91-d1f2-4977-95a7-a308ddaf83bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:25.312646 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d11ec91-d1f2-4977-95a7-a308ddaf83bd None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:25.312934 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d11ec91-d1f2-4977-95a7-a308ddaf83bd None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:25.313215 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d11ec91-d1f2-4977-95a7-a308ddaf83bd None admin] PATH_INFO: `/v3/roles` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:25.313992 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d11ec91-d1f2-4977-95a7-a308ddaf83bd None admin] RBAC: Adding query filter params (name=admin) {{(pid=80873) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:07:25.314302 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d11ec91-d1f2-4977-95a7-a308ddaf83bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:25.315665 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d11ec91-d1f2-4977-95a7-a308ddaf83bd None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:25.325488 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf574e6-30b4-4027-9130-e06af81f375f None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:25.337292 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 344/697] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 16 17:07:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:07:25.343134 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d11ec91-d1f2-4977-95a7-a308ddaf83bd None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:25.369356 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c725eb11-3f4b-41f1-993c-ed1a54e76852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:25.371946 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c725eb11-3f4b-41f1-993c-ed1a54e76852 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:25.372231 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c725eb11-3f4b-41f1-993c-ed1a54e76852 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:25.372513 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c725eb11-3f4b-41f1-993c-ed1a54e76852 None admin] PATH_INFO: `/v3/projects` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:25.373355 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c725eb11-3f4b-41f1-993c-ed1a54e76852 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:07:25.374850 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c725eb11-3f4b-41f1-993c-ed1a54e76852 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:25.376339 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c725eb11-3f4b-41f1-993c-ed1a54e76852 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:25.404885 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 354/698] 10.222.0.39 () {56 vars in 1148 bytes} [Thu Jun 16 17:07:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:07:25.411130 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c725eb11-3f4b-41f1-993c-ed1a54e76852 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:25.460903 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:25.489221 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:25.509621 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d11ec91-d1f2-4977-95a7-a308ddaf83bd None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:25.550667 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5bfaa5-e28f-480d-9c91-91d6580c8d34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:25.551732 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5bfaa5-e28f-480d-9c91-91d6580c8d34 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:25.552264 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5bfaa5-e28f-480d-9c91-91d6580c8d34 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:25.552695 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5bfaa5-e28f-480d-9c91-91d6580c8d34 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:25.559217 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c725eb11-3f4b-41f1-993c-ed1a54e76852 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:25.565717 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5bfaa5-e28f-480d-9c91-91d6580c8d34 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:25.567402 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5bfaa5-e28f-480d-9c91-91d6580c8d34 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:25.586594 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application [None req-8c5bfaa5-e28f-480d-9c91-91d6580c8d34 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:07:25.586594 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:07:25.586594 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:07:25.586594 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:07:25.586594 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:07:25.586594 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:07:25.586594 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:07:25.586594 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:07:25.586594 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:07:25.586594 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:07:25.586594 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:07:25.586594 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:07:25.586594 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 17:07:25.586594 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 17:07:25.586594 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 17:07:25.588437 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 17:07:25.588437 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:07:25.588437 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:07:25.588437 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:07:25.588437 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:07:25.588437 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:07:25.588437 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:07:25.588437 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:07:25.588437 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application with Lock( Jun 16 17:07:25.588437 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:07:25.588437 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:07:25.588437 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:07:25.588437 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:07:25.588437 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:07:25.588437 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:07:25.588437 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:07:25.588437 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:07:25.591545 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 17:07:25.591545 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 17:07:25.591545 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:07:25.591545 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Jun 16 17:07:25.591545 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 345/699] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 17:07:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 17:07:25.591545 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30739630-c24a-40e3-929f-b181f0cbd2be None None] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:25.592319 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30739630-c24a-40e3-929f-b181f0cbd2be None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:25.592319 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30739630-c24a-40e3-929f-b181f0cbd2be None None] PATH_INFO: `/` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:25.601783 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 346/700] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 17:07:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:07:25.601783 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30739630-c24a-40e3-929f-b181f0cbd2be None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:25.603526 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0e2e26-af81-4d1e-8e53-696f88b838ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:25.604194 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0e2e26-af81-4d1e-8e53-696f88b838ed None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:25.604483 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0e2e26-af81-4d1e-8e53-696f88b838ed None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:25.604769 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0e2e26-af81-4d1e-8e53-696f88b838ed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:25.605652 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0e2e26-af81-4d1e-8e53-696f88b838ed None admin] RBAC: Adding query filter params (role.id=a12797d48dac420cb2eaadbe537f60ef, scope.project.id=73015da4de1f48c29f57fff1040d2c10, user.id=bbec2dfe63764ed88a23e172ead0afa4) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:07:25.605998 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0e2e26-af81-4d1e-8e53-696f88b838ed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:25.607425 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0e2e26-af81-4d1e-8e53-696f88b838ed None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:25.615924 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 355/701] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jun 16 17:07:25 2022] GET /identity/v3/role_assignments?user.id=bbec2dfe63764ed88a23e172ead0afa4&scope.project.id=73015da4de1f48c29f57fff1040d2c10&role.id=a12797d48dac420cb2eaadbe537f60ef => generated 608 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:07:25.617261 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8809d65-0107-4bce-9218-50be91c134a0 None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:25.617559 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8809d65-0107-4bce-9218-50be91c134a0 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:25.617876 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8809d65-0107-4bce-9218-50be91c134a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:25.657035 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-b8809d65-0107-4bce-9218-50be91c134a0 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:07:25.658336 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-b8809d65-0107-4bce-9218-50be91c134a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:07:25.766383 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30739630-c24a-40e3-929f-b181f0cbd2be None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:25.807540 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbb0a76-e25d-4b31-a755-979a85ca89fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:25.808224 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbb0a76-e25d-4b31-a755-979a85ca89fa None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:25.809075 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbb0a76-e25d-4b31-a755-979a85ca89fa None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:25.809364 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbb0a76-e25d-4b31-a755-979a85ca89fa None admin] PATH_INFO: `/v3/domains` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:25.810165 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbb0a76-e25d-4b31-a755-979a85ca89fa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80873) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:07:25.810534 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbb0a76-e25d-4b31-a755-979a85ca89fa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:25.812001 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbb0a76-e25d-4b31-a755-979a85ca89fa None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:25.813919 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:25.836353 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 347/702] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 16 17:07:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:07:25.836353 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbb0a76-e25d-4b31-a755-979a85ca89fa None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:25.836618 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 356/703] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 17:07:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 17:07:25.872286 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8809d65-0107-4bce-9218-50be91c134a0 None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:25.896500 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:25.973367 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbb0a76-e25d-4b31-a755-979a85ca89fa None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:26.010254 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8809d65-0107-4bce-9218-50be91c134a0 None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:26.015315 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2b727f-f5a2-48f3-bc88-436639492724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:26.016117 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2b727f-f5a2-48f3-bc88-436639492724 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:26.016399 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2b727f-f5a2-48f3-bc88-436639492724 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:26.016673 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2b727f-f5a2-48f3-bc88-436639492724 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:26.025587 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2b727f-f5a2-48f3-bc88-436639492724 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:26.027144 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2b727f-f5a2-48f3-bc88-436639492724 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:26.042321 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application [None req-cb2b727f-f5a2-48f3-bc88-436639492724 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 16 17:07:26.042321 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:07:26.042321 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:07:26.042321 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:07:26.042321 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:07:26.042321 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:07:26.042321 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:07:26.042321 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:07:26.042321 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:07:26.042321 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:07:26.042321 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:07:26.042321 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:07:26.042321 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 17:07:26.042321 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 17:07:26.042321 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 17:07:26.042321 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 17:07:26.043444 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:07:26.043444 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:07:26.043444 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 17:07:26.043444 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 17:07:26.043444 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 17:07:26.043444 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 17:07:26.043444 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:07:26.043444 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:07:26.043444 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:07:26.043444 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:07:26.043444 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:07:26.043444 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application with Lock( Jun 16 17:07:26.043444 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:07:26.043444 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:07:26.043444 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:07:26.043444 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:07:26.043444 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:07:26.043444 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:07:26.044419 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:07:26.044419 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:07:26.044419 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 17:07:26.044419 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 17:07:26.044419 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 17:07:26.044419 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 17:07:26.044419 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 17:07:26.044419 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 17:07:26.044419 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 16 17:07:26.044419 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Jun 16 17:07:26.044419 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 348/704] 10.222.0.39 () {56 vars in 1093 bytes} [Thu Jun 16 17:07:25 2022] GET /identity/v3/users/nova => generated 82 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:07:26.045173 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91311fc9-7a37-4e78-a2e8-862a749bcca6 None None] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:26.045448 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91311fc9-7a37-4e78-a2e8-862a749bcca6 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:26.050302 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91311fc9-7a37-4e78-a2e8-862a749bcca6 None None] PATH_INFO: `/` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:26.051909 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 349/705] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 17:07:26 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:07:26.052705 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91311fc9-7a37-4e78-a2e8-862a749bcca6 None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:26.055923 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8fbf1d-c53a-4dc3-8078-9741520b21a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:26.057110 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8fbf1d-c53a-4dc3-8078-9741520b21a3 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:26.057497 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8fbf1d-c53a-4dc3-8078-9741520b21a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:26.057879 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8fbf1d-c53a-4dc3-8078-9741520b21a3 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:26.059230 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8fbf1d-c53a-4dc3-8078-9741520b21a3 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:26.060716 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8fbf1d-c53a-4dc3-8078-9741520b21a3 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:26.079780 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application [None req-fe8fbf1d-c53a-4dc3-8078-9741520b21a3 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 16 17:07:26.079780 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:07:26.079780 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 17:07:26.079780 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 17:07:26.079780 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 17:07:26.079780 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 17:07:26.079780 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 17:07:26.079780 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 17:07:26.079780 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 16 17:07:26.079780 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Jun 16 17:07:26.079780 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 17:07:26.079780 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Jun 16 17:07:26.079780 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:07:26.079780 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:07:26.079780 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:07:26.079780 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:07:26.080832 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:07:26.080832 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:07:26.080832 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:07:26.080832 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:07:26.080832 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:07:26.080832 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:07:26.080832 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:07:26.080832 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 17:07:26.080832 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 17:07:26.080832 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 17:07:26.080832 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 17:07:26.080832 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:07:26.080832 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:07:26.080832 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:07:26.080832 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:07:26.080832 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:07:26.081739 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:07:26.081739 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:07:26.081739 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application with Lock( Jun 16 17:07:26.081739 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:07:26.081739 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:07:26.081739 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:07:26.081739 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:07:26.081739 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:07:26.081739 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:07:26.081739 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:07:26.081739 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:07:26.081739 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 17:07:26.081739 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 17:07:26.081739 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 16 17:07:26.081739 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Jun 16 17:07:26.081739 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 357/706] 10.222.0.39 () {56 vars in 1129 bytes} [Thu Jun 16 17:07:25 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 17:07:26.087070 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09adcc5-92f0-4d1d-8284-89e3c06e38ad None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:26.087375 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09adcc5-92f0-4d1d-8284-89e3c06e38ad None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:26.087733 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09adcc5-92f0-4d1d-8284-89e3c06e38ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:26.107945 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-e09adcc5-92f0-4d1d-8284-89e3c06e38ad None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:07:26.109414 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-e09adcc5-92f0-4d1d-8284-89e3c06e38ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:07:26.120364 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:26.170442 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91311fc9-7a37-4e78-a2e8-862a749bcca6 None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:26.184569 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 358/707] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 17:07:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 17:07:26.185827 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09adcc5-92f0-4d1d-8284-89e3c06e38ad None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:26.197277 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:26.231243 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ba7bb7-2a2a-4fb4-8818-6be32c4657fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:26.232510 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ba7bb7-2a2a-4fb4-8818-6be32c4657fc None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:26.232965 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ba7bb7-2a2a-4fb4-8818-6be32c4657fc None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:26.233403 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ba7bb7-2a2a-4fb4-8818-6be32c4657fc None admin] PATH_INFO: `/v3/users` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:26.234642 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ba7bb7-2a2a-4fb4-8818-6be32c4657fc None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80873) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:07:26.235255 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ba7bb7-2a2a-4fb4-8818-6be32c4657fc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:26.236985 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ba7bb7-2a2a-4fb4-8818-6be32c4657fc None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:26.263852 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 350/708] 10.222.0.39 () {56 vars in 1133 bytes} [Thu Jun 16 17:07:26 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:07:26.265139 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ba7bb7-2a2a-4fb4-8818-6be32c4657fc None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:26.326641 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09adcc5-92f0-4d1d-8284-89e3c06e38ad None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:26.371807 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1ed11e-44be-4c32-a05b-2907e701576d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:26.372486 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1ed11e-44be-4c32-a05b-2907e701576d None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:26.372776 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1ed11e-44be-4c32-a05b-2907e701576d None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:26.373064 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1ed11e-44be-4c32-a05b-2907e701576d None admin] PATH_INFO: `/v3/services` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:26.373804 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1ed11e-44be-4c32-a05b-2907e701576d None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:07:26.374125 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1ed11e-44be-4c32-a05b-2907e701576d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:26.375526 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1ed11e-44be-4c32-a05b-2907e701576d None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:26.384769 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 359/709] 10.222.0.39 () {56 vars in 1124 bytes} [Thu Jun 16 17:07:26 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:07:26.384769 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1ed11e-44be-4c32-a05b-2907e701576d None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:26.388316 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ba7bb7-2a2a-4fb4-8818-6be32c4657fc None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:26.404776 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:26.430057 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f7ae74-3b8d-4508-bf3c-0e9cefa173b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:26.430963 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f7ae74-3b8d-4508-bf3c-0e9cefa173b2 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:26.431639 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f7ae74-3b8d-4508-bf3c-0e9cefa173b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:26.431927 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f7ae74-3b8d-4508-bf3c-0e9cefa173b2 None admin] PATH_INFO: `/v3/services/network` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:26.432602 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f7ae74-3b8d-4508-bf3c-0e9cefa173b2 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:26.434389 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f7ae74-3b8d-4508-bf3c-0e9cefa173b2 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:26.456827 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application [None req-61f7ae74-3b8d-4508-bf3c-0e9cefa173b2 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 16 17:07:26.456827 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:07:26.456827 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 17:07:26.456827 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 17:07:26.456827 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 17:07:26.456827 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 17:07:26.456827 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 17:07:26.456827 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 17:07:26.456827 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 16 17:07:26.456827 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Jun 16 17:07:26.456827 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 17:07:26.456827 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Jun 16 17:07:26.456827 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:07:26.456827 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:07:26.456827 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:07:26.456827 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:07:26.456827 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:07:26.457992 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:07:26.457992 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:07:26.457992 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:07:26.457992 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:07:26.457992 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:07:26.457992 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:07:26.457992 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 17:07:26.457992 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 17:07:26.457992 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 17:07:26.457992 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 17:07:26.457992 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:07:26.457992 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:07:26.457992 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:07:26.457992 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:07:26.457992 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:07:26.457992 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:07:26.458867 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:07:26.458867 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application with Lock( Jun 16 17:07:26.458867 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:07:26.458867 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:07:26.458867 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:07:26.458867 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:07:26.458867 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:07:26.458867 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:07:26.458867 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:07:26.458867 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:07:26.458867 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 17:07:26.458867 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 17:07:26.458867 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 16 17:07:26.458867 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Jun 16 17:07:26.459629 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 351/710] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 16 17:07:26 2022] GET /identity/v3/services/network => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:07:26.460698 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34402a60-b0f2-4422-ad04-2e0d99245987 None None] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:26.460995 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34402a60-b0f2-4422-ad04-2e0d99245987 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:26.462280 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34402a60-b0f2-4422-ad04-2e0d99245987 None None] PATH_INFO: `/` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:26.464005 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 352/711] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 17:07:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:07:26.464638 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34402a60-b0f2-4422-ad04-2e0d99245987 None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:26.471050 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:26.506341 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1ed11e-44be-4c32-a05b-2907e701576d None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:26.550900 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0398bab-cb8e-4909-a640-24bddc02db51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:26.551561 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0398bab-cb8e-4909-a640-24bddc02db51 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:26.551853 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0398bab-cb8e-4909-a640-24bddc02db51 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:26.552136 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0398bab-cb8e-4909-a640-24bddc02db51 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:26.590620 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34402a60-b0f2-4422-ad04-2e0d99245987 None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:26.636303 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960ebe2c-63d5-41f1-a6aa-593f0cf6fd05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:26.637514 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960ebe2c-63d5-41f1-a6aa-593f0cf6fd05 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:26.637841 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960ebe2c-63d5-41f1-a6aa-593f0cf6fd05 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:26.638129 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960ebe2c-63d5-41f1-a6aa-593f0cf6fd05 None admin] PATH_INFO: `/v3/services` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:26.638847 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960ebe2c-63d5-41f1-a6aa-593f0cf6fd05 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80873) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:07:26.639168 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960ebe2c-63d5-41f1-a6aa-593f0cf6fd05 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:26.640100 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0398bab-cb8e-4909-a640-24bddc02db51 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:26.641754 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0398bab-cb8e-4909-a640-24bddc02db51 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:26.644391 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960ebe2c-63d5-41f1-a6aa-593f0cf6fd05 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:26.651176 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 353/712] 10.222.0.39 () {56 vars in 1124 bytes} [Thu Jun 16 17:07:26 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:07:26.653848 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca0b57e-6e2d-43c2-847e-5292467cf113 None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:26.654499 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca0b57e-6e2d-43c2-847e-5292467cf113 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:26.655359 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca0b57e-6e2d-43c2-847e-5292467cf113 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:26.685884 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-6ca0b57e-6e2d-43c2-847e-5292467cf113 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:07:26.688659 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-6ca0b57e-6e2d-43c2-847e-5292467cf113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:07:26.736228 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:26.741834 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:26.773354 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 360/713] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 16 17:07:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 17:07:26.774624 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0398bab-cb8e-4909-a640-24bddc02db51 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:26.782900 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 354/714] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 17:07:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 17:07:26.783776 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca0b57e-6e2d-43c2-847e-5292467cf113 None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:26.910648 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0398bab-cb8e-4909-a640-24bddc02db51 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:26.941769 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca0b57e-6e2d-43c2-847e-5292467cf113 None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:26.967351 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320c7752-7536-4e33-9341-73c9de43628d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:26.968480 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320c7752-7536-4e33-9341-73c9de43628d None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:26.969047 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320c7752-7536-4e33-9341-73c9de43628d None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:26.969536 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320c7752-7536-4e33-9341-73c9de43628d None admin] PATH_INFO: `/v3/services` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:26.970492 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320c7752-7536-4e33-9341-73c9de43628d None admin] RBAC: Adding query filter params (name=network) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:07:26.971036 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320c7752-7536-4e33-9341-73c9de43628d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:26.972732 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320c7752-7536-4e33-9341-73c9de43628d None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:26.978527 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 361/715] 10.222.0.39 () {56 vars in 1112 bytes} [Thu Jun 16 17:07:26 2022] GET /identity/v3/services?name=network => generated 124 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:07:26.979659 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320c7752-7536-4e33-9341-73c9de43628d None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:26.988576 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f940064-b948-4c36-a159-96ddf688f9ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:26.989386 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f940064-b948-4c36-a159-96ddf688f9ec None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:26.989676 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f940064-b948-4c36-a159-96ddf688f9ec None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:26.990542 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f940064-b948-4c36-a159-96ddf688f9ec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:27.005031 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f940064-b948-4c36-a159-96ddf688f9ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:27.007376 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f940064-b948-4c36-a159-96ddf688f9ec None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:27.029340 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:27.038494 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application [None req-0f940064-b948-4c36-a159-96ddf688f9ec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:07:27.038494 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:07:27.038494 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:07:27.038494 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:07:27.038494 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:07:27.038494 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:07:27.038494 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:07:27.038494 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:07:27.038494 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:07:27.038494 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:07:27.038494 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:07:27.038494 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:07:27.038494 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 17:07:27.038494 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 17:07:27.038494 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 17:07:27.046725 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 17:07:27.046725 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:07:27.046725 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:07:27.046725 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:07:27.046725 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:07:27.046725 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:07:27.046725 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:07:27.046725 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:07:27.046725 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application with Lock( Jun 16 17:07:27.046725 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:07:27.046725 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:07:27.046725 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:07:27.046725 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:07:27.046725 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:07:27.046725 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:07:27.046725 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:07:27.046725 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:07:27.047668 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 17:07:27.047668 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 17:07:27.047668 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:07:27.047668 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Jun 16 17:07:27.047668 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 355/716] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 17:07:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:07:27.047668 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f940064-b948-4c36-a159-96ddf688f9ec None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:27.074153 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:27.114647 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320c7752-7536-4e33-9341-73c9de43628d None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:27.155125 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9589725-f0d0-4635-84bf-55c9fff65d9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:27.156129 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9589725-f0d0-4635-84bf-55c9fff65d9c None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:27.156425 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9589725-f0d0-4635-84bf-55c9fff65d9c None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:27.156715 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9589725-f0d0-4635-84bf-55c9fff65d9c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:27.161337 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f940064-b948-4c36-a159-96ddf688f9ec None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:27.170419 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9589725-f0d0-4635-84bf-55c9fff65d9c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 17:07:27.182178 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application [None req-a9589725-f0d0-4635-84bf-55c9fff65d9c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 17:07:27.182178 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:07:27.182178 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:07:27.182178 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:07:27.182178 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:07:27.182178 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:07:27.182178 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:07:27.182178 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:07:27.182178 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:07:27.182178 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:07:27.182178 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:07:27.182178 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:07:27.182178 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 17:07:27.182178 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 17:07:27.182178 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 17:07:27.182178 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 17:07:27.183201 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 17:07:27.183201 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 17:07:27.183201 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 17:07:27.183201 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 17:07:27.183201 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:07:27.183201 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:07:27.183201 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:07:27.183201 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:07:27.183201 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:07:27.183201 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:07:27.183201 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:07:27.183201 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application with Lock( Jun 16 17:07:27.183201 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:07:27.183201 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:07:27.183201 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:07:27.183201 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:07:27.184103 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:07:27.184103 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:07:27.184103 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:07:27.184103 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:07:27.184103 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 17:07:27.184103 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 17:07:27.184103 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 17:07:27.184103 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 17:07:27.184103 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 17:07:27.184103 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 17:07:27.184103 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 17:07:27.184103 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Jun 16 17:07:27.184103 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 362/717] 10.222.0.39 () {56 vars in 1102 bytes} [Thu Jun 16 17:07:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:07:27.184798 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9589725-f0d0-4635-84bf-55c9fff65d9c None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:27.210562 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6928f599-e701-4ec6-a1ad-74769dabf9df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:27.211356 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6928f599-e701-4ec6-a1ad-74769dabf9df None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:27.211645 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6928f599-e701-4ec6-a1ad-74769dabf9df None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:27.211926 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6928f599-e701-4ec6-a1ad-74769dabf9df None admin] PATH_INFO: `/v3/services` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:27.212670 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6928f599-e701-4ec6-a1ad-74769dabf9df None admin] RBAC: Adding query filter params (type=network) {{(pid=80873) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:07:27.212981 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6928f599-e701-4ec6-a1ad-74769dabf9df None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:27.214421 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6928f599-e701-4ec6-a1ad-74769dabf9df None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:27.226139 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 356/718] 10.222.0.39 () {56 vars in 1112 bytes} [Thu Jun 16 17:07:27 2022] GET /identity/v3/services?type=network => generated 124 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:07:27.227221 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6928f599-e701-4ec6-a1ad-74769dabf9df None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:27.310085 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9589725-f0d0-4635-84bf-55c9fff65d9c None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:27.314154 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:27.352270 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d1b1e1-7b2a-4ce7-9150-c953177598dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:27.352968 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d1b1e1-7b2a-4ce7-9150-c953177598dd None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:27.353268 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d1b1e1-7b2a-4ce7-9150-c953177598dd None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:27.353556 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d1b1e1-7b2a-4ce7-9150-c953177598dd None admin] PATH_INFO: `/v3/domains` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:27.354367 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d1b1e1-7b2a-4ce7-9150-c953177598dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:07:27.354688 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d1b1e1-7b2a-4ce7-9150-c953177598dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:27.356671 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d1b1e1-7b2a-4ce7-9150-c953177598dd None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:27.370323 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 363/719] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 16 17:07:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:07:27.382928 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d1b1e1-7b2a-4ce7-9150-c953177598dd None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:27.436839 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:27.452537 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6928f599-e701-4ec6-a1ad-74769dabf9df None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:27.493100 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4191e969-5953-4026-a99c-c4eb4da504e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:27.493914 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4191e969-5953-4026-a99c-c4eb4da504e3 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:27.494202 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4191e969-5953-4026-a99c-c4eb4da504e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:27.494802 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4191e969-5953-4026-a99c-c4eb4da504e3 None admin] PATH_INFO: `/v3/roles` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:27.495560 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4191e969-5953-4026-a99c-c4eb4da504e3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80873) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:07:27.497026 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4191e969-5953-4026-a99c-c4eb4da504e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:27.498821 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4191e969-5953-4026-a99c-c4eb4da504e3 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:27.512239 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 357/720] 10.222.0.39 () {56 vars in 1103 bytes} [Thu Jun 16 17:07:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:07:27.519098 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4191e969-5953-4026-a99c-c4eb4da504e3 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:27.555551 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d1b1e1-7b2a-4ce7-9150-c953177598dd None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:27.610938 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21404df-2819-4dca-85f1-56452fcaac51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:27.611737 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21404df-2819-4dca-85f1-56452fcaac51 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:27.612021 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21404df-2819-4dca-85f1-56452fcaac51 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:27.612296 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21404df-2819-4dca-85f1-56452fcaac51 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:27.619673 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21404df-2819-4dca-85f1-56452fcaac51 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:27.621220 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21404df-2819-4dca-85f1-56452fcaac51 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:27.635838 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application [None req-d21404df-2819-4dca-85f1-56452fcaac51 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 17:07:27.635838 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:07:27.635838 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:07:27.635838 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:07:27.635838 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:07:27.635838 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:07:27.635838 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:07:27.635838 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:07:27.635838 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:07:27.635838 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:07:27.635838 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:07:27.635838 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:07:27.635838 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 17:07:27.635838 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 17:07:27.635838 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 17:07:27.636887 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 17:07:27.636887 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:07:27.636887 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:07:27.636887 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:07:27.636887 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:07:27.636887 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:07:27.636887 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:07:27.636887 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:07:27.636887 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application with Lock( Jun 16 17:07:27.636887 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:07:27.636887 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:07:27.636887 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:07:27.636887 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:07:27.636887 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:07:27.636887 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:07:27.636887 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:07:27.636887 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:07:27.638027 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 17:07:27.638027 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 17:07:27.638027 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 17:07:27.638027 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 17:07:27.638027 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 17:07:27.638027 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 17:07:27.638027 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 17:07:27.638027 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Jun 16 17:07:27.638027 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 364/721] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 16 17:07:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:07:27.642869 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21404df-2819-4dca-85f1-56452fcaac51 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:27.651890 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4191e969-5953-4026-a99c-c4eb4da504e3 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:27.675803 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:27.718294 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324868d0-4f9b-49db-a1f3-a1db5cd8c274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:27.719074 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324868d0-4f9b-49db-a1f3-a1db5cd8c274 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:27.719359 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324868d0-4f9b-49db-a1f3-a1db5cd8c274 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:27.719634 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324868d0-4f9b-49db-a1f3-a1db5cd8c274 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:27.741927 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324868d0-4f9b-49db-a1f3-a1db5cd8c274 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:27.743369 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324868d0-4f9b-49db-a1f3-a1db5cd8c274 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:27.760746 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:27.772759 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application [None req-324868d0-4f9b-49db-a1f3-a1db5cd8c274 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:07:27.772759 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:07:27.772759 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:07:27.772759 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:07:27.772759 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:07:27.772759 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:07:27.772759 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:07:27.772759 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:07:27.772759 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:07:27.772759 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:07:27.772759 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:07:27.772759 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:07:27.772759 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 17:07:27.772759 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 17:07:27.772759 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 17:07:27.774762 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 17:07:27.774762 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:07:27.774762 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:07:27.774762 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:07:27.774762 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:07:27.774762 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:07:27.774762 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:07:27.774762 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:07:27.774762 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application with Lock( Jun 16 17:07:27.774762 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:07:27.774762 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:07:27.774762 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:07:27.774762 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:07:27.774762 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:07:27.774762 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:07:27.774762 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:07:27.774762 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:07:27.775681 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 17:07:27.775681 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 17:07:27.775681 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:07:27.775681 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Jun 16 17:07:27.775681 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 358/722] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 17:07:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:07:27.783842 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324868d0-4f9b-49db-a1f3-a1db5cd8c274 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:27.813113 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21404df-2819-4dca-85f1-56452fcaac51 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:27.848024 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6b1e75-a5f5-4597-a6f4-0e2ccae2c9da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:27.848695 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6b1e75-a5f5-4597-a6f4-0e2ccae2c9da None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:27.848987 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6b1e75-a5f5-4597-a6f4-0e2ccae2c9da None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:27.849537 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6b1e75-a5f5-4597-a6f4-0e2ccae2c9da None admin] PATH_INFO: `/v3/projects` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:27.850385 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6b1e75-a5f5-4597-a6f4-0e2ccae2c9da None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:07:27.850780 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6b1e75-a5f5-4597-a6f4-0e2ccae2c9da None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:27.852219 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6b1e75-a5f5-4597-a6f4-0e2ccae2c9da None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:27.865744 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 365/723] 10.222.0.39 () {56 vars in 1148 bytes} [Thu Jun 16 17:07:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 17:07:27.871644 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6b1e75-a5f5-4597-a6f4-0e2ccae2c9da None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:27.979320 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:27.998007 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6b1e75-a5f5-4597-a6f4-0e2ccae2c9da None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:28.010500 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324868d0-4f9b-49db-a1f3-a1db5cd8c274 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:28.036889 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef5e9ab-ce07-4627-87c4-e440709dcf80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:28.037821 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef5e9ab-ce07-4627-87c4-e440709dcf80 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:28.038221 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef5e9ab-ce07-4627-87c4-e440709dcf80 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:28.038611 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef5e9ab-ce07-4627-87c4-e440709dcf80 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:28.039659 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef5e9ab-ce07-4627-87c4-e440709dcf80 None admin] RBAC: Adding query filter params (role.id=dba744f8ab2a4c45b9d3212f8d203aba, scope.project.id=73015da4de1f48c29f57fff1040d2c10, user.id=3d381bb41dea4f1e90c3cf3815ac88dc) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:07:28.040086 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef5e9ab-ce07-4627-87c4-e440709dcf80 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:28.041697 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef5e9ab-ce07-4627-87c4-e440709dcf80 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:28.048872 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 366/724] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jun 16 17:07:27 2022] GET /identity/v3/role_assignments?user.id=3d381bb41dea4f1e90c3cf3815ac88dc&scope.project.id=73015da4de1f48c29f57fff1040d2c10&role.id=dba744f8ab2a4c45b9d3212f8d203aba => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:07:28.061322 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fac736-a137-44cb-aa00-fe4b0f56a2b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:28.062046 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fac736-a137-44cb-aa00-fe4b0f56a2b8 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:28.062339 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fac736-a137-44cb-aa00-fe4b0f56a2b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:28.062623 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fac736-a137-44cb-aa00-fe4b0f56a2b8 None admin] PATH_INFO: `/v3/domains` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:28.063373 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fac736-a137-44cb-aa00-fe4b0f56a2b8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80873) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:07:28.063687 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fac736-a137-44cb-aa00-fe4b0f56a2b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:28.065132 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fac736-a137-44cb-aa00-fe4b0f56a2b8 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:28.088040 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 359/725] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 16 17:07:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:07:28.094555 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef5e9ab-ce07-4627-87c4-e440709dcf80 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:28.282446 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef5e9ab-ce07-4627-87c4-e440709dcf80 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:28.323382 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8984f99-3333-4134-9502-5d283862f0b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:28.324963 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8984f99-3333-4134-9502-5d283862f0b6 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:28.325356 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8984f99-3333-4134-9502-5d283862f0b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:28.325737 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8984f99-3333-4134-9502-5d283862f0b6 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:28.332266 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f2698d-42f9-425f-bc98-19cce87195d4 None None] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:28.332708 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f2698d-42f9-425f-bc98-19cce87195d4 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:28.332997 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f2698d-42f9-425f-bc98-19cce87195d4 None None] PATH_INFO: `/` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:28.337173 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8984f99-3333-4134-9502-5d283862f0b6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:28.337305 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 360/726] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 17:07:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 17:07:28.337397 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8984f99-3333-4134-9502-5d283862f0b6 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:28.339397 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:28.339616 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85baabe0-a5ef-431b-b4d4-4028ea12d4d3 None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:28.340330 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85baabe0-a5ef-431b-b4d4-4028ea12d4d3 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:28.340464 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85baabe0-a5ef-431b-b4d4-4028ea12d4d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:28.353630 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application [None req-d8984f99-3333-4134-9502-5d283862f0b6 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 16 17:07:28.353630 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:07:28.353630 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:07:28.353630 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:07:28.353630 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:07:28.353630 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:07:28.353630 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:07:28.353630 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:07:28.353630 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:07:28.353630 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:07:28.353630 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:07:28.353630 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:07:28.353630 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 17:07:28.353630 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 17:07:28.353630 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 17:07:28.353630 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 17:07:28.354971 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:07:28.354971 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:07:28.354971 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 17:07:28.354971 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 17:07:28.354971 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 17:07:28.354971 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 17:07:28.354971 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:07:28.354971 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:07:28.354971 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:07:28.354971 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:07:28.354971 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:07:28.354971 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application with Lock( Jun 16 17:07:28.354971 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:07:28.354971 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:07:28.354971 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:07:28.354971 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:07:28.354971 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:07:28.354971 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:07:28.356166 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:07:28.356166 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:07:28.356166 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 17:07:28.356166 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 17:07:28.356166 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 17:07:28.356166 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 17:07:28.356166 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 17:07:28.356166 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 17:07:28.356166 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 16 17:07:28.356166 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Jun 16 17:07:28.358957 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 367/727] 10.222.0.39 () {56 vars in 1117 bytes} [Thu Jun 16 17:07:28 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:07:28.365703 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8984f99-3333-4134-9502-5d283862f0b6 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:28.376757 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-85baabe0-a5ef-431b-b4d4-4028ea12d4d3 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:07:28.378318 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-85baabe0-a5ef-431b-b4d4-4028ea12d4d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:07:28.577008 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:28.604822 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 361/728] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 17:07:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 17:07:28.632401 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8984f99-3333-4134-9502-5d283862f0b6 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:28.644002 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85baabe0-a5ef-431b-b4d4-4028ea12d4d3 None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:28.706505 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ef9381-0d5f-4740-b7e5-86d720756278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:28.707368 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ef9381-0d5f-4740-b7e5-86d720756278 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:28.707484 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ef9381-0d5f-4740-b7e5-86d720756278 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:28.707727 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ef9381-0d5f-4740-b7e5-86d720756278 None admin] PATH_INFO: `/v3/users` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:28.708585 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ef9381-0d5f-4740-b7e5-86d720756278 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:07:28.708897 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ef9381-0d5f-4740-b7e5-86d720756278 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:28.710373 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ef9381-0d5f-4740-b7e5-86d720756278 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:28.745481 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 368/729] 10.222.0.39 () {56 vars in 1149 bytes} [Thu Jun 16 17:07:28 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 380 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 17:07:28.751438 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ef9381-0d5f-4740-b7e5-86d720756278 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:28.761989 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85baabe0-a5ef-431b-b4d4-4028ea12d4d3 None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:28.810426 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d2a859-9b65-4ad8-89f0-754c8374c1dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:28.811368 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d2a859-9b65-4ad8-89f0-754c8374c1dd None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:28.811514 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d2a859-9b65-4ad8-89f0-754c8374c1dd None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:28.811780 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d2a859-9b65-4ad8-89f0-754c8374c1dd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:28.838122 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d2a859-9b65-4ad8-89f0-754c8374c1dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 17:07:28.854595 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application [None req-72d2a859-9b65-4ad8-89f0-754c8374c1dd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 17:07:28.854595 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:07:28.854595 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:07:28.854595 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:07:28.854595 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:07:28.854595 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:07:28.854595 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:07:28.854595 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:07:28.854595 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:07:28.854595 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:07:28.854595 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:07:28.854595 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:07:28.854595 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 17:07:28.854595 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 17:07:28.854595 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 17:07:28.854595 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 17:07:28.858941 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 17:07:28.858941 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 17:07:28.858941 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 17:07:28.858941 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 17:07:28.858941 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:07:28.858941 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:07:28.858941 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:07:28.858941 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:07:28.858941 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:07:28.858941 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:07:28.858941 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:07:28.858941 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application with Lock( Jun 16 17:07:28.858941 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:07:28.858941 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:07:28.858941 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:07:28.858941 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:07:28.862475 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:07:28.862475 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:07:28.862475 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:07:28.862475 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:07:28.862475 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 17:07:28.862475 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 17:07:28.862475 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 17:07:28.862475 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 17:07:28.862475 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 17:07:28.862475 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 17:07:28.862475 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 17:07:28.862475 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Jun 16 17:07:28.862475 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 362/730] 10.222.0.39 () {56 vars in 1096 bytes} [Thu Jun 16 17:07:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 17:07:28.873818 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:28.874075 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d2a859-9b65-4ad8-89f0-754c8374c1dd None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:28.898467 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ef9381-0d5f-4740-b7e5-86d720756278 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:28.941877 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe403ee-c65d-47c7-b68d-61f177ec5c1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:28.942540 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe403ee-c65d-47c7-b68d-61f177ec5c1a None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:28.942828 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe403ee-c65d-47c7-b68d-61f177ec5c1a None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:28.943109 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe403ee-c65d-47c7-b68d-61f177ec5c1a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:28.981128 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:29.078133 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe403ee-c65d-47c7-b68d-61f177ec5c1a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:29.079595 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe403ee-c65d-47c7-b68d-61f177ec5c1a None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:29.087148 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d2a859-9b65-4ad8-89f0-754c8374c1dd None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:29.159719 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dc44ec-d632-45dc-bc66-8d659049e92e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:29.160404 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dc44ec-d632-45dc-bc66-8d659049e92e None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:29.160694 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dc44ec-d632-45dc-bc66-8d659049e92e None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:29.160977 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dc44ec-d632-45dc-bc66-8d659049e92e None admin] PATH_INFO: `/v3/roles` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:29.161735 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dc44ec-d632-45dc-bc66-8d659049e92e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80873) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:07:29.162132 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dc44ec-d632-45dc-bc66-8d659049e92e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:29.163570 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dc44ec-d632-45dc-bc66-8d659049e92e None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:29.186000 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 363/731] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 16 17:07:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:07:29.192136 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dc44ec-d632-45dc-bc66-8d659049e92e None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:29.202172 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:29.274007 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 369/732] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 16 17:07:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 523 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 17:07:29.275366 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7d08a0-1768-4a73-b358-541c10a4b99e None None] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:29.275664 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7d08a0-1768-4a73-b358-541c10a4b99e None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:29.275952 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7d08a0-1768-4a73-b358-541c10a4b99e None None] PATH_INFO: `/` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:29.278141 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 370/733] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 17:07:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:07:29.282662 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7d08a0-1768-4a73-b358-541c10a4b99e None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:29.347767 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dc44ec-d632-45dc-bc66-8d659049e92e None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:29.365622 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:29.393709 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33eed6f4-f514-4b39-adae-dc017973280a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:29.394688 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eed6f4-f514-4b39-adae-dc017973280a None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:29.394979 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eed6f4-f514-4b39-adae-dc017973280a None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:29.395263 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eed6f4-f514-4b39-adae-dc017973280a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:29.410520 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33eed6f4-f514-4b39-adae-dc017973280a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:29.412186 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33eed6f4-f514-4b39-adae-dc017973280a None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:29.423178 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7d08a0-1768-4a73-b358-541c10a4b99e None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:29.438204 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application [None req-33eed6f4-f514-4b39-adae-dc017973280a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:07:29.438204 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:07:29.438204 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:07:29.438204 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:07:29.438204 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:07:29.438204 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:07:29.438204 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:07:29.438204 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:07:29.438204 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:07:29.438204 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:07:29.438204 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:07:29.438204 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:07:29.438204 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 17:07:29.438204 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 17:07:29.438204 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 17:07:29.439192 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 17:07:29.439192 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:07:29.439192 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:07:29.439192 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:07:29.439192 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:07:29.439192 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:07:29.439192 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:07:29.439192 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:07:29.439192 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application with Lock( Jun 16 17:07:29.439192 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:07:29.439192 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:07:29.439192 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:07:29.439192 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:07:29.439192 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:07:29.439192 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:07:29.439192 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:07:29.439192 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:07:29.440100 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 17:07:29.440100 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 17:07:29.440100 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:07:29.440100 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Jun 16 17:07:29.440100 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 364/734] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 17:07:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:07:29.441210 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f148b7-758d-4b0e-9982-9cd4032daf7c None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:29.441506 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f148b7-758d-4b0e-9982-9cd4032daf7c None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:29.441797 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f148b7-758d-4b0e-9982-9cd4032daf7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:29.463559 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-98f148b7-758d-4b0e-9982-9cd4032daf7c None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:07:29.465937 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-98f148b7-758d-4b0e-9982-9cd4032daf7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:07:29.470658 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4d7c34-27ac-46db-b1ec-1c1167be2299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:29.471731 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4d7c34-27ac-46db-b1ec-1c1167be2299 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:29.472229 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4d7c34-27ac-46db-b1ec-1c1167be2299 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:29.472760 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4d7c34-27ac-46db-b1ec-1c1167be2299 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:29.487465 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4d7c34-27ac-46db-b1ec-1c1167be2299 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:29.489645 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4d7c34-27ac-46db-b1ec-1c1167be2299 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:29.510819 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application [None req-3e4d7c34-27ac-46db-b1ec-1c1167be2299 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:07:29.510819 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:07:29.510819 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:07:29.510819 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:07:29.510819 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:07:29.510819 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:07:29.510819 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:07:29.510819 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:07:29.510819 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:07:29.510819 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:07:29.510819 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:07:29.510819 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:07:29.510819 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 17:07:29.510819 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 17:07:29.510819 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 17:07:29.512320 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 17:07:29.512320 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:07:29.512320 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:07:29.512320 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:07:29.512320 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:07:29.512320 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:07:29.512320 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:07:29.512320 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:07:29.512320 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application with Lock( Jun 16 17:07:29.512320 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:07:29.512320 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:07:29.512320 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:07:29.512320 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:07:29.512320 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:07:29.512320 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:07:29.512320 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:07:29.512320 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:07:29.513227 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 17:07:29.513227 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 17:07:29.513227 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:07:29.513227 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Jun 16 17:07:29.513227 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 371/735] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 17:07:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:07:29.514000 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4d7c34-27ac-46db-b1ec-1c1167be2299 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:29.529667 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:29.553867 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 365/736] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 17:07:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 17:07:29.555090 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f148b7-758d-4b0e-9982-9cd4032daf7c None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:29.624746 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4d7c34-27ac-46db-b1ec-1c1167be2299 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:29.661426 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eded562-1272-4e2c-bc94-5a1994d64e84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:29.662051 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eded562-1272-4e2c-bc94-5a1994d64e84 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:29.662406 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eded562-1272-4e2c-bc94-5a1994d64e84 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:29.662666 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eded562-1272-4e2c-bc94-5a1994d64e84 None admin] PATH_INFO: `/v3/domains` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:29.663409 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eded562-1272-4e2c-bc94-5a1994d64e84 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:07:29.663721 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eded562-1272-4e2c-bc94-5a1994d64e84 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:29.665227 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eded562-1272-4e2c-bc94-5a1994d64e84 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:29.678762 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:29.679060 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 372/737] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 16 17:07:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:07:29.680670 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eded562-1272-4e2c-bc94-5a1994d64e84 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:29.688462 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f148b7-758d-4b0e-9982-9cd4032daf7c None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:29.729806 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701db757-3646-43d9-bde6-7294962aa12e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:29.731761 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701db757-3646-43d9-bde6-7294962aa12e None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:29.732276 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701db757-3646-43d9-bde6-7294962aa12e None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:29.732781 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701db757-3646-43d9-bde6-7294962aa12e None admin] PATH_INFO: `/v3/domains` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:29.733729 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701db757-3646-43d9-bde6-7294962aa12e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80873) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:07:29.734263 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701db757-3646-43d9-bde6-7294962aa12e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:29.735823 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701db757-3646-43d9-bde6-7294962aa12e None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:29.748983 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 366/738] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 16 17:07:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:07:29.750277 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701db757-3646-43d9-bde6-7294962aa12e None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:29.761819 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:29.792190 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eded562-1272-4e2c-bc94-5a1994d64e84 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:29.829485 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993fc3ff-0ea6-4e7b-b164-46ca3adba39e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:29.830197 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993fc3ff-0ea6-4e7b-b164-46ca3adba39e None admin] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:29.830486 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993fc3ff-0ea6-4e7b-b164-46ca3adba39e None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:29.830765 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993fc3ff-0ea6-4e7b-b164-46ca3adba39e None admin] PATH_INFO: `/v3/services` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:29.831493 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993fc3ff-0ea6-4e7b-b164-46ca3adba39e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:29.832861 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993fc3ff-0ea6-4e7b-b164-46ca3adba39e None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:29.857055 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701db757-3646-43d9-bde6-7294962aa12e None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:29.891471 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d274467-ef79-4652-816b-824564e51660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:29.892300 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d274467-ef79-4652-816b-824564e51660 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:29.892588 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d274467-ef79-4652-816b-824564e51660 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:29.892869 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d274467-ef79-4652-816b-824564e51660 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:29.900811 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d274467-ef79-4652-816b-824564e51660 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:29.902828 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d274467-ef79-4652-816b-824564e51660 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:29.917008 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application [None req-8d274467-ef79-4652-816b-824564e51660 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 16 17:07:29.917008 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:07:29.917008 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:07:29.917008 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:07:29.917008 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:07:29.917008 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:07:29.917008 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:07:29.917008 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:07:29.917008 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:07:29.917008 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:07:29.917008 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:07:29.917008 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:07:29.917008 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 17:07:29.917008 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 17:07:29.917008 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 17:07:29.917008 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 17:07:29.918591 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:07:29.918591 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:07:29.918591 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 17:07:29.918591 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 17:07:29.918591 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 17:07:29.918591 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 17:07:29.918591 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:07:29.918591 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:07:29.918591 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:07:29.918591 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:07:29.918591 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:07:29.918591 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application with Lock( Jun 16 17:07:29.918591 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:07:29.918591 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:07:29.918591 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:07:29.918591 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:07:29.918591 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:07:29.918591 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:07:29.919554 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:07:29.919554 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:07:29.919554 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 17:07:29.919554 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 17:07:29.919554 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 17:07:29.919554 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 17:07:29.919554 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 17:07:29.919554 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 17:07:29.919554 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 16 17:07:29.919554 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Jun 16 17:07:29.919554 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 367/739] 10.222.0.39 () {56 vars in 1096 bytes} [Thu Jun 16 17:07:29 2022] GET /identity/v3/users/swift => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:07:29.920831 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d274467-ef79-4652-816b-824564e51660 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:29.935789 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:29.962063 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 373/740] 10.222.0.39 () {60 vars in 1141 bytes} [Thu Jun 16 17:07:29 2022] POST /identity/v3/services => generated 251 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:07:29.962063 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6643fae0-1261-492b-8fcc-3210ed59e141 None None] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:29.962063 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6643fae0-1261-492b-8fcc-3210ed59e141 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:29.962063 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6643fae0-1261-492b-8fcc-3210ed59e141 None None] PATH_INFO: `/` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:29.962063 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 374/741] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 17:07:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:07:29.962063 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6643fae0-1261-492b-8fcc-3210ed59e141 None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:30.049375 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d274467-ef79-4652-816b-824564e51660 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:30.100525 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0e9bf7-9533-4190-aea7-2acf94355049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:30.101375 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0e9bf7-9533-4190-aea7-2acf94355049 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:30.101661 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0e9bf7-9533-4190-aea7-2acf94355049 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:30.101991 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0e9bf7-9533-4190-aea7-2acf94355049 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:30.111262 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0e9bf7-9533-4190-aea7-2acf94355049 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:30.112749 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0e9bf7-9533-4190-aea7-2acf94355049 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:30.124976 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6643fae0-1261-492b-8fcc-3210ed59e141 None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:30.128830 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application [None req-6e0e9bf7-9533-4190-aea7-2acf94355049 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 17:07:30.128830 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:07:30.128830 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:07:30.128830 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:07:30.128830 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:07:30.128830 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:07:30.128830 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:07:30.128830 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:07:30.128830 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:07:30.128830 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:07:30.128830 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:07:30.128830 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:07:30.128830 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 17:07:30.128830 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 17:07:30.128830 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 17:07:30.129713 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 17:07:30.129713 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:07:30.129713 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:07:30.129713 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:07:30.129713 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:07:30.129713 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:07:30.129713 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:07:30.129713 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:07:30.129713 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application with Lock( Jun 16 17:07:30.129713 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:07:30.129713 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:07:30.129713 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:07:30.129713 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:07:30.129713 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:07:30.129713 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:07:30.129713 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:07:30.129713 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:07:30.130672 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 17:07:30.130672 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 17:07:30.130672 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 17:07:30.130672 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 17:07:30.130672 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 17:07:30.130672 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 17:07:30.130672 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 17:07:30.130672 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Jun 16 17:07:30.130672 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 368/742] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 16 17:07:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:07:30.131616 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa7fa12-f078-4e02-af0d-0ac3a9756280 None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:30.133260 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa7fa12-f078-4e02-af0d-0ac3a9756280 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:30.133260 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa7fa12-f078-4e02-af0d-0ac3a9756280 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:30.150873 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-5aa7fa12-f078-4e02-af0d-0ac3a9756280 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:07:30.152136 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-5aa7fa12-f078-4e02-af0d-0ac3a9756280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:07:30.160244 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:30.164775 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a38933b-1dee-4a22-acae-65e68b64fc6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:30.165446 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a38933b-1dee-4a22-acae-65e68b64fc6b None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:30.165736 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a38933b-1dee-4a22-acae-65e68b64fc6b None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:30.166048 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a38933b-1dee-4a22-acae-65e68b64fc6b None admin] PATH_INFO: `/v3/users` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:30.167357 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a38933b-1dee-4a22-acae-65e68b64fc6b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:07:30.168304 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a38933b-1dee-4a22-acae-65e68b64fc6b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:30.170074 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a38933b-1dee-4a22-acae-65e68b64fc6b None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:30.192575 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 375/743] 10.222.0.39 () {56 vars in 1135 bytes} [Thu Jun 16 17:07:29 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:07:30.193421 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a38933b-1dee-4a22-acae-65e68b64fc6b None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:30.235047 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:30.240557 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 369/744] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 17:07:30 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 17:07:30.241381 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa7fa12-f078-4e02-af0d-0ac3a9756280 None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:30.329992 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a38933b-1dee-4a22-acae-65e68b64fc6b None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:30.383745 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa7fa12-f078-4e02-af0d-0ac3a9756280 None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:30.388974 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b2fc10-af4c-4b65-b9b4-3947812db79e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:30.389717 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b2fc10-af4c-4b65-b9b4-3947812db79e None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:30.390033 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b2fc10-af4c-4b65-b9b4-3947812db79e None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:30.390314 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b2fc10-af4c-4b65-b9b4-3947812db79e None admin] PATH_INFO: `/v3/projects` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:30.391116 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b2fc10-af4c-4b65-b9b4-3947812db79e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:07:30.391429 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b2fc10-af4c-4b65-b9b4-3947812db79e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:30.393478 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b2fc10-af4c-4b65-b9b4-3947812db79e None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:30.410807 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 376/745] 10.222.0.39 () {56 vars in 1148 bytes} [Thu Jun 16 17:07:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:07:30.411964 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b2fc10-af4c-4b65-b9b4-3947812db79e None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:30.424195 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8aefc0-9052-4ad5-9e0a-88a479e0c59f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:30.424780 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8aefc0-9052-4ad5-9e0a-88a479e0c59f None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:30.425068 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8aefc0-9052-4ad5-9e0a-88a479e0c59f None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:30.425347 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8aefc0-9052-4ad5-9e0a-88a479e0c59f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:30.465166 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:30.501670 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:30.506757 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8aefc0-9052-4ad5-9e0a-88a479e0c59f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:30.508231 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8aefc0-9052-4ad5-9e0a-88a479e0c59f None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:30.525246 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b2fc10-af4c-4b65-b9b4-3947812db79e None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:30.561033 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c7701a-14fc-4a9a-8142-ad6fa5dfe380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:30.561701 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c7701a-14fc-4a9a-8142-ad6fa5dfe380 None admin] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:30.562014 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c7701a-14fc-4a9a-8142-ad6fa5dfe380 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:30.562291 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c7701a-14fc-4a9a-8142-ad6fa5dfe380 None admin] PATH_INFO: `/v3/services` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:30.563018 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c7701a-14fc-4a9a-8142-ad6fa5dfe380 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:30.564390 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c7701a-14fc-4a9a-8142-ad6fa5dfe380 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:30.618558 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 370/746] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 16 17:07:30 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 17:07:30.619889 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d33d86-1af2-450e-b625-6645bc8dacca None None] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:30.620171 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d33d86-1af2-450e-b625-6645bc8dacca None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:30.620497 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d33d86-1af2-450e-b625-6645bc8dacca None None] PATH_INFO: `/` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:30.622108 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 371/747] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 17:07:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:07:30.622603 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d33d86-1af2-450e-b625-6645bc8dacca None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:30.647630 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 377/748] 10.222.0.39 () {60 vars in 1141 bytes} [Thu Jun 16 17:07:30 2022] POST /identity/v3/services => generated 240 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:07:30.650196 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c7701a-14fc-4a9a-8142-ad6fa5dfe380 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:30.750112 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:30.763524 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d33d86-1af2-450e-b625-6645bc8dacca None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:30.795657 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c7701a-14fc-4a9a-8142-ad6fa5dfe380 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:30.806133 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d03a58b-c4fb-4d0a-b17a-bdeee143e679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:30.807233 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:30.809090 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d03a58b-c4fb-4d0a-b17a-bdeee143e679 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:30.809625 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d03a58b-c4fb-4d0a-b17a-bdeee143e679 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:30.810180 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d03a58b-c4fb-4d0a-b17a-bdeee143e679 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:30.811265 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d03a58b-c4fb-4d0a-b17a-bdeee143e679 None admin] RBAC: Adding query filter params (role.id=a12797d48dac420cb2eaadbe537f60ef, scope.project.id=73015da4de1f48c29f57fff1040d2c10, user.id=f7f35c1c15a84a92863d4f3f96d76830) {{(pid=80873) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:07:30.811813 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d03a58b-c4fb-4d0a-b17a-bdeee143e679 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:30.813488 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d03a58b-c4fb-4d0a-b17a-bdeee143e679 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:30.823098 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 372/749] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jun 16 17:07:30 2022] GET /identity/v3/role_assignments?user.id=f7f35c1c15a84a92863d4f3f96d76830&scope.project.id=73015da4de1f48c29f57fff1040d2c10&role.id=a12797d48dac420cb2eaadbe537f60ef => generated 259 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:07:30.825563 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bc3fa9-5727-4885-b195-960065b00af3 None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:30.826110 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bc3fa9-5727-4885-b195-960065b00af3 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:30.826591 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bc3fa9-5727-4885-b195-960065b00af3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:30.856947 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-92bc3fa9-5727-4885-b195-960065b00af3 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:07:30.859935 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf130c3-d771-47ef-a8b4-cc0b69719bd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:30.860766 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf130c3-d771-47ef-a8b4-cc0b69719bd7 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:30.861054 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf130c3-d771-47ef-a8b4-cc0b69719bd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:30.861338 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf130c3-d771-47ef-a8b4-cc0b69719bd7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:30.862885 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-92bc3fa9-5727-4885-b195-960065b00af3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:07:30.881133 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf130c3-d771-47ef-a8b4-cc0b69719bd7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:30.883308 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf130c3-d771-47ef-a8b4-cc0b69719bd7 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:30.922324 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application [None req-aaf130c3-d771-47ef-a8b4-cc0b69719bd7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:07:30.922324 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:07:30.922324 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:07:30.922324 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:07:30.922324 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:07:30.922324 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:07:30.922324 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:07:30.922324 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:07:30.922324 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:07:30.922324 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:07:30.922324 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:07:30.922324 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:07:30.922324 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 17:07:30.922324 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 17:07:30.922324 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 17:07:30.923350 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 17:07:30.923350 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:07:30.923350 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:07:30.923350 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:07:30.923350 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:07:30.923350 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:07:30.923350 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:07:30.923350 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:07:30.923350 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application with Lock( Jun 16 17:07:30.923350 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:07:30.923350 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:07:30.923350 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:07:30.923350 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:07:30.923350 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:07:30.923350 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:07:30.923350 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:07:30.923350 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:07:30.924283 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 17:07:30.924283 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 17:07:30.924283 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:07:30.924283 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Jun 16 17:07:30.928043 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 378/750] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 17:07:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:07:30.937666 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf130c3-d771-47ef-a8b4-cc0b69719bd7 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:30.980100 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 373/751] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 17:07:30 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 17:07:31.004997 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bc3fa9-5727-4885-b195-960065b00af3 None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:31.066868 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf130c3-d771-47ef-a8b4-cc0b69719bd7 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:31.102304 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e22a09-1309-427e-ad32-f8a86f15e4bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:31.103355 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e22a09-1309-427e-ad32-f8a86f15e4bb None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:31.103866 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e22a09-1309-427e-ad32-f8a86f15e4bb None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:31.104371 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e22a09-1309-427e-ad32-f8a86f15e4bb None admin] PATH_INFO: `/v3/domains` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:31.106102 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e22a09-1309-427e-ad32-f8a86f15e4bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:07:31.106802 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e22a09-1309-427e-ad32-f8a86f15e4bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:31.108390 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e22a09-1309-427e-ad32-f8a86f15e4bb None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:31.125919 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 379/752] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 16 17:07:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 17:07:31.127923 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e22a09-1309-427e-ad32-f8a86f15e4bb None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:31.150256 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:31.189542 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:31.223978 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bc3fa9-5727-4885-b195-960065b00af3 None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:31.236126 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e22a09-1309-427e-ad32-f8a86f15e4bb None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:31.276554 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ca9bcb-9ed9-47eb-ae72-ed7849568a71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:31.280050 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ca9bcb-9ed9-47eb-ae72-ed7849568a71 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:31.281959 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ca9bcb-9ed9-47eb-ae72-ed7849568a71 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:31.283225 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ca9bcb-9ed9-47eb-ae72-ed7849568a71 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:31.295167 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ca9bcb-9ed9-47eb-ae72-ed7849568a71 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:31.297401 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ca9bcb-9ed9-47eb-ae72-ed7849568a71 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:31.300396 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3d9cd5-76a0-4886-a6ae-d01c560c3845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:31.301455 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3d9cd5-76a0-4886-a6ae-d01c560c3845 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:31.301975 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3d9cd5-76a0-4886-a6ae-d01c560c3845 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:31.302452 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3d9cd5-76a0-4886-a6ae-d01c560c3845 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:31.324905 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application [None req-84ca9bcb-9ed9-47eb-ae72-ed7849568a71 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 17:07:31.324905 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:07:31.324905 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:07:31.324905 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:07:31.324905 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:07:31.324905 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:07:31.324905 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:07:31.324905 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:07:31.324905 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:07:31.324905 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:07:31.324905 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:07:31.324905 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:07:31.324905 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 17:07:31.324905 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 17:07:31.324905 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 17:07:31.325918 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 17:07:31.325918 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:07:31.325918 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:07:31.325918 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:07:31.325918 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:07:31.325918 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:07:31.325918 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:07:31.325918 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:07:31.325918 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application with Lock( Jun 16 17:07:31.325918 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:07:31.325918 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:07:31.325918 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:07:31.325918 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:07:31.325918 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:07:31.325918 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:07:31.325918 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:07:31.325918 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:07:31.326829 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 17:07:31.326829 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 17:07:31.326829 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 17:07:31.326829 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 17:07:31.326829 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 17:07:31.326829 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 17:07:31.326829 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 17:07:31.326829 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Jun 16 17:07:31.329328 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 380/753] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 16 17:07:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 17:07:31.334739 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3d9cd5-76a0-4886-a6ae-d01c560c3845 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 17:07:31.340141 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ca9bcb-9ed9-47eb-ae72-ed7849568a71 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:31.351237 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application [None req-ef3d9cd5-76a0-4886-a6ae-d01c560c3845 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 17:07:31.351237 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:07:31.351237 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:07:31.351237 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:07:31.351237 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:07:31.351237 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:07:31.351237 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:07:31.351237 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:07:31.351237 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:07:31.351237 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:07:31.351237 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:07:31.351237 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:07:31.351237 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 17:07:31.351237 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 17:07:31.351237 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 17:07:31.351237 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 17:07:31.352433 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 17:07:31.352433 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 17:07:31.352433 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 17:07:31.352433 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 17:07:31.352433 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:07:31.352433 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:07:31.352433 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:07:31.352433 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:07:31.352433 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:07:31.352433 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:07:31.352433 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:07:31.352433 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application with Lock( Jun 16 17:07:31.352433 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:07:31.352433 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:07:31.352433 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:07:31.352433 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:07:31.353263 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:07:31.353263 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:07:31.353263 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:07:31.353263 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:07:31.353263 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 17:07:31.353263 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 17:07:31.353263 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 17:07:31.353263 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 17:07:31.353263 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 17:07:31.353263 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 17:07:31.353263 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 17:07:31.353263 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Jun 16 17:07:31.353263 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 374/754] 10.222.0.39 () {56 vars in 1096 bytes} [Thu Jun 16 17:07:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 348 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:07:31.358875 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3d9cd5-76a0-4886-a6ae-d01c560c3845 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:31.436252 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:31.458089 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ca9bcb-9ed9-47eb-ae72-ed7849568a71 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:31.501633 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3d9cd5-76a0-4886-a6ae-d01c560c3845 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:31.530529 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bce0a74-af8d-4830-a817-8c3ec0127502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:31.531551 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bce0a74-af8d-4830-a817-8c3ec0127502 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:31.532043 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bce0a74-af8d-4830-a817-8c3ec0127502 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:31.532522 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bce0a74-af8d-4830-a817-8c3ec0127502 None admin] PATH_INFO: `/v3/projects` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:31.533527 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bce0a74-af8d-4830-a817-8c3ec0127502 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:07:31.534065 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bce0a74-af8d-4830-a817-8c3ec0127502 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:31.535714 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bce0a74-af8d-4830-a817-8c3ec0127502 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:31.549435 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 381/755] 10.222.0.39 () {56 vars in 1148 bytes} [Thu Jun 16 17:07:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 17:07:31.553858 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c2dd2c-f985-414c-b710-f45562c12c93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:31.553858 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c2dd2c-f985-414c-b710-f45562c12c93 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:31.553858 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c2dd2c-f985-414c-b710-f45562c12c93 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:31.553858 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c2dd2c-f985-414c-b710-f45562c12c93 None admin] PATH_INFO: `/v3/roles` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:31.554209 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c2dd2c-f985-414c-b710-f45562c12c93 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80873) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:07:31.554209 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c2dd2c-f985-414c-b710-f45562c12c93 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:31.554209 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c2dd2c-f985-414c-b710-f45562c12c93 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:31.556215 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bce0a74-af8d-4830-a817-8c3ec0127502 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:31.572701 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 375/756] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 16 17:07:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 17:07:31.577462 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c2dd2c-f985-414c-b710-f45562c12c93 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:31.593058 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:31.674023 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bce0a74-af8d-4830-a817-8c3ec0127502 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:31.719195 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c2dd2c-f985-414c-b710-f45562c12c93 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:31.720715 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c25286-0e85-4b5b-9189-0d2493e6605a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:31.721637 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c25286-0e85-4b5b-9189-0d2493e6605a None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:31.722157 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c25286-0e85-4b5b-9189-0d2493e6605a None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:31.722640 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c25286-0e85-4b5b-9189-0d2493e6605a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:31.723697 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c25286-0e85-4b5b-9189-0d2493e6605a None admin] RBAC: Adding query filter params (role.id=dba744f8ab2a4c45b9d3212f8d203aba, scope.project.id=73015da4de1f48c29f57fff1040d2c10, user.id=bbec2dfe63764ed88a23e172ead0afa4) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:07:31.726350 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c25286-0e85-4b5b-9189-0d2493e6605a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:31.728149 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c25286-0e85-4b5b-9189-0d2493e6605a None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:31.748409 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 382/757] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jun 16 17:07:31 2022] GET /identity/v3/role_assignments?user.id=bbec2dfe63764ed88a23e172ead0afa4&scope.project.id=73015da4de1f48c29f57fff1040d2c10&role.id=dba744f8ab2a4c45b9d3212f8d203aba => generated 259 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:07:31.764737 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d09341-2eb3-4c51-9e56-67b1a4c44a30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:31.765949 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d09341-2eb3-4c51-9e56-67b1a4c44a30 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:31.766474 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d09341-2eb3-4c51-9e56-67b1a4c44a30 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:31.766965 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d09341-2eb3-4c51-9e56-67b1a4c44a30 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:31.779879 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d09341-2eb3-4c51-9e56-67b1a4c44a30 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:31.781866 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d09341-2eb3-4c51-9e56-67b1a4c44a30 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:31.801185 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application [None req-f2d09341-2eb3-4c51-9e56-67b1a4c44a30 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:07:31.801185 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:07:31.801185 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:07:31.801185 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:07:31.801185 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:07:31.801185 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:07:31.801185 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:07:31.801185 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:07:31.801185 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:07:31.801185 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:07:31.801185 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:07:31.801185 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:07:31.801185 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 17:07:31.801185 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 17:07:31.801185 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 17:07:31.802239 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 17:07:31.802239 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:07:31.802239 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:07:31.802239 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:07:31.802239 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:07:31.802239 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:07:31.802239 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:07:31.802239 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:07:31.802239 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application with Lock( Jun 16 17:07:31.802239 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:07:31.802239 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:07:31.802239 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:07:31.802239 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:07:31.802239 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:07:31.802239 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:07:31.802239 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:07:31.802239 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:07:31.803168 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 17:07:31.803168 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 17:07:31.803168 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:07:31.803168 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Jun 16 17:07:31.805642 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 376/758] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 17:07:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 17:07:31.813809 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c25286-0e85-4b5b-9189-0d2493e6605a None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:31.830284 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:31.954391 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c25286-0e85-4b5b-9189-0d2493e6605a None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:31.991677 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e725387b-5fdc-4b0d-a37a-488038296193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:31.992353 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e725387b-5fdc-4b0d-a37a-488038296193 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:31.992639 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e725387b-5fdc-4b0d-a37a-488038296193 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:31.992916 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e725387b-5fdc-4b0d-a37a-488038296193 None admin] PATH_INFO: `/v3/domains` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:31.993648 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e725387b-5fdc-4b0d-a37a-488038296193 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:07:31.994003 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e725387b-5fdc-4b0d-a37a-488038296193 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:31.995381 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e725387b-5fdc-4b0d-a37a-488038296193 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:32.009462 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 383/759] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 16 17:07:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:07:32.015225 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d09341-2eb3-4c51-9e56-67b1a4c44a30 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:32.091646 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:32.191979 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d09341-2eb3-4c51-9e56-67b1a4c44a30 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:32.286493 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd3bf45-3dde-412b-8620-ebb3365d30e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:32.287309 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd3bf45-3dde-412b-8620-ebb3365d30e7 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:32.287602 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd3bf45-3dde-412b-8620-ebb3365d30e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:32.287870 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd3bf45-3dde-412b-8620-ebb3365d30e7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:32.306961 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd3bf45-3dde-412b-8620-ebb3365d30e7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:32.308606 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd3bf45-3dde-412b-8620-ebb3365d30e7 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:32.332501 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application [None req-3dd3bf45-3dde-412b-8620-ebb3365d30e7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 16 17:07:32.332501 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:07:32.332501 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:07:32.332501 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:07:32.332501 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:07:32.332501 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:07:32.332501 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:07:32.332501 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:07:32.332501 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:07:32.332501 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:07:32.332501 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:07:32.332501 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:07:32.332501 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 17:07:32.332501 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 17:07:32.332501 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 17:07:32.332501 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 17:07:32.334852 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:07:32.334852 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:07:32.334852 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 17:07:32.334852 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 17:07:32.334852 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 17:07:32.334852 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 17:07:32.334852 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:07:32.334852 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:07:32.334852 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:07:32.334852 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:07:32.334852 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:07:32.334852 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application with Lock( Jun 16 17:07:32.334852 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:07:32.334852 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:07:32.334852 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:07:32.334852 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:07:32.334852 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:07:32.334852 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:07:32.335840 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:07:32.335840 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:07:32.335840 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 17:07:32.335840 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 17:07:32.335840 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 17:07:32.335840 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 17:07:32.335840 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 17:07:32.335840 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 17:07:32.335840 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 16 17:07:32.335840 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Jun 16 17:07:32.335840 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 377/760] 10.222.0.39 () {56 vars in 1093 bytes} [Thu Jun 16 17:07:32 2022] GET /identity/v3/users/nova => generated 82 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:07:32.343346 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e725387b-5fdc-4b0d-a37a-488038296193 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:32.462218 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:32.525463 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e725387b-5fdc-4b0d-a37a-488038296193 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:32.594628 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77580500-9f37-411d-a59f-c9408c8c79a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:32.595241 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77580500-9f37-411d-a59f-c9408c8c79a0 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:32.595529 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77580500-9f37-411d-a59f-c9408c8c79a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:32.595806 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77580500-9f37-411d-a59f-c9408c8c79a0 None admin] PATH_INFO: `/v3/users` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:32.596652 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77580500-9f37-411d-a59f-c9408c8c79a0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:07:32.596971 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77580500-9f37-411d-a59f-c9408c8c79a0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:32.598428 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77580500-9f37-411d-a59f-c9408c8c79a0 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:32.630749 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 384/761] 10.222.0.39 () {56 vars in 1133 bytes} [Thu Jun 16 17:07:32 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:07:32.637462 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd3bf45-3dde-412b-8620-ebb3365d30e7 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:32.781141 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd3bf45-3dde-412b-8620-ebb3365d30e7 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:32.817246 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:32.831394 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc75209-db9e-44f7-bb41-5862d9e28f5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:32.832204 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc75209-db9e-44f7-bb41-5862d9e28f5f None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:32.832498 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc75209-db9e-44f7-bb41-5862d9e28f5f None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:32.832774 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc75209-db9e-44f7-bb41-5862d9e28f5f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:32.842030 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30533ac2-a079-4b9d-ad5a-060d40d0570d None None] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:32.842322 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30533ac2-a079-4b9d-ad5a-060d40d0570d None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:32.842592 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30533ac2-a079-4b9d-ad5a-060d40d0570d None None] PATH_INFO: `/` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:32.844409 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 385/762] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 17:07:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:07:32.847010 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc75209-db9e-44f7-bb41-5862d9e28f5f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:32.848600 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc75209-db9e-44f7-bb41-5862d9e28f5f None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:32.849805 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06885e9-4b67-473f-bcd3-478d4796f042 None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:32.850531 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06885e9-4b67-473f-bcd3-478d4796f042 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:32.850531 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06885e9-4b67-473f-bcd3-478d4796f042 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:32.866954 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-a06885e9-4b67-473f-bcd3-478d4796f042 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:07:32.868146 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-a06885e9-4b67-473f-bcd3-478d4796f042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:07:32.873147 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application [None req-0bc75209-db9e-44f7-bb41-5862d9e28f5f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:07:32.873147 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:07:32.873147 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:07:32.873147 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:07:32.873147 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:07:32.873147 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:07:32.873147 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:07:32.873147 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:07:32.873147 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:07:32.873147 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:07:32.873147 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:07:32.873147 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:07:32.873147 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 17:07:32.873147 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 17:07:32.873147 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 17:07:32.874115 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 17:07:32.874115 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:07:32.874115 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:07:32.874115 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:07:32.874115 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:07:32.874115 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:07:32.874115 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:07:32.874115 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:07:32.874115 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application with Lock( Jun 16 17:07:32.874115 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:07:32.874115 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:07:32.874115 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:07:32.874115 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:07:32.874115 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:07:32.874115 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:07:32.874115 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:07:32.874115 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:07:32.875021 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 17:07:32.875021 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 17:07:32.875021 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:07:32.875021 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Jun 16 17:07:32.883769 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 378/763] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 17:07:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:07:32.883769 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc75209-db9e-44f7-bb41-5862d9e28f5f None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:32.947849 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 386/764] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 17:07:32 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 17:07:32.971001 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06885e9-4b67-473f-bcd3-478d4796f042 None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:33.029645 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:33.082240 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06885e9-4b67-473f-bcd3-478d4796f042 None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:33.124691 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69af1d6-65ad-4c74-89ca-8b5520244a36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:33.125567 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69af1d6-65ad-4c74-89ca-8b5520244a36 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:33.125877 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69af1d6-65ad-4c74-89ca-8b5520244a36 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:33.126159 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69af1d6-65ad-4c74-89ca-8b5520244a36 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:33.128583 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69af1d6-65ad-4c74-89ca-8b5520244a36 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:33.129997 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69af1d6-65ad-4c74-89ca-8b5520244a36 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:33.150129 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application [None req-b69af1d6-65ad-4c74-89ca-8b5520244a36 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 16 17:07:33.150129 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:07:33.150129 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 17:07:33.150129 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 17:07:33.150129 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 17:07:33.150129 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 17:07:33.150129 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 17:07:33.150129 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 17:07:33.150129 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 16 17:07:33.150129 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Jun 16 17:07:33.150129 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 17:07:33.150129 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Jun 16 17:07:33.150129 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:07:33.150129 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:07:33.150129 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:07:33.150129 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:07:33.151150 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:07:33.151150 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:07:33.151150 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:07:33.151150 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:07:33.151150 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:07:33.151150 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:07:33.151150 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:07:33.151150 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 17:07:33.151150 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 17:07:33.151150 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 17:07:33.151150 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 17:07:33.151150 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:07:33.151150 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:07:33.151150 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:07:33.151150 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:07:33.151150 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:07:33.152607 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:07:33.152607 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:07:33.152607 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application with Lock( Jun 16 17:07:33.152607 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:07:33.152607 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:07:33.152607 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:07:33.152607 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:07:33.152607 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:07:33.152607 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:07:33.152607 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:07:33.152607 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:07:33.152607 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 17:07:33.152607 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 17:07:33.152607 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 16 17:07:33.152607 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Jun 16 17:07:33.152607 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 387/765] 10.222.0.39 () {56 vars in 1129 bytes} [Thu Jun 16 17:07:32 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 17:07:33.162213 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc75209-db9e-44f7-bb41-5862d9e28f5f None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:33.164657 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69af1d6-65ad-4c74-89ca-8b5520244a36 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:33.232030 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95931c3-b804-4edc-b0d8-0b60f91ba441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:33.232848 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95931c3-b804-4edc-b0d8-0b60f91ba441 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:33.233143 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95931c3-b804-4edc-b0d8-0b60f91ba441 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:33.233426 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95931c3-b804-4edc-b0d8-0b60f91ba441 None admin] PATH_INFO: `/v3/domains` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:33.234180 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95931c3-b804-4edc-b0d8-0b60f91ba441 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80873) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:07:33.234493 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95931c3-b804-4edc-b0d8-0b60f91ba441 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:33.235933 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95931c3-b804-4edc-b0d8-0b60f91ba441 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:33.249273 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 379/766] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 16 17:07:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 366 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:07:33.257700 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95931c3-b804-4edc-b0d8-0b60f91ba441 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:33.307495 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:33.392312 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69af1d6-65ad-4c74-89ca-8b5520244a36 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:33.392846 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95931c3-b804-4edc-b0d8-0b60f91ba441 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:33.413217 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:33.433190 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea645111-0e65-493d-a3b9-28b2095bd3eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:33.434989 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea645111-0e65-493d-a3b9-28b2095bd3eb None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:33.435496 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea645111-0e65-493d-a3b9-28b2095bd3eb None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:33.436012 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea645111-0e65-493d-a3b9-28b2095bd3eb None admin] PATH_INFO: `/v3/services` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:33.436129 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b216015a-c0a1-4f78-9bfb-9f0138df6be4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:33.436853 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b216015a-c0a1-4f78-9bfb-9f0138df6be4 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:33.437203 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b216015a-c0a1-4f78-9bfb-9f0138df6be4 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:33.437485 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b216015a-c0a1-4f78-9bfb-9f0138df6be4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:33.437738 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea645111-0e65-493d-a3b9-28b2095bd3eb None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:07:33.438286 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea645111-0e65-493d-a3b9-28b2095bd3eb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:33.441141 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea645111-0e65-493d-a3b9-28b2095bd3eb None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:33.445533 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b216015a-c0a1-4f78-9bfb-9f0138df6be4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:33.446725 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 388/767] 10.222.0.39 () {56 vars in 1124 bytes} [Thu Jun 16 17:07:33 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:07:33.446999 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b216015a-c0a1-4f78-9bfb-9f0138df6be4 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:33.447863 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646ee82d-4c92-430e-b151-dd77d00ac8a3 None None] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:33.448158 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646ee82d-4c92-430e-b151-dd77d00ac8a3 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:33.448615 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646ee82d-4c92-430e-b151-dd77d00ac8a3 None None] PATH_INFO: `/` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:33.455160 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 389/768] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 17:07:33 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:07:33.456213 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1595b2d-187d-4e9e-8beb-062448e462df None None] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:33.456512 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1595b2d-187d-4e9e-8beb-062448e462df None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:33.456797 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1595b2d-187d-4e9e-8beb-062448e462df None None] PATH_INFO: `/` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:33.458214 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 390/769] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 17:07:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:07:33.458766 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1595b2d-187d-4e9e-8beb-062448e462df None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:33.461677 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application [None req-b216015a-c0a1-4f78-9bfb-9f0138df6be4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 17:07:33.461677 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:07:33.461677 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:07:33.461677 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:07:33.461677 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:07:33.461677 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:07:33.461677 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:07:33.461677 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:07:33.461677 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:07:33.461677 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:07:33.461677 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:07:33.461677 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:07:33.461677 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 17:07:33.461677 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 17:07:33.461677 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 17:07:33.462572 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 17:07:33.462572 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:07:33.462572 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:07:33.462572 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:07:33.462572 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:07:33.462572 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:07:33.462572 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:07:33.462572 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:07:33.462572 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application with Lock( Jun 16 17:07:33.462572 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:07:33.462572 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:07:33.462572 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:07:33.462572 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:07:33.462572 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:07:33.462572 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:07:33.462572 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:07:33.462572 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:07:33.465338 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 17:07:33.465338 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 17:07:33.465338 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 17:07:33.465338 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 17:07:33.465338 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 17:07:33.465338 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 17:07:33.465338 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 17:07:33.465338 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Jun 16 17:07:33.465338 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 380/770] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 16 17:07:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:07:33.465338 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e334fec2-3d5c-49b4-827e-1bf899ab78ee None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:33.465930 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e334fec2-3d5c-49b4-827e-1bf899ab78ee None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:33.465930 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e334fec2-3d5c-49b4-827e-1bf899ab78ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:33.483942 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-e334fec2-3d5c-49b4-827e-1bf899ab78ee None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:07:33.485155 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-e334fec2-3d5c-49b4-827e-1bf899ab78ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:07:33.560273 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 381/771] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 17:07:33 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 17:07:33.561484 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6616ce41-5fe8-4df2-a085-ef0dbd0ecdad None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:33.561801 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6616ce41-5fe8-4df2-a085-ef0dbd0ecdad None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:33.562090 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6616ce41-5fe8-4df2-a085-ef0dbd0ecdad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:33.580302 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-6616ce41-5fe8-4df2-a085-ef0dbd0ecdad None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:07:33.581666 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-6616ce41-5fe8-4df2-a085-ef0dbd0ecdad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:07:33.592429 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1595b2d-187d-4e9e-8beb-062448e462df None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:33.607507 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:33.627757 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9fcfa4-863b-4655-9751-eb994c17d3fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:33.628428 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9fcfa4-863b-4655-9751-eb994c17d3fa None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:33.628716 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9fcfa4-863b-4655-9751-eb994c17d3fa None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:33.628997 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9fcfa4-863b-4655-9751-eb994c17d3fa None admin] PATH_INFO: `/v3/services` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:33.629713 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9fcfa4-863b-4655-9751-eb994c17d3fa None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:07:33.630060 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9fcfa4-863b-4655-9751-eb994c17d3fa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:33.631425 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9fcfa4-863b-4655-9751-eb994c17d3fa None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:33.642439 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 391/772] 10.222.0.39 () {56 vars in 1124 bytes} [Thu Jun 16 17:07:33 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:07:33.642439 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9fcfa4-863b-4655-9751-eb994c17d3fa None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:33.669283 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 382/773] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 17:07:33 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 17:07:33.670175 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6616ce41-5fe8-4df2-a085-ef0dbd0ecdad None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:33.700814 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:33.759673 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9fcfa4-863b-4655-9751-eb994c17d3fa None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:33.779387 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6616ce41-5fe8-4df2-a085-ef0dbd0ecdad None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:33.798288 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9edce3-ecab-4b04-a761-16765e4b1e4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:33.799239 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9edce3-ecab-4b04-a761-16765e4b1e4f None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:33.799705 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9edce3-ecab-4b04-a761-16765e4b1e4f None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:33.800185 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9edce3-ecab-4b04-a761-16765e4b1e4f None admin] PATH_INFO: `/v3/projects` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:33.801290 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9edce3-ecab-4b04-a761-16765e4b1e4f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:07:33.801609 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9edce3-ecab-4b04-a761-16765e4b1e4f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:33.803045 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9edce3-ecab-4b04-a761-16765e4b1e4f None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:33.815798 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f0d562-01f5-4a15-9003-f5dbfb034453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:33.816592 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f0d562-01f5-4a15-9003-f5dbfb034453 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:33.816883 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f0d562-01f5-4a15-9003-f5dbfb034453 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:33.817166 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f0d562-01f5-4a15-9003-f5dbfb034453 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:33.817896 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 392/774] 10.222.0.39 () {56 vars in 1148 bytes} [Thu Jun 16 17:07:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:07:33.818961 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9edce3-ecab-4b04-a761-16765e4b1e4f None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:33.828717 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f0d562-01f5-4a15-9003-f5dbfb034453 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 17:07:33.836568 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application [None req-d1f0d562-01f5-4a15-9003-f5dbfb034453 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 17:07:33.836568 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:07:33.836568 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:07:33.836568 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:07:33.836568 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:07:33.836568 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:07:33.836568 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:07:33.836568 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:07:33.836568 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:07:33.836568 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:07:33.836568 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:07:33.836568 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:07:33.836568 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 17:07:33.836568 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 17:07:33.836568 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 17:07:33.836568 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 17:07:33.837528 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 17:07:33.837528 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 17:07:33.837528 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 17:07:33.837528 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 17:07:33.837528 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:07:33.837528 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:07:33.837528 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:07:33.837528 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:07:33.837528 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:07:33.837528 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:07:33.837528 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:07:33.837528 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application with Lock( Jun 16 17:07:33.837528 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:07:33.837528 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:07:33.837528 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:07:33.837528 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:07:33.838454 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:07:33.838454 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:07:33.838454 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:07:33.838454 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:07:33.838454 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 17:07:33.838454 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 17:07:33.838454 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 17:07:33.838454 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 17:07:33.838454 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 17:07:33.838454 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 17:07:33.838454 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 17:07:33.838454 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Jun 16 17:07:33.838454 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 383/775] 10.222.0.39 () {56 vars in 1102 bytes} [Thu Jun 16 17:07:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:07:33.839769 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f0d562-01f5-4a15-9003-f5dbfb034453 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:33.859462 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:33.947383 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9edce3-ecab-4b04-a761-16765e4b1e4f None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:33.949877 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:33.959735 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f0d562-01f5-4a15-9003-f5dbfb034453 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:33.983586 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789ea68c-057e-4620-b632-aaa9c048b6e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:33.984662 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789ea68c-057e-4620-b632-aaa9c048b6e8 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:33.985495 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789ea68c-057e-4620-b632-aaa9c048b6e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:33.986196 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789ea68c-057e-4620-b632-aaa9c048b6e8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:33.987362 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789ea68c-057e-4620-b632-aaa9c048b6e8 None admin] RBAC: Adding query filter params (interface=public, service_id=9245b927a560471db3dd0849f36629c1, region_id=RegionOne) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:07:33.988367 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789ea68c-057e-4620-b632-aaa9c048b6e8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:33.991394 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789ea68c-057e-4620-b632-aaa9c048b6e8 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:33.998630 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6754ef8-651b-4bb9-9945-225ce9bf42ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:33.999616 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6754ef8-651b-4bb9-9945-225ce9bf42ec None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:34.000053 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6754ef8-651b-4bb9-9945-225ce9bf42ec None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:34.000480 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6754ef8-651b-4bb9-9945-225ce9bf42ec None admin] PATH_INFO: `/v3/services/network` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:34.001143 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 393/776] 10.222.0.39 () {56 vars in 1251 bytes} [Thu Jun 16 17:07:33 2022] GET /identity/v3/endpoints?service_id=9245b927a560471db3dd0849f36629c1&interface=public®ion_id=RegionOne => generated 194 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:07:34.001455 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6754ef8-651b-4bb9-9945-225ce9bf42ec None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:34.001972 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789ea68c-057e-4620-b632-aaa9c048b6e8 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:34.003129 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6754ef8-651b-4bb9-9945-225ce9bf42ec None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:34.017029 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application [None req-c6754ef8-651b-4bb9-9945-225ce9bf42ec None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 16 17:07:34.017029 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:07:34.017029 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 17:07:34.017029 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 17:07:34.017029 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 17:07:34.017029 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 17:07:34.017029 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 17:07:34.017029 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 17:07:34.017029 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 16 17:07:34.017029 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Jun 16 17:07:34.017029 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 17:07:34.017029 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Jun 16 17:07:34.017029 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:07:34.017029 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:07:34.017029 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:07:34.017029 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:07:34.017029 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:07:34.018236 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:07:34.018236 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:07:34.018236 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:07:34.018236 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:07:34.018236 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:07:34.018236 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:07:34.018236 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 17:07:34.018236 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 17:07:34.018236 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 17:07:34.018236 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 17:07:34.018236 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:07:34.018236 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:07:34.018236 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:07:34.018236 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:07:34.018236 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:07:34.018236 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:07:34.019083 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:07:34.019083 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application with Lock( Jun 16 17:07:34.019083 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:07:34.019083 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:07:34.019083 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:07:34.019083 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:07:34.019083 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:07:34.019083 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:07:34.019083 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:07:34.019083 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:07:34.019083 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 17:07:34.019083 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 17:07:34.019083 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 16 17:07:34.019083 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Jun 16 17:07:34.024887 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 384/777] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 16 17:07:33 2022] GET /identity/v3/services/network => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:07:34.024887 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6754ef8-651b-4bb9-9945-225ce9bf42ec None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:34.111935 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:34.117318 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789ea68c-057e-4620-b632-aaa9c048b6e8 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:34.136141 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6754ef8-651b-4bb9-9945-225ce9bf42ec None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:34.153602 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7fefba-3400-4abd-aeca-b4b95dc5019e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:34.154447 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7fefba-3400-4abd-aeca-b4b95dc5019e None admin] REQUEST_METHOD: `PUT` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:34.154729 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7fefba-3400-4abd-aeca-b4b95dc5019e None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:34.155005 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7fefba-3400-4abd-aeca-b4b95dc5019e None admin] PATH_INFO: `/v3/projects/73015da4de1f48c29f57fff1040d2c10/users/3d381bb41dea4f1e90c3cf3815ac88dc/roles/dba744f8ab2a4c45b9d3212f8d203aba` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:34.157026 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7fefba-3400-4abd-aeca-b4b95dc5019e None admin] RBAC: Authorizing `identity:create_grant(project_id=73015da4de1f48c29f57fff1040d2c10, user_id=3d381bb41dea4f1e90c3cf3815ac88dc, role_id=dba744f8ab2a4c45b9d3212f8d203aba)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:34.158496 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7fefba-3400-4abd-aeca-b4b95dc5019e None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:34.172198 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fae4b3b-64e9-43d2-8857-eb5bf708d1d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:34.172881 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fae4b3b-64e9-43d2-8857-eb5bf708d1d0 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:34.173173 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fae4b3b-64e9-43d2-8857-eb5bf708d1d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:34.173458 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fae4b3b-64e9-43d2-8857-eb5bf708d1d0 None admin] PATH_INFO: `/v3/roles` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:34.174254 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fae4b3b-64e9-43d2-8857-eb5bf708d1d0 None admin] RBAC: Adding query filter params (name=service) {{(pid=80873) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:07:34.174573 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fae4b3b-64e9-43d2-8857-eb5bf708d1d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:34.175939 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fae4b3b-64e9-43d2-8857-eb5bf708d1d0 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:34.184378 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 385/778] 10.222.0.39 () {56 vars in 1103 bytes} [Thu Jun 16 17:07:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:07:34.185175 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fae4b3b-64e9-43d2-8857-eb5bf708d1d0 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:34.227928 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 394/779] 10.222.0.39 () {58 vars in 1439 bytes} [Thu Jun 16 17:07:34 2022] PUT /identity/v3/projects/73015da4de1f48c29f57fff1040d2c10/users/3d381bb41dea4f1e90c3cf3815ac88dc/roles/dba744f8ab2a4c45b9d3212f8d203aba => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:07:34.229245 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7fefba-3400-4abd-aeca-b4b95dc5019e None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:34.265424 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:34.322850 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fae4b3b-64e9-43d2-8857-eb5bf708d1d0 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:34.365584 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e633bf1f-0dcb-4e81-add6-17f37379eac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:34.366371 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e633bf1f-0dcb-4e81-add6-17f37379eac4 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:34.366615 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e633bf1f-0dcb-4e81-add6-17f37379eac4 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:34.366984 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e633bf1f-0dcb-4e81-add6-17f37379eac4 None admin] PATH_INFO: `/v3/services` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:34.367722 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e633bf1f-0dcb-4e81-add6-17f37379eac4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:34.369162 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e633bf1f-0dcb-4e81-add6-17f37379eac4 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:34.375525 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7fefba-3400-4abd-aeca-b4b95dc5019e None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:34.382339 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 386/780] 10.222.0.39 () {56 vars in 1087 bytes} [Thu Jun 16 17:07:34 2022] GET /identity/v3/services => generated 772 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:07:34.383465 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e633bf1f-0dcb-4e81-add6-17f37379eac4 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:34.399499 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:34.423983 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e266c0-041e-4d40-8600-63b614887940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:34.425369 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e266c0-041e-4d40-8600-63b614887940 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:34.425953 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e266c0-041e-4d40-8600-63b614887940 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:34.426435 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e266c0-041e-4d40-8600-63b614887940 None admin] PATH_INFO: `/v3/services` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:34.427409 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e266c0-041e-4d40-8600-63b614887940 None admin] RBAC: Adding query filter params (name=network) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:07:34.427944 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e266c0-041e-4d40-8600-63b614887940 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:34.429559 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e266c0-041e-4d40-8600-63b614887940 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:34.437871 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 395/781] 10.222.0.39 () {56 vars in 1112 bytes} [Thu Jun 16 17:07:34 2022] GET /identity/v3/services?name=network => generated 124 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:07:34.444796 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e266c0-041e-4d40-8600-63b614887940 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:34.517395 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e633bf1f-0dcb-4e81-add6-17f37379eac4 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:34.558460 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:34.568076 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b0bb2b-07cc-4149-9a2e-4beb31c49b43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:34.568909 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b0bb2b-07cc-4149-9a2e-4beb31c49b43 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:34.569208 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b0bb2b-07cc-4149-9a2e-4beb31c49b43 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:34.569495 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b0bb2b-07cc-4149-9a2e-4beb31c49b43 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:34.570597 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e266c0-041e-4d40-8600-63b614887940 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:34.582781 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b0bb2b-07cc-4149-9a2e-4beb31c49b43 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:34.584376 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b0bb2b-07cc-4149-9a2e-4beb31c49b43 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:34.606707 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application [None req-72b0bb2b-07cc-4149-9a2e-4beb31c49b43 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:07:34.606707 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:07:34.606707 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:07:34.606707 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:07:34.606707 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:07:34.606707 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:07:34.606707 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:07:34.606707 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:07:34.606707 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:07:34.606707 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:07:34.606707 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:07:34.606707 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:07:34.606707 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 17:07:34.606707 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 17:07:34.606707 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 17:07:34.607709 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 17:07:34.607709 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:07:34.607709 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:07:34.607709 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:07:34.607709 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:07:34.607709 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:07:34.607709 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:07:34.607709 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:07:34.607709 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application with Lock( Jun 16 17:07:34.607709 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:07:34.607709 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:07:34.607709 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:07:34.607709 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:07:34.607709 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:07:34.607709 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:07:34.607709 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:07:34.607709 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:07:34.608618 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 17:07:34.608618 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 17:07:34.608618 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:07:34.608618 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Jun 16 17:07:34.608618 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 387/782] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 17:07:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:07:34.613612 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b0bb2b-07cc-4149-9a2e-4beb31c49b43 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:34.614908 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63b1229-2dd5-4837-9a70-25cce5d38b2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:34.615821 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63b1229-2dd5-4837-9a70-25cce5d38b2b None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:34.616333 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63b1229-2dd5-4837-9a70-25cce5d38b2b None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:34.616889 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63b1229-2dd5-4837-9a70-25cce5d38b2b None admin] PATH_INFO: `/v3/services` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:34.617978 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63b1229-2dd5-4837-9a70-25cce5d38b2b None admin] RBAC: Adding query filter params (type=network) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:07:34.618515 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63b1229-2dd5-4837-9a70-25cce5d38b2b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:34.620139 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63b1229-2dd5-4837-9a70-25cce5d38b2b None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:34.627495 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 396/783] 10.222.0.39 () {56 vars in 1112 bytes} [Thu Jun 16 17:07:34 2022] GET /identity/v3/services?type=network => generated 350 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 17:07:34.633589 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63b1229-2dd5-4837-9a70-25cce5d38b2b None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:34.722951 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:34.759168 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63b1229-2dd5-4837-9a70-25cce5d38b2b None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:34.782552 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b0bb2b-07cc-4149-9a2e-4beb31c49b43 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:34.804887 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea484fa-0e46-42b7-84b1-02a69154e5ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:34.805948 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea484fa-0e46-42b7-84b1-02a69154e5ec None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:34.806244 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea484fa-0e46-42b7-84b1-02a69154e5ec None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:34.806529 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea484fa-0e46-42b7-84b1-02a69154e5ec None admin] PATH_INFO: `/v3/endpoints` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:34.807344 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea484fa-0e46-42b7-84b1-02a69154e5ec None admin] RBAC: Adding query filter params (interface=public, service_id=9e1c987da76649299d253abfd2fe62ea, region_id=RegionOne) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:07:34.807663 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea484fa-0e46-42b7-84b1-02a69154e5ec None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:34.810188 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea484fa-0e46-42b7-84b1-02a69154e5ec None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:34.818700 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 397/784] 10.222.0.39 () {56 vars in 1251 bytes} [Thu Jun 16 17:07:34 2022] GET /identity/v3/endpoints?service_id=9e1c987da76649299d253abfd2fe62ea&interface=public®ion_id=RegionOne => generated 194 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:07:34.820734 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c2822e-ae23-4d9c-b37b-f701521bfdff None None] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:34.821305 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c2822e-ae23-4d9c-b37b-f701521bfdff None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:34.821592 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c2822e-ae23-4d9c-b37b-f701521bfdff None None] PATH_INFO: `/` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:34.823158 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 398/785] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 17:07:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:07:34.825048 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c2822e-ae23-4d9c-b37b-f701521bfdff None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:34.830435 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f628db-9746-4a16-b591-68fb860bd122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:34.831113 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f628db-9746-4a16-b591-68fb860bd122 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:34.831399 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f628db-9746-4a16-b591-68fb860bd122 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:34.831676 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f628db-9746-4a16-b591-68fb860bd122 None admin] PATH_INFO: `/v3/domains` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:34.832410 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f628db-9746-4a16-b591-68fb860bd122 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80873) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:07:34.832724 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f628db-9746-4a16-b591-68fb860bd122 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:34.834116 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f628db-9746-4a16-b591-68fb860bd122 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:34.848202 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 388/786] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 16 17:07:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:07:34.849854 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4854802a-0645-4fe2-8bd1-ac29cc0d6405 None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:34.850154 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4854802a-0645-4fe2-8bd1-ac29cc0d6405 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:34.850437 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4854802a-0645-4fe2-8bd1-ac29cc0d6405 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:34.853643 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:34.868483 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-4854802a-0645-4fe2-8bd1-ac29cc0d6405 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:07:34.869681 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-4854802a-0645-4fe2-8bd1-ac29cc0d6405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:07:34.954537 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 389/787] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 17:07:34 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 17:07:34.955411 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4854802a-0645-4fe2-8bd1-ac29cc0d6405 None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:34.964315 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c2822e-ae23-4d9c-b37b-f701521bfdff None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:35.007519 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:35.017463 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1202567-e027-43db-89e0-c65e2e14af0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:35.018185 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1202567-e027-43db-89e0-c65e2e14af0c None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:35.018479 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1202567-e027-43db-89e0-c65e2e14af0c None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:35.019594 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1202567-e027-43db-89e0-c65e2e14af0c None admin] PATH_INFO: `/v3/services` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:35.019594 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1202567-e027-43db-89e0-c65e2e14af0c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:35.020887 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1202567-e027-43db-89e0-c65e2e14af0c None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:35.027430 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 399/788] 10.222.0.39 () {56 vars in 1087 bytes} [Thu Jun 16 17:07:34 2022] GET /identity/v3/services => generated 772 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:07:35.028400 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1202567-e027-43db-89e0-c65e2e14af0c None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:35.067175 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4854802a-0645-4fe2-8bd1-ac29cc0d6405 None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:35.122632 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0747e74-e8fe-4343-9a76-7aa38dda0c91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:35.123484 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0747e74-e8fe-4343-9a76-7aa38dda0c91 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:35.123785 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0747e74-e8fe-4343-9a76-7aa38dda0c91 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:35.124057 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0747e74-e8fe-4343-9a76-7aa38dda0c91 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:35.127317 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:35.138398 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0747e74-e8fe-4343-9a76-7aa38dda0c91 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:35.139933 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0747e74-e8fe-4343-9a76-7aa38dda0c91 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:35.145934 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1202567-e027-43db-89e0-c65e2e14af0c None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:35.169425 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application [None req-c0747e74-e8fe-4343-9a76-7aa38dda0c91 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 16 17:07:35.169425 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:07:35.169425 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:07:35.169425 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:07:35.169425 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:07:35.169425 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:07:35.169425 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:07:35.169425 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:07:35.169425 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:07:35.169425 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:07:35.169425 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:07:35.169425 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:07:35.169425 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 17:07:35.169425 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 17:07:35.169425 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 17:07:35.169425 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 17:07:35.170509 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:07:35.170509 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:07:35.170509 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 17:07:35.170509 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 17:07:35.170509 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 17:07:35.170509 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 17:07:35.170509 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:07:35.170509 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:07:35.170509 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:07:35.170509 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:07:35.170509 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:07:35.170509 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application with Lock( Jun 16 17:07:35.170509 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:07:35.170509 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:07:35.170509 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:07:35.170509 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:07:35.170509 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:07:35.170509 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:07:35.171472 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:07:35.171472 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:07:35.171472 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 17:07:35.171472 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 17:07:35.171472 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 17:07:35.171472 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 17:07:35.171472 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 17:07:35.171472 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 17:07:35.171472 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 16 17:07:35.171472 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Jun 16 17:07:35.179231 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 390/789] 10.222.0.39 () {56 vars in 1117 bytes} [Thu Jun 16 17:07:34 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:07:35.184595 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0747e74-e8fe-4343-9a76-7aa38dda0c91 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:35.186657 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba79c4dc-9ff1-4dd9-8df4-ef9168f7ca09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:35.187494 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba79c4dc-9ff1-4dd9-8df4-ef9168f7ca09 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:35.187788 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba79c4dc-9ff1-4dd9-8df4-ef9168f7ca09 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:35.188078 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba79c4dc-9ff1-4dd9-8df4-ef9168f7ca09 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:35.201270 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba79c4dc-9ff1-4dd9-8df4-ef9168f7ca09 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 17:07:35.209337 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application [None req-ba79c4dc-9ff1-4dd9-8df4-ef9168f7ca09 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 17:07:35.209337 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:07:35.209337 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:07:35.209337 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:07:35.209337 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:07:35.209337 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:07:35.209337 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:07:35.209337 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:07:35.209337 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:07:35.209337 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:07:35.209337 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:07:35.209337 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:07:35.209337 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 17:07:35.209337 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 17:07:35.209337 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 17:07:35.209337 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 17:07:35.211728 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 17:07:35.211728 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 17:07:35.211728 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 17:07:35.211728 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 17:07:35.211728 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:07:35.211728 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:07:35.211728 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:07:35.211728 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:07:35.211728 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:07:35.211728 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:07:35.211728 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:07:35.211728 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application with Lock( Jun 16 17:07:35.211728 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:07:35.211728 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:07:35.211728 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:07:35.211728 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:07:35.213831 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:07:35.213831 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:07:35.213831 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:07:35.213831 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:07:35.213831 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 17:07:35.213831 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 17:07:35.213831 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 17:07:35.213831 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 17:07:35.213831 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 17:07:35.213831 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 17:07:35.213831 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 17:07:35.213831 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Jun 16 17:07:35.221935 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 400/790] 10.222.0.39 () {56 vars in 1096 bytes} [Thu Jun 16 17:07:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:07:35.221935 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba79c4dc-9ff1-4dd9-8df4-ef9168f7ca09 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:35.334185 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0747e74-e8fe-4343-9a76-7aa38dda0c91 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:35.343626 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:35.358183 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba79c4dc-9ff1-4dd9-8df4-ef9168f7ca09 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:35.372392 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6380180-ebb3-474e-80f2-64ae0e031aeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:35.373237 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6380180-ebb3-474e-80f2-64ae0e031aeb None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:35.373630 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6380180-ebb3-474e-80f2-64ae0e031aeb None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:35.374039 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6380180-ebb3-474e-80f2-64ae0e031aeb None admin] PATH_INFO: `/v3/users` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:35.374965 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6380180-ebb3-474e-80f2-64ae0e031aeb None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80873) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:07:35.375373 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6380180-ebb3-474e-80f2-64ae0e031aeb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:35.376895 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6380180-ebb3-474e-80f2-64ae0e031aeb None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:35.400369 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 391/791] 10.222.0.39 () {56 vars in 1149 bytes} [Thu Jun 16 17:07:35 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:07:35.405594 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6380180-ebb3-474e-80f2-64ae0e031aeb None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:35.419551 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b1d744-e7c6-411a-bb68-7bb382eeb64f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:35.420231 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b1d744-e7c6-411a-bb68-7bb382eeb64f None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:35.420522 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b1d744-e7c6-411a-bb68-7bb382eeb64f None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:35.420807 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b1d744-e7c6-411a-bb68-7bb382eeb64f None admin] PATH_INFO: `/v3/roles` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:35.421650 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b1d744-e7c6-411a-bb68-7bb382eeb64f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:07:35.421998 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b1d744-e7c6-411a-bb68-7bb382eeb64f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:35.423376 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b1d744-e7c6-411a-bb68-7bb382eeb64f None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:35.439593 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 401/792] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 16 17:07:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 17:07:35.445552 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b1d744-e7c6-411a-bb68-7bb382eeb64f None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:35.461979 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:35.577934 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6380180-ebb3-474e-80f2-64ae0e031aeb None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:35.619202 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6bd95c-8ca7-461a-aa70-572876a936e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:35.619987 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6bd95c-8ca7-461a-aa70-572876a936e3 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:35.620973 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6bd95c-8ca7-461a-aa70-572876a936e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:35.621270 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6bd95c-8ca7-461a-aa70-572876a936e3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:35.642797 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6bd95c-8ca7-461a-aa70-572876a936e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:35.644426 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6bd95c-8ca7-461a-aa70-572876a936e3 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:35.646877 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b1d744-e7c6-411a-bb68-7bb382eeb64f None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:35.678015 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application [None req-5e6bd95c-8ca7-461a-aa70-572876a936e3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:07:35.678015 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:07:35.678015 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:07:35.678015 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:07:35.678015 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:07:35.678015 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:07:35.678015 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:07:35.678015 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:07:35.678015 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:07:35.678015 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:07:35.678015 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:07:35.678015 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:07:35.678015 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 17:07:35.678015 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 17:07:35.678015 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 17:07:35.678975 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 17:07:35.678975 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:07:35.678975 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:07:35.678975 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:07:35.678975 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:07:35.678975 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:07:35.678975 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:07:35.678975 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:07:35.678975 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application with Lock( Jun 16 17:07:35.678975 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:07:35.678975 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:07:35.678975 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:07:35.678975 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:07:35.678975 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:07:35.678975 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:07:35.678975 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:07:35.678975 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:07:35.679897 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 17:07:35.679897 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 17:07:35.679897 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:07:35.679897 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Jun 16 17:07:35.680446 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 392/793] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 17:07:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 17:07:35.688212 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6bd95c-8ca7-461a-aa70-572876a936e3 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:35.711243 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b25bf41-c6d3-4f24-b585-3ba7b90bc3e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:35.712051 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b25bf41-c6d3-4f24-b585-3ba7b90bc3e2 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:35.712333 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b25bf41-c6d3-4f24-b585-3ba7b90bc3e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:35.712609 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b25bf41-c6d3-4f24-b585-3ba7b90bc3e2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:35.731010 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:35.731311 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b25bf41-c6d3-4f24-b585-3ba7b90bc3e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:35.732782 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b25bf41-c6d3-4f24-b585-3ba7b90bc3e2 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:35.757702 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application [None req-9b25bf41-c6d3-4f24-b585-3ba7b90bc3e2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:07:35.757702 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:07:35.757702 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:07:35.757702 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:07:35.757702 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:07:35.757702 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:07:35.757702 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:07:35.757702 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:07:35.757702 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:07:35.757702 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:07:35.757702 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:07:35.757702 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:07:35.757702 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 17:07:35.757702 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 17:07:35.757702 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 17:07:35.758676 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 17:07:35.758676 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:07:35.758676 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:07:35.758676 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:07:35.758676 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:07:35.758676 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:07:35.758676 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:07:35.758676 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:07:35.758676 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application with Lock( Jun 16 17:07:35.758676 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:07:35.758676 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:07:35.758676 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:07:35.758676 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:07:35.758676 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:07:35.758676 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:07:35.758676 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:07:35.758676 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:07:35.759592 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 17:07:35.759592 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 17:07:35.759592 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:07:35.759592 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Jun 16 17:07:35.769892 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 402/794] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 17:07:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 17:07:35.774500 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b25bf41-c6d3-4f24-b585-3ba7b90bc3e2 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:35.854027 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:35.911877 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b25bf41-c6d3-4f24-b585-3ba7b90bc3e2 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:35.939743 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6bd95c-8ca7-461a-aa70-572876a936e3 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:35.950539 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a3ea67-8ae9-40ab-a9d0-43f07f2efa71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:35.951208 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a3ea67-8ae9-40ab-a9d0-43f07f2efa71 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:35.951493 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a3ea67-8ae9-40ab-a9d0-43f07f2efa71 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:35.951772 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a3ea67-8ae9-40ab-a9d0-43f07f2efa71 None admin] PATH_INFO: `/v3/domains` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:35.952514 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a3ea67-8ae9-40ab-a9d0-43f07f2efa71 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:07:35.952823 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a3ea67-8ae9-40ab-a9d0-43f07f2efa71 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:35.954223 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a3ea67-8ae9-40ab-a9d0-43f07f2efa71 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:35.968279 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 403/795] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 16 17:07:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:07:35.978824 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a3ea67-8ae9-40ab-a9d0-43f07f2efa71 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:36.008532 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec1bcd3-53fc-4be8-90c3-7f1934434ea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:36.009204 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec1bcd3-53fc-4be8-90c3-7f1934434ea7 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:36.009493 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec1bcd3-53fc-4be8-90c3-7f1934434ea7 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:36.009795 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec1bcd3-53fc-4be8-90c3-7f1934434ea7 None admin] PATH_INFO: `/v3/domains` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:36.010532 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec1bcd3-53fc-4be8-90c3-7f1934434ea7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80873) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:07:36.010898 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec1bcd3-53fc-4be8-90c3-7f1934434ea7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:36.012785 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec1bcd3-53fc-4be8-90c3-7f1934434ea7 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:36.034214 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 393/796] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 16 17:07:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:07:36.040098 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec1bcd3-53fc-4be8-90c3-7f1934434ea7 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:36.188479 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:36.193620 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a3ea67-8ae9-40ab-a9d0-43f07f2efa71 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:36.234147 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:36.234770 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec1bcd3-53fc-4be8-90c3-7f1934434ea7 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:36.268337 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2147c63c-2efa-4a64-b9cd-3d9e3b1075a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:36.269160 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2147c63c-2efa-4a64-b9cd-3d9e3b1075a7 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:36.269447 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2147c63c-2efa-4a64-b9cd-3d9e3b1075a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:36.269730 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2147c63c-2efa-4a64-b9cd-3d9e3b1075a7 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:36.281467 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8e8ef3-c3ae-4d8b-8b31-b48b50e9c164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:36.282315 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8e8ef3-c3ae-4d8b-8b31-b48b50e9c164 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:36.282605 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8e8ef3-c3ae-4d8b-8b31-b48b50e9c164 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:36.282889 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8e8ef3-c3ae-4d8b-8b31-b48b50e9c164 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:36.287307 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2147c63c-2efa-4a64-b9cd-3d9e3b1075a7 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:36.288781 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2147c63c-2efa-4a64-b9cd-3d9e3b1075a7 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:36.290397 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8e8ef3-c3ae-4d8b-8b31-b48b50e9c164 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:36.291829 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8e8ef3-c3ae-4d8b-8b31-b48b50e9c164 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:36.306664 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application [None req-6d8e8ef3-c3ae-4d8b-8b31-b48b50e9c164 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 17:07:36.306664 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:07:36.306664 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:07:36.306664 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:07:36.306664 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:07:36.306664 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:07:36.306664 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:07:36.306664 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:07:36.306664 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:07:36.306664 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:07:36.306664 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:07:36.306664 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:07:36.306664 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 17:07:36.306664 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 17:07:36.306664 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 17:07:36.307646 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 17:07:36.307646 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:07:36.307646 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:07:36.307646 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:07:36.307646 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:07:36.307646 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:07:36.307646 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:07:36.307646 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:07:36.307646 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application with Lock( Jun 16 17:07:36.307646 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:07:36.307646 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:07:36.307646 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:07:36.307646 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:07:36.307646 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:07:36.307646 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:07:36.307646 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:07:36.307646 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:07:36.308859 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 17:07:36.308859 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 17:07:36.308859 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 17:07:36.308859 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 17:07:36.308859 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 17:07:36.308859 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 17:07:36.308859 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 17:07:36.308859 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Jun 16 17:07:36.308859 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 394/797] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 16 17:07:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:07:36.313684 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8e8ef3-c3ae-4d8b-8b31-b48b50e9c164 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:36.317094 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application [None req-2147c63c-2efa-4a64-b9cd-3d9e3b1075a7 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 16 17:07:36.317094 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:07:36.317094 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:07:36.317094 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:07:36.317094 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:07:36.317094 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:07:36.317094 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:07:36.317094 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:07:36.317094 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:07:36.317094 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:07:36.317094 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:07:36.317094 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:07:36.317094 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 17:07:36.317094 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 17:07:36.317094 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 17:07:36.317094 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 17:07:36.319229 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:07:36.319229 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:07:36.319229 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 17:07:36.319229 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 17:07:36.319229 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 17:07:36.319229 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 17:07:36.319229 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:07:36.319229 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:07:36.319229 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:07:36.319229 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:07:36.319229 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:07:36.319229 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application with Lock( Jun 16 17:07:36.319229 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:07:36.319229 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:07:36.319229 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:07:36.319229 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:07:36.319229 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:07:36.319229 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:07:36.321512 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:07:36.321512 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:07:36.321512 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 17:07:36.321512 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 17:07:36.321512 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 17:07:36.321512 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 17:07:36.321512 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 17:07:36.321512 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 17:07:36.321512 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 16 17:07:36.321512 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Jun 16 17:07:36.321512 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 404/798] 10.222.0.39 () {56 vars in 1096 bytes} [Thu Jun 16 17:07:35 2022] GET /identity/v3/users/swift => generated 83 bytes in 340 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:07:36.334767 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2147c63c-2efa-4a64-b9cd-3d9e3b1075a7 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:36.426506 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8e8ef3-c3ae-4d8b-8b31-b48b50e9c164 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:36.487829 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a04057-a223-417e-af2b-ba64ab2e4e43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:36.488831 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a04057-a223-417e-af2b-ba64ab2e4e43 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:36.489325 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a04057-a223-417e-af2b-ba64ab2e4e43 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:36.489853 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a04057-a223-417e-af2b-ba64ab2e4e43 None admin] PATH_INFO: `/v3/projects` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:36.490882 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a04057-a223-417e-af2b-ba64ab2e4e43 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80873) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:07:36.491507 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a04057-a223-417e-af2b-ba64ab2e4e43 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:36.493142 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a04057-a223-417e-af2b-ba64ab2e4e43 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:36.502199 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:36.508976 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 395/799] 10.222.0.39 () {56 vars in 1148 bytes} [Thu Jun 16 17:07:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:07:36.515870 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a04057-a223-417e-af2b-ba64ab2e4e43 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:36.542643 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2147c63c-2efa-4a64-b9cd-3d9e3b1075a7 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:36.619049 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b269482-715a-4e81-8343-77e52b8fc861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:36.619778 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b269482-715a-4e81-8343-77e52b8fc861 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:36.620051 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b269482-715a-4e81-8343-77e52b8fc861 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:36.620876 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b269482-715a-4e81-8343-77e52b8fc861 None admin] PATH_INFO: `/v3/users` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:36.622274 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b269482-715a-4e81-8343-77e52b8fc861 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:07:36.622601 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b269482-715a-4e81-8343-77e52b8fc861 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:36.624107 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b269482-715a-4e81-8343-77e52b8fc861 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:36.670982 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 405/800] 10.222.0.39 () {56 vars in 1135 bytes} [Thu Jun 16 17:07:36 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:07:36.678174 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b269482-715a-4e81-8343-77e52b8fc861 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:36.709010 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a04057-a223-417e-af2b-ba64ab2e4e43 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:36.717361 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:36.749562 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e18fbd1-49f0-4b35-a6dd-da044c18e0d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:36.750742 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e18fbd1-49f0-4b35-a6dd-da044c18e0d2 None admin] REQUEST_METHOD: `PUT` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:36.751184 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e18fbd1-49f0-4b35-a6dd-da044c18e0d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:36.751874 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e18fbd1-49f0-4b35-a6dd-da044c18e0d2 None admin] PATH_INFO: `/v3/projects/73015da4de1f48c29f57fff1040d2c10/users/f7f35c1c15a84a92863d4f3f96d76830/roles/a12797d48dac420cb2eaadbe537f60ef` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:36.770033 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e18fbd1-49f0-4b35-a6dd-da044c18e0d2 None admin] RBAC: Authorizing `identity:create_grant(project_id=73015da4de1f48c29f57fff1040d2c10, user_id=f7f35c1c15a84a92863d4f3f96d76830, role_id=a12797d48dac420cb2eaadbe537f60ef)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:36.771494 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e18fbd1-49f0-4b35-a6dd-da044c18e0d2 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:36.794440 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b269482-715a-4e81-8343-77e52b8fc861 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:36.831386 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169d0916-96e1-429e-a788-0808bbdcb40c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:36.832458 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169d0916-96e1-429e-a788-0808bbdcb40c None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:36.832570 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169d0916-96e1-429e-a788-0808bbdcb40c None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:36.832804 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169d0916-96e1-429e-a788-0808bbdcb40c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:36.843809 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169d0916-96e1-429e-a788-0808bbdcb40c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:36.845261 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169d0916-96e1-429e-a788-0808bbdcb40c None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:36.864929 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application [None req-169d0916-96e1-429e-a788-0808bbdcb40c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:07:36.864929 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:07:36.864929 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:07:36.864929 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:07:36.864929 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:07:36.864929 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:07:36.864929 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:07:36.864929 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:07:36.864929 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:07:36.864929 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:07:36.864929 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:07:36.864929 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:07:36.864929 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 17:07:36.864929 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 17:07:36.864929 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 17:07:36.865976 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 17:07:36.865976 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:07:36.865976 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:07:36.865976 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:07:36.865976 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:07:36.865976 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:07:36.865976 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:07:36.865976 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:07:36.865976 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application with Lock( Jun 16 17:07:36.865976 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:07:36.865976 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:07:36.865976 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:07:36.865976 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:07:36.865976 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:07:36.865976 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:07:36.865976 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:07:36.865976 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:07:36.866924 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 17:07:36.866924 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 17:07:36.866924 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:07:36.866924 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Jun 16 17:07:36.867929 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 396/802] 10.222.0.39 () {58 vars in 1439 bytes} [Thu Jun 16 17:07:36 2022] PUT /identity/v3/projects/73015da4de1f48c29f57fff1040d2c10/users/f7f35c1c15a84a92863d4f3f96d76830/roles/a12797d48dac420cb2eaadbe537f60ef => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:07:36.871593 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 406/802] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 17:07:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 17:07:36.872741 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5833955d-70e4-4a3a-82c2-ecb5db6eda37 None None] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:36.873084 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169d0916-96e1-429e-a788-0808bbdcb40c None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:36.873870 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5833955d-70e4-4a3a-82c2-ecb5db6eda37 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:36.874402 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5833955d-70e4-4a3a-82c2-ecb5db6eda37 None None] PATH_INFO: `/` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:36.876878 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 397/803] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 17:07:36 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:07:36.884428 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d03d6ac-f682-4d23-8501-eb3dbf8c64fc None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:36.885253 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d03d6ac-f682-4d23-8501-eb3dbf8c64fc None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:36.885894 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d03d6ac-f682-4d23-8501-eb3dbf8c64fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:36.934887 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-2d03d6ac-f682-4d23-8501-eb3dbf8c64fc None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:07:36.936638 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-2d03d6ac-f682-4d23-8501-eb3dbf8c64fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:07:37.011288 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:37.019299 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:37.023987 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169d0916-96e1-429e-a788-0808bbdcb40c None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:37.049713 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 398/804] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 17:07:36 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 17:07:37.051322 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41375fdf-24f0-416c-b38d-e673aabd2c9c None None] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:37.051704 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41375fdf-24f0-416c-b38d-e673aabd2c9c None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:37.052129 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41375fdf-24f0-416c-b38d-e673aabd2c9c None None] PATH_INFO: `/` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:37.058275 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 399/805] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 17:07:37 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:07:37.059672 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38b708a-4b3c-4149-9706-3d767dd33dc4 None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:37.060058 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38b708a-4b3c-4149-9706-3d767dd33dc4 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:37.060467 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38b708a-4b3c-4149-9706-3d767dd33dc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:37.068654 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45eddf6c-523d-4675-aec1-9d027c64f00c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:37.069342 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eddf6c-523d-4675-aec1-9d027c64f00c None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:37.069633 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eddf6c-523d-4675-aec1-9d027c64f00c None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:37.069946 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eddf6c-523d-4675-aec1-9d027c64f00c None admin] PATH_INFO: `/v3/domains` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:37.070679 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45eddf6c-523d-4675-aec1-9d027c64f00c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:07:37.070995 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45eddf6c-523d-4675-aec1-9d027c64f00c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:37.072380 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45eddf6c-523d-4675-aec1-9d027c64f00c None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:37.081205 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-a38b708a-4b3c-4149-9706-3d767dd33dc4 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:07:37.082705 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-a38b708a-4b3c-4149-9706-3d767dd33dc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:07:37.088795 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 407/806] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 16 17:07:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:07:37.094113 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45eddf6c-523d-4675-aec1-9d027c64f00c None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:37.193454 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 400/807] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 17:07:37 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 17:07:37.194995 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38b708a-4b3c-4149-9706-3d767dd33dc4 None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:37.239060 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45eddf6c-523d-4675-aec1-9d027c64f00c None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:37.276257 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b9cdf6-049a-4da5-9d8f-ace7c38884bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:37.277313 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b9cdf6-049a-4da5-9d8f-ace7c38884bf None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:37.277654 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b9cdf6-049a-4da5-9d8f-ace7c38884bf None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:37.278089 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b9cdf6-049a-4da5-9d8f-ace7c38884bf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:37.291171 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b9cdf6-049a-4da5-9d8f-ace7c38884bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 17:07:37.299928 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application [None req-22b9cdf6-049a-4da5-9d8f-ace7c38884bf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 17:07:37.299928 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:07:37.299928 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:07:37.299928 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:07:37.299928 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:07:37.299928 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:07:37.299928 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:07:37.299928 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:07:37.299928 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:07:37.299928 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:07:37.299928 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:07:37.299928 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:07:37.299928 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 17:07:37.299928 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 17:07:37.299928 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 17:07:37.299928 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 17:07:37.301191 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 17:07:37.301191 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 17:07:37.301191 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 17:07:37.301191 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 17:07:37.301191 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:07:37.301191 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:07:37.301191 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:07:37.301191 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:07:37.301191 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:07:37.301191 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:07:37.301191 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:07:37.301191 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application with Lock( Jun 16 17:07:37.301191 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:07:37.301191 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:07:37.301191 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:07:37.301191 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:07:37.302319 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:07:37.302319 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:07:37.302319 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:07:37.302319 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:07:37.302319 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 17:07:37.302319 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 17:07:37.302319 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 17:07:37.302319 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 17:07:37.302319 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 17:07:37.302319 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 17:07:37.302319 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 17:07:37.302319 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Jun 16 17:07:37.302319 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 408/808] 10.222.0.39 () {56 vars in 1096 bytes} [Thu Jun 16 17:07:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:07:37.306119 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b9cdf6-049a-4da5-9d8f-ace7c38884bf None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:37.323184 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:37.330614 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38b708a-4b3c-4149-9706-3d767dd33dc4 None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:37.342181 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:37.374817 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2368de5e-3319-46b0-9210-40a551787f0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:37.375767 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2368de5e-3319-46b0-9210-40a551787f0c None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:37.376055 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2368de5e-3319-46b0-9210-40a551787f0c None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:37.376328 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2368de5e-3319-46b0-9210-40a551787f0c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:37.384068 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2368de5e-3319-46b0-9210-40a551787f0c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:37.385715 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2368de5e-3319-46b0-9210-40a551787f0c None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:37.403568 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application [None req-2368de5e-3319-46b0-9210-40a551787f0c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 17:07:37.403568 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:07:37.403568 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:07:37.403568 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:07:37.403568 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:07:37.403568 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:07:37.403568 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:07:37.403568 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:07:37.403568 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:07:37.403568 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:07:37.403568 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:07:37.403568 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:07:37.403568 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 17:07:37.403568 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 17:07:37.403568 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 17:07:37.404729 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 17:07:37.404729 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:07:37.404729 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:07:37.404729 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:07:37.404729 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:07:37.404729 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:07:37.404729 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:07:37.404729 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:07:37.404729 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application with Lock( Jun 16 17:07:37.404729 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:07:37.404729 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:07:37.404729 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:07:37.404729 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:07:37.404729 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:07:37.404729 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:07:37.404729 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:07:37.404729 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:07:37.406032 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 17:07:37.406032 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 17:07:37.406032 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 17:07:37.406032 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 17:07:37.406032 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 17:07:37.406032 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 17:07:37.406032 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 17:07:37.406032 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Jun 16 17:07:37.409666 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 401/809] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 16 17:07:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:07:37.410633 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2368de5e-3319-46b0-9210-40a551787f0c None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:37.442855 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b9cdf6-049a-4da5-9d8f-ace7c38884bf None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:37.498586 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccf842f-82fc-437b-80b3-29e0d35f9c1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:37.499527 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccf842f-82fc-437b-80b3-29e0d35f9c1e None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:37.499920 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccf842f-82fc-437b-80b3-29e0d35f9c1e None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:37.500304 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccf842f-82fc-437b-80b3-29e0d35f9c1e None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:37.501737 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccf842f-82fc-437b-80b3-29e0d35f9c1e None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:37.503775 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccf842f-82fc-437b-80b3-29e0d35f9c1e None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:37.522019 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application [None req-6ccf842f-82fc-437b-80b3-29e0d35f9c1e None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 16 17:07:37.522019 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:07:37.522019 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 17:07:37.522019 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 17:07:37.522019 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 17:07:37.522019 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 17:07:37.522019 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 17:07:37.522019 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 17:07:37.522019 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 16 17:07:37.522019 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Jun 16 17:07:37.522019 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 17:07:37.522019 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Jun 16 17:07:37.522019 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:07:37.522019 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:07:37.522019 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:07:37.522019 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:07:37.523086 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:07:37.523086 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:07:37.523086 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:07:37.523086 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:07:37.523086 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:07:37.523086 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:07:37.523086 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:07:37.523086 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 17:07:37.523086 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 17:07:37.523086 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 17:07:37.523086 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 17:07:37.523086 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:07:37.523086 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:07:37.523086 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:07:37.523086 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:07:37.523086 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:07:37.524118 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:07:37.524118 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:07:37.524118 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application with Lock( Jun 16 17:07:37.524118 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:07:37.524118 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:07:37.524118 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:07:37.524118 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:07:37.524118 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:07:37.524118 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:07:37.524118 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:07:37.524118 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:07:37.524118 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 17:07:37.524118 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 17:07:37.524118 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 16 17:07:37.524118 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Jun 16 17:07:37.524118 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 409/810] 10.222.0.39 () {56 vars in 1129 bytes} [Thu Jun 16 17:07:37 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:07:37.525457 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccf842f-82fc-437b-80b3-29e0d35f9c1e None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:37.533350 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2368de5e-3319-46b0-9210-40a551787f0c None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:37.576778 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952737a1-8ef3-41fb-93ef-00644b6b6141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:37.577520 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952737a1-8ef3-41fb-93ef-00644b6b6141 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:37.577839 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952737a1-8ef3-41fb-93ef-00644b6b6141 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:37.578178 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952737a1-8ef3-41fb-93ef-00644b6b6141 None admin] PATH_INFO: `/v3/roles` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:37.578943 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952737a1-8ef3-41fb-93ef-00644b6b6141 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80873) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:07:37.579259 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952737a1-8ef3-41fb-93ef-00644b6b6141 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:37.580678 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952737a1-8ef3-41fb-93ef-00644b6b6141 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:37.594135 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 402/811] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 16 17:07:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:07:37.595044 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952737a1-8ef3-41fb-93ef-00644b6b6141 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:37.616268 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:37.638739 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:37.655624 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccf842f-82fc-437b-80b3-29e0d35f9c1e None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:37.694852 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e44234b-f633-4613-9705-1766f6274ca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:37.695940 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e44234b-f633-4613-9705-1766f6274ca1 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:37.696490 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e44234b-f633-4613-9705-1766f6274ca1 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:37.697119 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e44234b-f633-4613-9705-1766f6274ca1 None admin] PATH_INFO: `/v3/projects` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:37.698270 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e44234b-f633-4613-9705-1766f6274ca1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:07:37.699349 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e44234b-f633-4613-9705-1766f6274ca1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:37.701243 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e44234b-f633-4613-9705-1766f6274ca1 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:37.718763 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 410/812] 10.222.0.39 () {56 vars in 1148 bytes} [Thu Jun 16 17:07:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:07:37.720277 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e44234b-f633-4613-9705-1766f6274ca1 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:37.732994 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952737a1-8ef3-41fb-93ef-00644b6b6141 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:37.776086 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febc995a-d72b-4f3a-9df1-c977ac8cadb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:37.777248 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febc995a-d72b-4f3a-9df1-c977ac8cadb4 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:37.777536 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febc995a-d72b-4f3a-9df1-c977ac8cadb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:37.777863 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febc995a-d72b-4f3a-9df1-c977ac8cadb4 None admin] PATH_INFO: `/v3/services` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:37.778763 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febc995a-d72b-4f3a-9df1-c977ac8cadb4 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80873) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:07:37.779409 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febc995a-d72b-4f3a-9df1-c977ac8cadb4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:37.780793 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febc995a-d72b-4f3a-9df1-c977ac8cadb4 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:37.791483 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 403/813] 10.222.0.39 () {56 vars in 1124 bytes} [Thu Jun 16 17:07:37 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:07:37.791483 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febc995a-d72b-4f3a-9df1-c977ac8cadb4 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:37.833787 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e44234b-f633-4613-9705-1766f6274ca1 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:37.866037 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:37.872879 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b591da7-3878-4691-a5af-1d9a2403430c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:37.873491 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b591da7-3878-4691-a5af-1d9a2403430c None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:37.873918 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b591da7-3878-4691-a5af-1d9a2403430c None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:37.874203 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b591da7-3878-4691-a5af-1d9a2403430c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:37.887024 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b591da7-3878-4691-a5af-1d9a2403430c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:37.888571 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b591da7-3878-4691-a5af-1d9a2403430c None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:37.894627 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:37.902468 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febc995a-d72b-4f3a-9df1-c977ac8cadb4 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:37.908921 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application [None req-7b591da7-3878-4691-a5af-1d9a2403430c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:07:37.908921 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:07:37.908921 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:07:37.908921 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:07:37.908921 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:07:37.908921 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:07:37.908921 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:07:37.908921 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:07:37.908921 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:07:37.908921 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:07:37.908921 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:07:37.908921 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:07:37.908921 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 17:07:37.908921 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 17:07:37.908921 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 17:07:37.910017 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 17:07:37.910017 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:07:37.910017 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:07:37.910017 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:07:37.910017 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:07:37.910017 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:07:37.910017 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:07:37.910017 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:07:37.910017 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application with Lock( Jun 16 17:07:37.910017 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:07:37.910017 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:07:37.910017 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:07:37.910017 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:07:37.910017 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:07:37.910017 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:07:37.910017 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:07:37.910017 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:07:37.911132 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 17:07:37.911132 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 17:07:37.911132 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:07:37.911132 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Jun 16 17:07:37.915101 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 411/814] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 17:07:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:07:37.916473 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbec5734-afc3-4704-bbee-2c3355d6c954 None None] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:37.918277 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbec5734-afc3-4704-bbee-2c3355d6c954 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:37.918277 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbec5734-afc3-4704-bbee-2c3355d6c954 None None] PATH_INFO: `/` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:37.919279 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 412/815] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 17:07:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:07:37.919996 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbec5734-afc3-4704-bbee-2c3355d6c954 None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:37.944517 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b346a2-28e6-4cba-8db1-f6d023a4a333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:37.945742 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b346a2-28e6-4cba-8db1-f6d023a4a333 None admin] REQUEST_METHOD: `PUT` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:37.946259 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b346a2-28e6-4cba-8db1-f6d023a4a333 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:37.946858 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b346a2-28e6-4cba-8db1-f6d023a4a333 None admin] PATH_INFO: `/v3/projects/73015da4de1f48c29f57fff1040d2c10/users/bbec2dfe63764ed88a23e172ead0afa4/roles/dba744f8ab2a4c45b9d3212f8d203aba` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:37.948642 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b346a2-28e6-4cba-8db1-f6d023a4a333 None admin] RBAC: Authorizing `identity:create_grant(project_id=73015da4de1f48c29f57fff1040d2c10, user_id=bbec2dfe63764ed88a23e172ead0afa4, role_id=dba744f8ab2a4c45b9d3212f8d203aba)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:37.950176 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b346a2-28e6-4cba-8db1-f6d023a4a333 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:38.033793 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 404/816] 10.222.0.39 () {58 vars in 1439 bytes} [Thu Jun 16 17:07:37 2022] PUT /identity/v3/projects/73015da4de1f48c29f57fff1040d2c10/users/bbec2dfe63764ed88a23e172ead0afa4/roles/dba744f8ab2a4c45b9d3212f8d203aba => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:07:38.033793 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b346a2-28e6-4cba-8db1-f6d023a4a333 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:38.040718 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbec5734-afc3-4704-bbee-2c3355d6c954 None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:38.084957 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80587bde-c2ab-4be9-8606-788c95c605f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:38.085573 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80587bde-c2ab-4be9-8606-788c95c605f2 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:38.085894 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80587bde-c2ab-4be9-8606-788c95c605f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:38.086181 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80587bde-c2ab-4be9-8606-788c95c605f2 None admin] PATH_INFO: `/v3/services` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:38.087109 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80587bde-c2ab-4be9-8606-788c95c605f2 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:07:38.087480 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80587bde-c2ab-4be9-8606-788c95c605f2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:38.089071 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80587bde-c2ab-4be9-8606-788c95c605f2 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:38.101495 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 413/817] 10.222.0.39 () {56 vars in 1124 bytes} [Thu Jun 16 17:07:37 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:07:38.103232 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a4eb9c-7bc7-43ab-b9a6-d5a6955724bb None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:38.103656 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a4eb9c-7bc7-43ab-b9a6-d5a6955724bb None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:38.103953 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a4eb9c-7bc7-43ab-b9a6-d5a6955724bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:38.123935 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-f1a4eb9c-7bc7-43ab-b9a6-d5a6955724bb None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:07:38.125241 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-f1a4eb9c-7bc7-43ab-b9a6-d5a6955724bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:07:38.174802 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b346a2-28e6-4cba-8db1-f6d023a4a333 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:38.183175 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:38.215507 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 414/818] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 17:07:38 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 17:07:38.217788 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a4eb9c-7bc7-43ab-b9a6-d5a6955724bb None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:38.231074 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5a17fd-0f68-4faa-b561-9834d35218e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:38.232103 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5a17fd-0f68-4faa-b561-9834d35218e9 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:38.232443 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5a17fd-0f68-4faa-b561-9834d35218e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:38.232737 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5a17fd-0f68-4faa-b561-9834d35218e9 None admin] PATH_INFO: `/v3/domains` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:38.233644 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5a17fd-0f68-4faa-b561-9834d35218e9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80873) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:07:38.233990 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5a17fd-0f68-4faa-b561-9834d35218e9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:38.236098 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5a17fd-0f68-4faa-b561-9834d35218e9 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:38.254105 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 405/819] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 16 17:07:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:07:38.254857 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5a17fd-0f68-4faa-b561-9834d35218e9 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:38.276713 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:38.352003 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a4eb9c-7bc7-43ab-b9a6-d5a6955724bb None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:38.391789 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f81ec3f-a1f4-4e59-9004-9273afeef136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:38.392526 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f81ec3f-a1f4-4e59-9004-9273afeef136 None admin] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:38.392910 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f81ec3f-a1f4-4e59-9004-9273afeef136 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:38.393311 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f81ec3f-a1f4-4e59-9004-9273afeef136 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:38.394480 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f81ec3f-a1f4-4e59-9004-9273afeef136 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:38.395867 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f81ec3f-a1f4-4e59-9004-9273afeef136 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:38.408996 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5a17fd-0f68-4faa-b561-9834d35218e9 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:38.568999 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 415/820] 10.222.0.39 () {60 vars in 1144 bytes} [Thu Jun 16 17:07:38 2022] POST /identity/v3/endpoints => generated 346 bytes in 353 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:07:38.569863 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f81ec3f-a1f4-4e59-9004-9273afeef136 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:38.578887 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebf1109-2f59-41d1-b87d-c727ed87eb17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:38.579721 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebf1109-2f59-41d1-b87d-c727ed87eb17 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:38.580012 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebf1109-2f59-41d1-b87d-c727ed87eb17 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:38.580352 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebf1109-2f59-41d1-b87d-c727ed87eb17 None admin] PATH_INFO: `/v3/services/network` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:38.581924 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebf1109-2f59-41d1-b87d-c727ed87eb17 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:38.583461 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebf1109-2f59-41d1-b87d-c727ed87eb17 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:38.601389 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application [None req-6ebf1109-2f59-41d1-b87d-c727ed87eb17 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 16 17:07:38.601389 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:07:38.601389 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 17:07:38.601389 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 17:07:38.601389 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 17:07:38.601389 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 17:07:38.601389 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 17:07:38.601389 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 17:07:38.601389 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 16 17:07:38.601389 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Jun 16 17:07:38.601389 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 17:07:38.601389 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Jun 16 17:07:38.601389 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:07:38.601389 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:07:38.601389 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:07:38.601389 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:07:38.601389 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:07:38.602650 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:07:38.602650 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:07:38.602650 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:07:38.602650 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:07:38.602650 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:07:38.602650 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:07:38.602650 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 17:07:38.602650 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 17:07:38.602650 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 17:07:38.602650 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 17:07:38.602650 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:07:38.602650 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:07:38.602650 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:07:38.602650 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:07:38.602650 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:07:38.602650 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:07:38.603532 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:07:38.603532 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application with Lock( Jun 16 17:07:38.603532 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:07:38.603532 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:07:38.603532 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:07:38.603532 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:07:38.603532 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:07:38.603532 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:07:38.603532 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:07:38.603532 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:07:38.603532 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 17:07:38.603532 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 17:07:38.603532 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 16 17:07:38.603532 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Jun 16 17:07:38.604326 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 406/821] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 16 17:07:38 2022] GET /identity/v3/services/network => generated 88 bytes in 349 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:07:38.610166 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebf1109-2f59-41d1-b87d-c727ed87eb17 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:38.635165 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:38.781447 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:38.786343 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f81ec3f-a1f4-4e59-9004-9273afeef136 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:38.813025 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebf1109-2f59-41d1-b87d-c727ed87eb17 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:38.833347 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3589929f-d8ce-4e84-9a3e-13a3535f51e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:38.834540 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3589929f-d8ce-4e84-9a3e-13a3535f51e0 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:38.835470 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3589929f-d8ce-4e84-9a3e-13a3535f51e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:38.836017 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3589929f-d8ce-4e84-9a3e-13a3535f51e0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:38.847538 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3589929f-d8ce-4e84-9a3e-13a3535f51e0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:38.850385 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3589929f-d8ce-4e84-9a3e-13a3535f51e0 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:38.854324 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd8d26f-088d-4609-ba9c-fae778f620da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:38.855711 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd8d26f-088d-4609-ba9c-fae778f620da None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:38.856059 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd8d26f-088d-4609-ba9c-fae778f620da None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:38.856446 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd8d26f-088d-4609-ba9c-fae778f620da None admin] PATH_INFO: `/v3/services` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:38.857234 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd8d26f-088d-4609-ba9c-fae778f620da None admin] RBAC: Adding query filter params (name=network) {{(pid=80873) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:07:38.857651 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd8d26f-088d-4609-ba9c-fae778f620da None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:38.859154 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd8d26f-088d-4609-ba9c-fae778f620da None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:38.868020 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 407/822] 10.222.0.39 () {56 vars in 1112 bytes} [Thu Jun 16 17:07:38 2022] GET /identity/v3/services?name=network => generated 124 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 17:07:38.873828 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application [None req-3589929f-d8ce-4e84-9a3e-13a3535f51e0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 16 17:07:38.873828 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:07:38.873828 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:07:38.873828 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:07:38.873828 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:07:38.873828 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:07:38.873828 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:07:38.873828 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:07:38.873828 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:07:38.873828 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:07:38.873828 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:07:38.873828 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:07:38.873828 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 17:07:38.873828 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 17:07:38.873828 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 17:07:38.873828 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 17:07:38.874832 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:07:38.874832 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:07:38.874832 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 17:07:38.874832 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 17:07:38.874832 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 17:07:38.874832 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 17:07:38.874832 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:07:38.874832 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:07:38.874832 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:07:38.874832 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:07:38.874832 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:07:38.874832 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application with Lock( Jun 16 17:07:38.874832 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:07:38.874832 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:07:38.874832 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:07:38.874832 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:07:38.874832 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:07:38.874832 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:07:38.875802 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:07:38.875802 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:07:38.875802 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 17:07:38.875802 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 17:07:38.875802 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 17:07:38.875802 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 17:07:38.875802 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 17:07:38.875802 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 17:07:38.875802 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 16 17:07:38.875802 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Jun 16 17:07:38.875802 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 416/823] 10.222.0.39 () {56 vars in 1093 bytes} [Thu Jun 16 17:07:38 2022] GET /identity/v3/users/nova => generated 82 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:07:38.878734 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3589929f-d8ce-4e84-9a3e-13a3535f51e0 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:38.878863 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd8d26f-088d-4609-ba9c-fae778f620da None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:39.009968 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:39.019048 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3589929f-d8ce-4e84-9a3e-13a3535f51e0 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:39.026862 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd8d26f-088d-4609-ba9c-fae778f620da None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:39.075319 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a72a476-54f8-4718-965c-4c02f68f4c94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:39.076282 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a72a476-54f8-4718-965c-4c02f68f4c94 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:39.077004 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a72a476-54f8-4718-965c-4c02f68f4c94 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:39.077998 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a72a476-54f8-4718-965c-4c02f68f4c94 None admin] PATH_INFO: `/v3/users` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:39.078328 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa41a57-75c1-4837-be0f-b2c19cd8173b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:39.079109 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa41a57-75c1-4837-be0f-b2c19cd8173b None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:39.079572 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa41a57-75c1-4837-be0f-b2c19cd8173b None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:39.079929 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a72a476-54f8-4718-965c-4c02f68f4c94 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80873) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:07:39.080085 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa41a57-75c1-4837-be0f-b2c19cd8173b None admin] PATH_INFO: `/v3/services` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:39.080532 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a72a476-54f8-4718-965c-4c02f68f4c94 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:39.081023 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa41a57-75c1-4837-be0f-b2c19cd8173b None admin] RBAC: Adding query filter params (type=network) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:07:39.081441 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa41a57-75c1-4837-be0f-b2c19cd8173b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:39.082467 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a72a476-54f8-4718-965c-4c02f68f4c94 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:39.083051 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa41a57-75c1-4837-be0f-b2c19cd8173b None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:39.092521 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:39.092786 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 417/824] 10.222.0.39 () {56 vars in 1112 bytes} [Thu Jun 16 17:07:38 2022] GET /identity/v3/services?type=network => generated 350 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:07:39.095523 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa41a57-75c1-4837-be0f-b2c19cd8173b None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:39.114875 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 408/825] 10.222.0.39 () {56 vars in 1133 bytes} [Thu Jun 16 17:07:38 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:07:39.114875 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a72a476-54f8-4718-965c-4c02f68f4c94 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:39.236240 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a72a476-54f8-4718-965c-4c02f68f4c94 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:39.277687 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd03a1b-d531-4f3b-bd36-801d61e86fe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:39.278657 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd03a1b-d531-4f3b-bd36-801d61e86fe8 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:39.279093 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd03a1b-d531-4f3b-bd36-801d61e86fe8 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:39.279520 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd03a1b-d531-4f3b-bd36-801d61e86fe8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:39.359298 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:39.374472 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd03a1b-d531-4f3b-bd36-801d61e86fe8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:39.374472 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd03a1b-d531-4f3b-bd36-801d61e86fe8 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:39.445304 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa41a57-75c1-4837-be0f-b2c19cd8173b None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:39.481450 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15447ed8-8a19-415a-8933-3ab0d6e64d77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:39.482177 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15447ed8-8a19-415a-8933-3ab0d6e64d77 None admin] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:39.482468 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15447ed8-8a19-415a-8933-3ab0d6e64d77 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:39.482752 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15447ed8-8a19-415a-8933-3ab0d6e64d77 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:39.483563 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15447ed8-8a19-415a-8933-3ab0d6e64d77 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:39.484957 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15447ed8-8a19-415a-8933-3ab0d6e64d77 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:39.493851 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 409/826] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 16 17:07:39 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 16 17:07:39.495842 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1f5261-b099-4f35-810e-c6fd129e452a None None] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:39.496136 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1f5261-b099-4f35-810e-c6fd129e452a None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:39.496418 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1f5261-b099-4f35-810e-c6fd129e452a None None] PATH_INFO: `/` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:39.497795 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 410/827] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 17:07:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:07:39.499700 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1f5261-b099-4f35-810e-c6fd129e452a None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:39.608752 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:39.610061 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 418/828] 10.222.0.39 () {60 vars in 1144 bytes} [Thu Jun 16 17:07:39 2022] POST /identity/v3/endpoints => generated 327 bytes in 515 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:07:39.612466 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01febc1c-b216-414b-a345-7eed3a18bcf2 None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:39.613100 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01febc1c-b216-414b-a345-7eed3a18bcf2 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:39.613652 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01febc1c-b216-414b-a345-7eed3a18bcf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:39.617331 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1f5261-b099-4f35-810e-c6fd129e452a None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:39.637210 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-01febc1c-b216-414b-a345-7eed3a18bcf2 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:07:39.639505 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-01febc1c-b216-414b-a345-7eed3a18bcf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:07:39.674189 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:39.685214 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab94e28-4e83-4aa8-b654-a34146f04316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:39.686070 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab94e28-4e83-4aa8-b654-a34146f04316 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:39.687291 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab94e28-4e83-4aa8-b654-a34146f04316 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:39.687291 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab94e28-4e83-4aa8-b654-a34146f04316 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:39.710301 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab94e28-4e83-4aa8-b654-a34146f04316 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:39.711858 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab94e28-4e83-4aa8-b654-a34146f04316 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:39.727491 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 419/829] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 17:07:39 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 17:07:39.751662 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application [None req-dab94e28-4e83-4aa8-b654-a34146f04316 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:07:39.751662 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:07:39.751662 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:07:39.751662 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:07:39.751662 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:07:39.751662 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:07:39.751662 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:07:39.751662 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:07:39.751662 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:07:39.751662 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:07:39.751662 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:07:39.751662 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:07:39.751662 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 17:07:39.751662 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 17:07:39.751662 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 17:07:39.752672 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 17:07:39.752672 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:07:39.752672 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:07:39.752672 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:07:39.752672 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:07:39.752672 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:07:39.752672 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:07:39.752672 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:07:39.752672 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application with Lock( Jun 16 17:07:39.752672 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:07:39.752672 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:07:39.752672 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:07:39.752672 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:07:39.752672 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:07:39.752672 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:07:39.752672 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:07:39.752672 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:07:39.753575 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 17:07:39.753575 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 17:07:39.753575 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:07:39.753575 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Jun 16 17:07:39.755690 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01febc1c-b216-414b-a345-7eed3a18bcf2 None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:39.756872 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 411/830] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 17:07:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 17:07:39.761521 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab94e28-4e83-4aa8-b654-a34146f04316 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:39.915602 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab94e28-4e83-4aa8-b654-a34146f04316 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:39.921106 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01febc1c-b216-414b-a345-7eed3a18bcf2 None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:39.958570 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0a1f46-15f0-4cca-a89f-b5e0a1ba3b3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:39.959253 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0a1f46-15f0-4cca-a89f-b5e0a1ba3b3d None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:39.959533 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0a1f46-15f0-4cca-a89f-b5e0a1ba3b3d None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:39.959810 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0a1f46-15f0-4cca-a89f-b5e0a1ba3b3d None admin] PATH_INFO: `/v3/domains` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:39.960855 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0a1f46-15f0-4cca-a89f-b5e0a1ba3b3d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80873) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:07:39.961163 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0a1f46-15f0-4cca-a89f-b5e0a1ba3b3d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:39.962971 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0a1f46-15f0-4cca-a89f-b5e0a1ba3b3d None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:39.966564 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed37cd1-abc7-435b-9b82-7cf0ce64eee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:39.967632 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed37cd1-abc7-435b-9b82-7cf0ce64eee0 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:39.968134 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed37cd1-abc7-435b-9b82-7cf0ce64eee0 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:39.968618 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed37cd1-abc7-435b-9b82-7cf0ce64eee0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:39.981808 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 412/831] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 16 17:07:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:07:39.985174 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0a1f46-15f0-4cca-a89f-b5e0a1ba3b3d None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:39.986736 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed37cd1-abc7-435b-9b82-7cf0ce64eee0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 17:07:39.990654 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:39.997822 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application [None req-bed37cd1-abc7-435b-9b82-7cf0ce64eee0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 17:07:39.997822 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:07:39.997822 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:07:39.997822 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:07:39.997822 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:07:39.997822 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:07:39.997822 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:07:39.997822 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:07:39.997822 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:07:39.997822 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:07:39.997822 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:07:39.997822 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:07:39.997822 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 17:07:39.997822 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 17:07:39.997822 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 17:07:39.997822 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 17:07:39.998873 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 17:07:39.998873 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 17:07:39.998873 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 17:07:39.998873 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 17:07:39.998873 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:07:39.998873 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:07:39.998873 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:07:39.998873 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:07:39.998873 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:07:39.998873 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:07:39.998873 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:07:39.998873 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application with Lock( Jun 16 17:07:39.998873 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:07:39.998873 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:07:39.998873 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:07:39.998873 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:07:39.999721 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:07:39.999721 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:07:39.999721 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:07:39.999721 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:07:39.999721 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 17:07:39.999721 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 17:07:39.999721 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 17:07:39.999721 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 17:07:39.999721 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 17:07:39.999721 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 17:07:39.999721 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 17:07:39.999721 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Jun 16 17:07:39.999721 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 420/832] 10.222.0.39 () {56 vars in 1102 bytes} [Thu Jun 16 17:07:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:07:40.005399 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed37cd1-abc7-435b-9b82-7cf0ce64eee0 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:40.012740 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:40.127197 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0a1f46-15f0-4cca-a89f-b5e0a1ba3b3d None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:40.147825 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed37cd1-abc7-435b-9b82-7cf0ce64eee0 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:40.165046 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c86b22-b362-4362-979e-c4c7d7965f18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:40.166232 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c86b22-b362-4362-979e-c4c7d7965f18 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:40.166719 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c86b22-b362-4362-979e-c4c7d7965f18 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:40.167811 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c86b22-b362-4362-979e-c4c7d7965f18 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:40.179398 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c86b22-b362-4362-979e-c4c7d7965f18 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:40.181189 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c86b22-b362-4362-979e-c4c7d7965f18 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:40.198077 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba35525-335e-4fd6-93d6-cb7499e43514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:40.198762 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba35525-335e-4fd6-93d6-cb7499e43514 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:40.199050 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba35525-335e-4fd6-93d6-cb7499e43514 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:40.199334 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba35525-335e-4fd6-93d6-cb7499e43514 None admin] PATH_INFO: `/v3/roles` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:40.199999 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application [None req-75c86b22-b362-4362-979e-c4c7d7965f18 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 17:07:40.199999 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:07:40.199999 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:07:40.199999 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:07:40.199999 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:07:40.199999 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:07:40.199999 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:07:40.199999 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:07:40.199999 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:07:40.199999 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:07:40.199999 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:07:40.199999 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:07:40.199999 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 17:07:40.199999 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 17:07:40.199999 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 17:07:40.200864 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 17:07:40.200864 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:07:40.200864 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:07:40.200864 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:07:40.200864 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:07:40.200864 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:07:40.200864 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:07:40.200864 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:07:40.200864 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application with Lock( Jun 16 17:07:40.200864 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:07:40.200864 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:07:40.200864 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:07:40.200864 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:07:40.200864 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:07:40.200864 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:07:40.200864 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:07:40.200864 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:07:40.201778 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 17:07:40.201778 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 17:07:40.201778 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 17:07:40.201778 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 17:07:40.201778 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 17:07:40.201778 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 17:07:40.201778 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 17:07:40.201778 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Jun 16 17:07:40.202206 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba35525-335e-4fd6-93d6-cb7499e43514 None admin] RBAC: Adding query filter params (name=service) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:07:40.202206 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba35525-335e-4fd6-93d6-cb7499e43514 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:40.202206 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba35525-335e-4fd6-93d6-cb7499e43514 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:40.204474 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 413/833] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 16 17:07:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:07:40.214226 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c86b22-b362-4362-979e-c4c7d7965f18 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:40.214426 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 421/834] 10.222.0.39 () {56 vars in 1103 bytes} [Thu Jun 16 17:07:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 17:07:40.218567 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba35525-335e-4fd6-93d6-cb7499e43514 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:40.295429 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:40.298986 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:40.332545 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba35525-335e-4fd6-93d6-cb7499e43514 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:40.349527 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c86b22-b362-4362-979e-c4c7d7965f18 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:40.371276 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584a7f0d-34e1-4a37-afda-fd96e59ca170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:40.372280 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584a7f0d-34e1-4a37-afda-fd96e59ca170 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:40.372613 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584a7f0d-34e1-4a37-afda-fd96e59ca170 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:40.372968 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584a7f0d-34e1-4a37-afda-fd96e59ca170 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:40.385523 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584a7f0d-34e1-4a37-afda-fd96e59ca170 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:40.387231 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584a7f0d-34e1-4a37-afda-fd96e59ca170 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:40.393445 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6d4b3c-03ad-48a1-b6a0-e21fd95ff320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:40.394450 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6d4b3c-03ad-48a1-b6a0-e21fd95ff320 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:40.394882 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6d4b3c-03ad-48a1-b6a0-e21fd95ff320 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:40.395309 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6d4b3c-03ad-48a1-b6a0-e21fd95ff320 None admin] PATH_INFO: `/v3/projects` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:40.397081 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6d4b3c-03ad-48a1-b6a0-e21fd95ff320 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80873) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:07:40.397605 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6d4b3c-03ad-48a1-b6a0-e21fd95ff320 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:40.400262 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6d4b3c-03ad-48a1-b6a0-e21fd95ff320 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:40.410025 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application [None req-584a7f0d-34e1-4a37-afda-fd96e59ca170 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:07:40.410025 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:07:40.410025 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:07:40.410025 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:07:40.410025 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:07:40.410025 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:07:40.410025 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:07:40.410025 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:07:40.410025 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:07:40.410025 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:07:40.410025 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:07:40.410025 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:07:40.410025 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 17:07:40.410025 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 17:07:40.410025 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 17:07:40.411019 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 17:07:40.411019 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:07:40.411019 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:07:40.411019 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:07:40.411019 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:07:40.411019 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:07:40.411019 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:07:40.411019 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:07:40.411019 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application with Lock( Jun 16 17:07:40.411019 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:07:40.411019 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:07:40.411019 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:07:40.411019 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:07:40.411019 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:07:40.411019 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:07:40.411019 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:07:40.411019 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:07:40.411910 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 17:07:40.411910 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 17:07:40.411910 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:07:40.411910 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Jun 16 17:07:40.417697 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 422/835] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 17:07:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:07:40.420012 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584a7f0d-34e1-4a37-afda-fd96e59ca170 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:40.422614 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 414/836] 10.222.0.39 () {56 vars in 1148 bytes} [Thu Jun 16 17:07:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:07:40.428883 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6d4b3c-03ad-48a1-b6a0-e21fd95ff320 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:40.546132 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6d4b3c-03ad-48a1-b6a0-e21fd95ff320 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:40.546333 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584a7f0d-34e1-4a37-afda-fd96e59ca170 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:40.566196 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:40.570583 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:40.580995 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9edbe95-f742-4433-a755-8ad2abbb391b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:40.584135 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9edbe95-f742-4433-a755-8ad2abbb391b None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:40.584135 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9edbe95-f742-4433-a755-8ad2abbb391b None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:40.584135 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9edbe95-f742-4433-a755-8ad2abbb391b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:40.584135 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9edbe95-f742-4433-a755-8ad2abbb391b None admin] RBAC: Adding query filter params (role.id=dba744f8ab2a4c45b9d3212f8d203aba, scope.project.id=73015da4de1f48c29f57fff1040d2c10, user.id=3d381bb41dea4f1e90c3cf3815ac88dc) {{(pid=80873) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:07:40.584487 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c68593-46a5-4109-86c2-b9c416e57b24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:40.584574 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9edbe95-f742-4433-a755-8ad2abbb391b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:40.584645 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c68593-46a5-4109-86c2-b9c416e57b24 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:40.584645 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c68593-46a5-4109-86c2-b9c416e57b24 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:40.584645 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c68593-46a5-4109-86c2-b9c416e57b24 None admin] PATH_INFO: `/v3/domains` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:40.584837 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9edbe95-f742-4433-a755-8ad2abbb391b None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:40.585164 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c68593-46a5-4109-86c2-b9c416e57b24 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:07:40.585471 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c68593-46a5-4109-86c2-b9c416e57b24 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:40.586869 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c68593-46a5-4109-86c2-b9c416e57b24 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:40.598176 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 415/837] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jun 16 17:07:40 2022] GET /identity/v3/role_assignments?user.id=3d381bb41dea4f1e90c3cf3815ac88dc&scope.project.id=73015da4de1f48c29f57fff1040d2c10&role.id=dba744f8ab2a4c45b9d3212f8d203aba => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:07:40.599123 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 423/838] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 16 17:07:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:07:40.600497 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6628eed-2724-4616-bc95-5e41144c45aa None None] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:40.600797 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6628eed-2724-4616-bc95-5e41144c45aa None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:40.601082 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6628eed-2724-4616-bc95-5e41144c45aa None None] PATH_INFO: `/` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:40.602601 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 416/839] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 17:07:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:07:40.607892 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c68593-46a5-4109-86c2-b9c416e57b24 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:40.609720 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59bbcad-6a92-4e2c-a1e7-14d3390d20e8 None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:40.610045 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59bbcad-6a92-4e2c-a1e7-14d3390d20e8 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:40.610325 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59bbcad-6a92-4e2c-a1e7-14d3390d20e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:40.633128 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-e59bbcad-6a92-4e2c-a1e7-14d3390d20e8 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:07:40.634400 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-e59bbcad-6a92-4e2c-a1e7-14d3390d20e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:07:40.721896 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 417/840] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 17:07:40 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 17:07:40.731580 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c68593-46a5-4109-86c2-b9c416e57b24 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:40.751106 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59bbcad-6a92-4e2c-a1e7-14d3390d20e8 None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:40.773469 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04584c70-9b49-4cb4-b474-99c8ab57efb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:40.774661 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04584c70-9b49-4cb4-b474-99c8ab57efb1 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:40.774997 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04584c70-9b49-4cb4-b474-99c8ab57efb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:40.775286 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04584c70-9b49-4cb4-b474-99c8ab57efb1 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:40.790134 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04584c70-9b49-4cb4-b474-99c8ab57efb1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:40.791592 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04584c70-9b49-4cb4-b474-99c8ab57efb1 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:40.807560 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application [None req-04584c70-9b49-4cb4-b474-99c8ab57efb1 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 16 17:07:40.807560 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:07:40.807560 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:07:40.807560 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:07:40.807560 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:07:40.807560 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:07:40.807560 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:07:40.807560 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:07:40.807560 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:07:40.807560 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:07:40.807560 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:07:40.807560 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:07:40.807560 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 17:07:40.807560 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 17:07:40.807560 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 17:07:40.807560 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 17:07:40.808593 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:07:40.808593 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:07:40.808593 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 17:07:40.808593 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 17:07:40.808593 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 17:07:40.808593 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 17:07:40.808593 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:07:40.808593 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:07:40.808593 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:07:40.808593 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:07:40.808593 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:07:40.808593 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application with Lock( Jun 16 17:07:40.808593 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:07:40.808593 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:07:40.808593 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:07:40.808593 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:07:40.808593 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:07:40.808593 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:07:40.809532 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:07:40.809532 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:07:40.809532 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 17:07:40.809532 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 17:07:40.809532 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 17:07:40.809532 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 17:07:40.809532 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 17:07:40.809532 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 17:07:40.809532 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 16 17:07:40.809532 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Jun 16 17:07:40.809532 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 424/841] 10.222.0.39 () {56 vars in 1117 bytes} [Thu Jun 16 17:07:40 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 17:07:40.814717 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04584c70-9b49-4cb4-b474-99c8ab57efb1 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:40.858858 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:40.881337 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59bbcad-6a92-4e2c-a1e7-14d3390d20e8 None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:40.902594 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:40.925847 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac43329-d508-4b37-91ab-40c2fbf1b57c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:40.926656 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac43329-d508-4b37-91ab-40c2fbf1b57c None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:40.926942 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac43329-d508-4b37-91ab-40c2fbf1b57c None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:40.927221 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac43329-d508-4b37-91ab-40c2fbf1b57c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:40.928128 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04584c70-9b49-4cb4-b474-99c8ab57efb1 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:40.939175 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac43329-d508-4b37-91ab-40c2fbf1b57c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 17:07:40.947542 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application [None req-2ac43329-d508-4b37-91ab-40c2fbf1b57c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 17:07:40.947542 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:07:40.947542 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:07:40.947542 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:07:40.947542 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:07:40.947542 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:07:40.947542 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:07:40.947542 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:07:40.947542 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:07:40.947542 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:07:40.947542 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:07:40.947542 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:07:40.947542 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 17:07:40.947542 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 17:07:40.947542 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 17:07:40.947542 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 17:07:40.948727 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 17:07:40.948727 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 17:07:40.948727 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 17:07:40.948727 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 17:07:40.948727 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:07:40.948727 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:07:40.948727 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:07:40.948727 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:07:40.948727 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:07:40.948727 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:07:40.948727 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:07:40.948727 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application with Lock( Jun 16 17:07:40.948727 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:07:40.948727 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:07:40.948727 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:07:40.948727 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:07:40.954559 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:07:40.954559 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:07:40.954559 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:07:40.954559 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:07:40.954559 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 17:07:40.954559 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 17:07:40.954559 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 17:07:40.954559 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 17:07:40.954559 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 17:07:40.954559 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 17:07:40.954559 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 17:07:40.954559 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Jun 16 17:07:40.954559 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 418/842] 10.222.0.39 () {56 vars in 1096 bytes} [Thu Jun 16 17:07:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 17:07:40.956205 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac43329-d508-4b37-91ab-40c2fbf1b57c None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:40.974056 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e715355-e5c5-4ee3-b0ad-1fa0b96f4816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:40.975059 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e715355-e5c5-4ee3-b0ad-1fa0b96f4816 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:40.975491 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e715355-e5c5-4ee3-b0ad-1fa0b96f4816 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:40.975915 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e715355-e5c5-4ee3-b0ad-1fa0b96f4816 None admin] PATH_INFO: `/v3/users` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:40.976896 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e715355-e5c5-4ee3-b0ad-1fa0b96f4816 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:07:40.977355 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e715355-e5c5-4ee3-b0ad-1fa0b96f4816 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:40.978951 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e715355-e5c5-4ee3-b0ad-1fa0b96f4816 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:40.999914 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 425/843] 10.222.0.39 () {56 vars in 1149 bytes} [Thu Jun 16 17:07:40 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 17:07:41.008568 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e715355-e5c5-4ee3-b0ad-1fa0b96f4816 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:41.081366 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac43329-d508-4b37-91ab-40c2fbf1b57c None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:41.108544 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:41.114249 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e715355-e5c5-4ee3-b0ad-1fa0b96f4816 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:41.121736 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964b82c3-af1c-4ee1-acab-8f9a08156ad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:41.122707 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964b82c3-af1c-4ee1-acab-8f9a08156ad2 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:41.123204 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964b82c3-af1c-4ee1-acab-8f9a08156ad2 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:41.123692 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964b82c3-af1c-4ee1-acab-8f9a08156ad2 None admin] PATH_INFO: `/v3/roles` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:41.124651 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964b82c3-af1c-4ee1-acab-8f9a08156ad2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80873) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:07:41.125193 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964b82c3-af1c-4ee1-acab-8f9a08156ad2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:41.126816 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964b82c3-af1c-4ee1-acab-8f9a08156ad2 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:41.136742 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 419/844] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 16 17:07:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:07:41.142509 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964b82c3-af1c-4ee1-acab-8f9a08156ad2 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:41.154685 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9cc5ae-a561-43cc-86ca-878ebcafafd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:41.155202 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9cc5ae-a561-43cc-86ca-878ebcafafd8 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:41.155489 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9cc5ae-a561-43cc-86ca-878ebcafafd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:41.155808 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9cc5ae-a561-43cc-86ca-878ebcafafd8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:41.194051 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:41.232194 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9cc5ae-a561-43cc-86ca-878ebcafafd8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:41.233602 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9cc5ae-a561-43cc-86ca-878ebcafafd8 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:41.267689 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964b82c3-af1c-4ee1-acab-8f9a08156ad2 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:41.304993 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54761041-c894-4f72-9189-4cd9dfa7f803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:41.305909 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54761041-c894-4f72-9189-4cd9dfa7f803 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:41.306173 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54761041-c894-4f72-9189-4cd9dfa7f803 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:41.306503 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54761041-c894-4f72-9189-4cd9dfa7f803 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:41.318437 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54761041-c894-4f72-9189-4cd9dfa7f803 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:41.320080 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54761041-c894-4f72-9189-4cd9dfa7f803 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:41.333571 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:41.337625 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application [None req-54761041-c894-4f72-9189-4cd9dfa7f803 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:07:41.337625 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:07:41.337625 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:07:41.337625 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:07:41.337625 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:07:41.337625 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:07:41.337625 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:07:41.337625 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:07:41.337625 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:07:41.337625 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:07:41.337625 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:07:41.337625 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:07:41.337625 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 17:07:41.337625 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 17:07:41.337625 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 17:07:41.342669 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 17:07:41.342669 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:07:41.342669 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:07:41.342669 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:07:41.342669 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:07:41.342669 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:07:41.342669 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:07:41.342669 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:07:41.342669 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application with Lock( Jun 16 17:07:41.342669 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:07:41.342669 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:07:41.342669 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:07:41.342669 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:07:41.342669 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:07:41.342669 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:07:41.342669 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:07:41.342669 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:07:41.343578 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 17:07:41.343578 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 17:07:41.343578 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:07:41.343578 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Jun 16 17:07:41.343578 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 420/845] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 17:07:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 17:07:41.343578 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15339d7-2748-457f-9fe4-c14aea5b74b3 None None] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:41.343922 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 426/846] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 16 17:07:41 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 17:07:41.345352 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15339d7-2748-457f-9fe4-c14aea5b74b3 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:41.345488 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9cc5ae-a561-43cc-86ca-878ebcafafd8 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:41.345716 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15339d7-2748-457f-9fe4-c14aea5b74b3 None None] PATH_INFO: `/` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:41.350006 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 421/847] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 17:07:41 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:07:41.350006 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15339d7-2748-457f-9fe4-c14aea5b74b3 None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:41.449226 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:41.455296 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9cc5ae-a561-43cc-86ca-878ebcafafd8 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:41.459232 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15339d7-2748-457f-9fe4-c14aea5b74b3 None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:41.500086 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9851fe9-bd92-497a-ae98-8699567721f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:41.500086 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9851fe9-bd92-497a-ae98-8699567721f1 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:41.500086 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9851fe9-bd92-497a-ae98-8699567721f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:41.500431 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c87a09-7cdc-44ba-94f5-3fc9182af433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:41.500522 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9851fe9-bd92-497a-ae98-8699567721f1 None admin] PATH_INFO: `/v3/domains` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:41.500593 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c87a09-7cdc-44ba-94f5-3fc9182af433 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:41.500662 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9851fe9-bd92-497a-ae98-8699567721f1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:07:41.500729 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c87a09-7cdc-44ba-94f5-3fc9182af433 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:41.500808 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9851fe9-bd92-497a-ae98-8699567721f1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:41.500879 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c87a09-7cdc-44ba-94f5-3fc9182af433 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:41.501729 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9851fe9-bd92-497a-ae98-8699567721f1 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:41.510077 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c87a09-7cdc-44ba-94f5-3fc9182af433 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:41.512252 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c87a09-7cdc-44ba-94f5-3fc9182af433 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:41.519792 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 427/848] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 16 17:07:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:07:41.521383 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fc429d-7fc1-4e28-8381-d68c83355812 None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:41.521852 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fc429d-7fc1-4e28-8381-d68c83355812 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:41.522282 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fc429d-7fc1-4e28-8381-d68c83355812 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:41.530914 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application [None req-49c87a09-7cdc-44ba-94f5-3fc9182af433 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:07:41.530914 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:07:41.530914 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:07:41.530914 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:07:41.530914 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:07:41.530914 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:07:41.530914 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:07:41.530914 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:07:41.530914 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:07:41.530914 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:07:41.530914 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:07:41.530914 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:07:41.530914 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 17:07:41.530914 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 17:07:41.530914 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 17:07:41.531990 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 17:07:41.531990 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:07:41.531990 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:07:41.531990 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:07:41.531990 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:07:41.531990 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:07:41.531990 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:07:41.531990 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:07:41.531990 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application with Lock( Jun 16 17:07:41.531990 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:07:41.531990 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:07:41.531990 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:07:41.531990 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:07:41.531990 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:07:41.531990 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:07:41.531990 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:07:41.531990 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:07:41.533174 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 17:07:41.533174 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 17:07:41.533174 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:07:41.533174 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Jun 16 17:07:41.536651 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 422/849] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 17:07:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:07:41.537854 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c87a09-7cdc-44ba-94f5-3fc9182af433 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:41.543581 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-39fc429d-7fc1-4e28-8381-d68c83355812 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:07:41.544970 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-39fc429d-7fc1-4e28-8381-d68c83355812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:07:41.603580 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:41.630037 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 428/850] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 17:07:41 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 17:07:41.630835 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fc429d-7fc1-4e28-8381-d68c83355812 None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:41.645536 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c87a09-7cdc-44ba-94f5-3fc9182af433 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:41.683994 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8bdf57-67eb-4839-bb8b-97fd4836b4ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:41.684858 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8bdf57-67eb-4839-bb8b-97fd4836b4ba None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:41.685145 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8bdf57-67eb-4839-bb8b-97fd4836b4ba None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:41.685421 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8bdf57-67eb-4839-bb8b-97fd4836b4ba None admin] PATH_INFO: `/v3/users/swift` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:41.693641 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8bdf57-67eb-4839-bb8b-97fd4836b4ba None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:41.695113 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8bdf57-67eb-4839-bb8b-97fd4836b4ba None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:41.709969 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application [None req-9a8bdf57-67eb-4839-bb8b-97fd4836b4ba None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 16 17:07:41.709969 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:07:41.709969 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:07:41.709969 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:07:41.709969 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:07:41.709969 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:07:41.709969 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:07:41.709969 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:07:41.709969 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:07:41.709969 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:07:41.709969 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:07:41.709969 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:07:41.709969 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 17:07:41.709969 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 17:07:41.709969 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 17:07:41.709969 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 17:07:41.711096 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:07:41.711096 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:07:41.711096 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 17:07:41.711096 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 17:07:41.711096 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 17:07:41.711096 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 17:07:41.711096 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:07:41.711096 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:07:41.711096 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:07:41.711096 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:07:41.711096 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:07:41.711096 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application with Lock( Jun 16 17:07:41.711096 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:07:41.711096 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:07:41.711096 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:07:41.711096 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:07:41.711096 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:07:41.711096 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:07:41.712124 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:07:41.712124 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:07:41.712124 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 17:07:41.712124 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 17:07:41.712124 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 17:07:41.712124 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 17:07:41.712124 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 17:07:41.712124 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 17:07:41.712124 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 16 17:07:41.712124 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Jun 16 17:07:41.712124 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 423/851] 10.222.0.39 () {56 vars in 1096 bytes} [Thu Jun 16 17:07:41 2022] GET /identity/v3/users/swift => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:07:41.712124 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8bdf57-67eb-4839-bb8b-97fd4836b4ba None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:41.718806 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:41.749070 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fc429d-7fc1-4e28-8381-d68c83355812 None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:41.788641 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df00a3d4-f16e-425e-9a7d-d8864fb9301c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:41.789183 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df00a3d4-f16e-425e-9a7d-d8864fb9301c None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:41.789475 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df00a3d4-f16e-425e-9a7d-d8864fb9301c None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:41.789772 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df00a3d4-f16e-425e-9a7d-d8864fb9301c None admin] PATH_INFO: `/v3/domains` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:41.790529 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df00a3d4-f16e-425e-9a7d-d8864fb9301c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:07:41.790845 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df00a3d4-f16e-425e-9a7d-d8864fb9301c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:41.792407 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df00a3d4-f16e-425e-9a7d-d8864fb9301c None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:41.805472 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 429/852] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 16 17:07:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:07:41.809540 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df00a3d4-f16e-425e-9a7d-d8864fb9301c None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:41.837176 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8bdf57-67eb-4839-bb8b-97fd4836b4ba None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:41.859544 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:41.876672 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d84421-a92a-436c-bd85-0c285c323832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:41.877798 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d84421-a92a-436c-bd85-0c285c323832 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:41.878301 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d84421-a92a-436c-bd85-0c285c323832 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:41.878793 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d84421-a92a-436c-bd85-0c285c323832 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:41.879695 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d84421-a92a-436c-bd85-0c285c323832 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:41.884788 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d84421-a92a-436c-bd85-0c285c323832 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:41.899146 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application [None req-b1d84421-a92a-436c-bd85-0c285c323832 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 16 17:07:41.899146 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:07:41.899146 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 17:07:41.899146 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 17:07:41.899146 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 17:07:41.899146 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 17:07:41.899146 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 17:07:41.899146 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 17:07:41.899146 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 16 17:07:41.899146 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Jun 16 17:07:41.899146 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 17:07:41.899146 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Jun 16 17:07:41.899146 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:07:41.899146 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:07:41.899146 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:07:41.899146 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:07:41.899146 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:07:41.900351 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:07:41.900351 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:07:41.900351 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:07:41.900351 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:07:41.900351 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:07:41.900351 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:07:41.900351 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 17:07:41.900351 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 17:07:41.900351 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 17:07:41.900351 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 17:07:41.900351 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:07:41.900351 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:07:41.900351 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:07:41.900351 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:07:41.900351 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:07:41.900351 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:07:41.901945 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:07:41.901945 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application with Lock( Jun 16 17:07:41.901945 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:07:41.901945 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:07:41.901945 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:07:41.901945 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:07:41.901945 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:07:41.901945 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:07:41.901945 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:07:41.901945 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:07:41.901945 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 17:07:41.901945 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 17:07:41.901945 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 16 17:07:41.901945 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Jun 16 17:07:41.901945 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 424/853] 10.222.0.39 () {56 vars in 1114 bytes} [Thu Jun 16 17:07:41 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:07:41.903168 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d84421-a92a-436c-bd85-0c285c323832 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:41.925593 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df00a3d4-f16e-425e-9a7d-d8864fb9301c None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:41.961734 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e38a428-279f-4fe9-a382-fdd34e71ba06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:41.962442 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e38a428-279f-4fe9-a382-fdd34e71ba06 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:41.962737 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e38a428-279f-4fe9-a382-fdd34e71ba06 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:41.963022 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e38a428-279f-4fe9-a382-fdd34e71ba06 None admin] PATH_INFO: `/v3/users` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:41.964401 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e38a428-279f-4fe9-a382-fdd34e71ba06 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:07:41.964722 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e38a428-279f-4fe9-a382-fdd34e71ba06 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:41.966174 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e38a428-279f-4fe9-a382-fdd34e71ba06 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:41.976812 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:41.989508 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 430/854] 10.222.0.39 () {56 vars in 1135 bytes} [Thu Jun 16 17:07:41 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:07:41.989508 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e38a428-279f-4fe9-a382-fdd34e71ba06 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:42.016312 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d84421-a92a-436c-bd85-0c285c323832 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:42.052871 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ecd8fc-cc35-4214-8865-5e2c1b7bd028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:42.053587 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ecd8fc-cc35-4214-8865-5e2c1b7bd028 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:42.053908 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ecd8fc-cc35-4214-8865-5e2c1b7bd028 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:42.054188 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ecd8fc-cc35-4214-8865-5e2c1b7bd028 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:42.061517 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ecd8fc-cc35-4214-8865-5e2c1b7bd028 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:42.062975 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ecd8fc-cc35-4214-8865-5e2c1b7bd028 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:42.078467 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application [None req-f4ecd8fc-cc35-4214-8865-5e2c1b7bd028 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 17:07:42.078467 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:07:42.078467 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:07:42.078467 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:07:42.078467 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:07:42.078467 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:07:42.078467 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:07:42.078467 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:07:42.078467 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:07:42.078467 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:07:42.078467 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:07:42.078467 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:07:42.078467 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 17:07:42.078467 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 17:07:42.078467 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 17:07:42.079372 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 17:07:42.079372 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:07:42.079372 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:07:42.079372 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:07:42.079372 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:07:42.079372 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:07:42.079372 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:07:42.079372 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:07:42.079372 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application with Lock( Jun 16 17:07:42.079372 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:07:42.079372 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:07:42.079372 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:07:42.079372 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:07:42.079372 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:07:42.079372 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:07:42.079372 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:07:42.079372 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:07:42.080270 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 17:07:42.080270 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 17:07:42.080270 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 17:07:42.080270 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 17:07:42.080270 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 17:07:42.080270 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 17:07:42.080270 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 17:07:42.080270 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Jun 16 17:07:42.080270 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 425/855] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 16 17:07:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:07:42.080755 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ecd8fc-cc35-4214-8865-5e2c1b7bd028 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:42.094293 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e38a428-279f-4fe9-a382-fdd34e71ba06 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:42.096645 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:42.129664 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6e92f8-c812-445b-b8f6-c03b4d839eb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:42.130447 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6e92f8-c812-445b-b8f6-c03b4d839eb1 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:42.130738 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6e92f8-c812-445b-b8f6-c03b4d839eb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:42.131018 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6e92f8-c812-445b-b8f6-c03b4d839eb1 None admin] PATH_INFO: `/v3/services` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:42.131824 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6e92f8-c812-445b-b8f6-c03b4d839eb1 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:07:42.132148 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6e92f8-c812-445b-b8f6-c03b4d839eb1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:42.133505 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6e92f8-c812-445b-b8f6-c03b4d839eb1 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:42.144473 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 431/856] 10.222.0.39 () {56 vars in 1114 bytes} [Thu Jun 16 17:07:41 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:07:42.144473 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6e92f8-c812-445b-b8f6-c03b4d839eb1 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:42.190885 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ecd8fc-cc35-4214-8865-5e2c1b7bd028 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:42.220370 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:42.228578 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda4856b-7db9-4577-a32a-2aa36d9c626a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:42.229439 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda4856b-7db9-4577-a32a-2aa36d9c626a None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:42.229989 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda4856b-7db9-4577-a32a-2aa36d9c626a None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:42.230136 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda4856b-7db9-4577-a32a-2aa36d9c626a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:42.249495 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6e92f8-c812-445b-b8f6-c03b4d839eb1 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:42.287469 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5d0457-cfda-4886-994b-a56bed2cca28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:42.288136 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5d0457-cfda-4886-994b-a56bed2cca28 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:42.288425 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5d0457-cfda-4886-994b-a56bed2cca28 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:42.288701 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5d0457-cfda-4886-994b-a56bed2cca28 None admin] PATH_INFO: `/v3/projects` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:42.289482 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5d0457-cfda-4886-994b-a56bed2cca28 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:07:42.289818 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5d0457-cfda-4886-994b-a56bed2cca28 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:42.291244 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5d0457-cfda-4886-994b-a56bed2cca28 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:42.302728 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda4856b-7db9-4577-a32a-2aa36d9c626a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:42.309706 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda4856b-7db9-4577-a32a-2aa36d9c626a None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:42.310315 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 432/857] 10.222.0.39 () {56 vars in 1148 bytes} [Thu Jun 16 17:07:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:07:42.310315 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5d0457-cfda-4886-994b-a56bed2cca28 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:42.339252 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:42.418782 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5d0457-cfda-4886-994b-a56bed2cca28 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:42.422405 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 426/858] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 16 17:07:42 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 17:07:42.423254 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda4856b-7db9-4577-a32a-2aa36d9c626a None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:42.454681 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:42.456765 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f850afc-1e19-43ce-ad52-fb4d052a6318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:42.457441 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f850afc-1e19-43ce-ad52-fb4d052a6318 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:42.457732 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f850afc-1e19-43ce-ad52-fb4d052a6318 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:42.458051 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f850afc-1e19-43ce-ad52-fb4d052a6318 None admin] PATH_INFO: `/v3/services` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:42.458760 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f850afc-1e19-43ce-ad52-fb4d052a6318 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:07:42.459076 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f850afc-1e19-43ce-ad52-fb4d052a6318 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:42.460437 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f850afc-1e19-43ce-ad52-fb4d052a6318 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:42.474007 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 433/859] 10.222.0.39 () {56 vars in 1114 bytes} [Thu Jun 16 17:07:42 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:07:42.474007 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f850afc-1e19-43ce-ad52-fb4d052a6318 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:42.548633 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda4856b-7db9-4577-a32a-2aa36d9c626a None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:42.590297 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffc073d-3949-4dee-ae9e-a4ad33ec90fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:42.590885 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffc073d-3949-4dee-ae9e-a4ad33ec90fa None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:42.591171 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffc073d-3949-4dee-ae9e-a4ad33ec90fa None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:42.591448 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffc073d-3949-4dee-ae9e-a4ad33ec90fa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:42.592294 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffc073d-3949-4dee-ae9e-a4ad33ec90fa None admin] RBAC: Adding query filter params (role.id=a12797d48dac420cb2eaadbe537f60ef, scope.project.id=73015da4de1f48c29f57fff1040d2c10, user.id=f7f35c1c15a84a92863d4f3f96d76830) {{(pid=80873) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:07:42.592726 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffc073d-3949-4dee-ae9e-a4ad33ec90fa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:42.594231 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffc073d-3949-4dee-ae9e-a4ad33ec90fa None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:42.596960 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:42.605722 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 427/860] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jun 16 17:07:42 2022] GET /identity/v3/role_assignments?user.id=f7f35c1c15a84a92863d4f3f96d76830&scope.project.id=73015da4de1f48c29f57fff1040d2c10&role.id=a12797d48dac420cb2eaadbe537f60ef => generated 608 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:07:42.612617 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f850afc-1e19-43ce-ad52-fb4d052a6318 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:42.656243 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253c05a7-ef13-49fd-bcd2-64537fa96991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:42.657216 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253c05a7-ef13-49fd-bcd2-64537fa96991 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:42.657618 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253c05a7-ef13-49fd-bcd2-64537fa96991 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:42.658024 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253c05a7-ef13-49fd-bcd2-64537fa96991 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:42.671603 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253c05a7-ef13-49fd-bcd2-64537fa96991 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:42.673088 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253c05a7-ef13-49fd-bcd2-64537fa96991 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:42.695865 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application [None req-253c05a7-ef13-49fd-bcd2-64537fa96991 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:07:42.695865 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:07:42.695865 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:07:42.695865 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:07:42.695865 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:07:42.695865 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:07:42.695865 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:07:42.695865 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:07:42.695865 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:07:42.695865 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:07:42.695865 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:07:42.695865 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:07:42.695865 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 17:07:42.695865 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 17:07:42.695865 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 17:07:42.696922 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 17:07:42.696922 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:07:42.696922 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:07:42.696922 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:07:42.696922 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:07:42.696922 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:07:42.696922 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:07:42.696922 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:07:42.696922 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application with Lock( Jun 16 17:07:42.696922 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:07:42.696922 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:07:42.696922 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:07:42.696922 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:07:42.696922 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:07:42.696922 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:07:42.696922 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:07:42.696922 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:07:42.698546 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 17:07:42.698546 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 17:07:42.698546 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:07:42.698546 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Jun 16 17:07:42.701900 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 434/861] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 17:07:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:07:42.704218 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffc073d-3949-4dee-ae9e-a4ad33ec90fa None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:42.817276 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:42.826888 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffc073d-3949-4dee-ae9e-a4ad33ec90fa None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:42.839695 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fc35b7-d966-4126-bda5-fdec7712d772 None None] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:42.840210 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fc35b7-d966-4126-bda5-fdec7712d772 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:42.840370 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fc35b7-d966-4126-bda5-fdec7712d772 None None] PATH_INFO: `/` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:42.841944 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 435/862] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 17:07:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 17:07:42.847060 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb324ec3-de9a-44af-8328-38224e4943dc None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:42.847419 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb324ec3-de9a-44af-8328-38224e4943dc None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:42.847704 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb324ec3-de9a-44af-8328-38224e4943dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:42.870837 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-eb324ec3-de9a-44af-8328-38224e4943dc None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:07:42.871310 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7578c1a9-7ff5-4101-ad33-af89ff0b69f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:42.872212 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7578c1a9-7ff5-4101-ad33-af89ff0b69f5 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:42.872663 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7578c1a9-7ff5-4101-ad33-af89ff0b69f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:42.873255 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-eb324ec3-de9a-44af-8328-38224e4943dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:07:42.873417 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7578c1a9-7ff5-4101-ad33-af89ff0b69f5 None admin] PATH_INFO: `/v3/domains` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:42.874092 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7578c1a9-7ff5-4101-ad33-af89ff0b69f5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80873) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:07:42.874411 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7578c1a9-7ff5-4101-ad33-af89ff0b69f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:42.876046 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7578c1a9-7ff5-4101-ad33-af89ff0b69f5 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:42.896343 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 428/863] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 16 17:07:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:07:42.903753 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7578c1a9-7ff5-4101-ad33-af89ff0b69f5 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:42.960255 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 436/864] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 17:07:42 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 17:07:42.990809 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb324ec3-de9a-44af-8328-38224e4943dc None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:43.043708 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7578c1a9-7ff5-4101-ad33-af89ff0b69f5 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:43.089200 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:43.093999 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54092d39-8900-439d-b00c-d7b7aea72476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:43.094942 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54092d39-8900-439d-b00c-d7b7aea72476 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:43.095297 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54092d39-8900-439d-b00c-d7b7aea72476 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:43.095808 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54092d39-8900-439d-b00c-d7b7aea72476 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:43.103752 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54092d39-8900-439d-b00c-d7b7aea72476 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:43.107276 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54092d39-8900-439d-b00c-d7b7aea72476 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:43.120937 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application [None req-54092d39-8900-439d-b00c-d7b7aea72476 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 17:07:43.120937 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:07:43.120937 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:07:43.120937 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:07:43.120937 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:07:43.120937 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:07:43.120937 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:07:43.120937 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:07:43.120937 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:07:43.120937 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:07:43.120937 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:07:43.120937 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:07:43.120937 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 17:07:43.120937 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 17:07:43.120937 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 17:07:43.121989 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 17:07:43.121989 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:07:43.121989 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:07:43.121989 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:07:43.121989 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:07:43.121989 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:07:43.121989 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:07:43.121989 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:07:43.121989 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application with Lock( Jun 16 17:07:43.121989 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:07:43.121989 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:07:43.121989 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:07:43.121989 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:07:43.121989 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:07:43.121989 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:07:43.121989 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:07:43.121989 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:07:43.122984 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 17:07:43.122984 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 17:07:43.122984 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 17:07:43.122984 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 17:07:43.122984 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 17:07:43.122984 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 17:07:43.122984 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 17:07:43.122984 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Jun 16 17:07:43.123930 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb324ec3-de9a-44af-8328-38224e4943dc None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:43.127203 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 429/865] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 16 17:07:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 17:07:43.128216 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54092d39-8900-439d-b00c-d7b7aea72476 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:43.143952 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:43.170013 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7979325d-5f77-4d28-8212-3c910113ceb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:43.171593 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7979325d-5f77-4d28-8212-3c910113ceb7 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:43.172039 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7979325d-5f77-4d28-8212-3c910113ceb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:43.172470 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7979325d-5f77-4d28-8212-3c910113ceb7 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:43.173645 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7979325d-5f77-4d28-8212-3c910113ceb7 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:43.175792 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7979325d-5f77-4d28-8212-3c910113ceb7 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:43.192135 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application [None req-7979325d-5f77-4d28-8212-3c910113ceb7 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 16 17:07:43.192135 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:07:43.192135 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 17:07:43.192135 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 17:07:43.192135 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 17:07:43.192135 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 17:07:43.192135 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 17:07:43.192135 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 17:07:43.192135 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 16 17:07:43.192135 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Jun 16 17:07:43.192135 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 17:07:43.192135 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Jun 16 17:07:43.192135 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:07:43.192135 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:07:43.192135 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:07:43.192135 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:07:43.193390 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:07:43.193390 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:07:43.193390 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:07:43.193390 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:07:43.193390 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:07:43.193390 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:07:43.193390 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:07:43.193390 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 17:07:43.193390 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 17:07:43.193390 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 17:07:43.193390 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 17:07:43.193390 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:07:43.193390 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:07:43.193390 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:07:43.193390 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:07:43.193390 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:07:43.194350 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:07:43.194350 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:07:43.194350 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application with Lock( Jun 16 17:07:43.194350 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:07:43.194350 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:07:43.194350 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:07:43.194350 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:07:43.194350 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:07:43.194350 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:07:43.194350 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:07:43.194350 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:07:43.194350 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 17:07:43.194350 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 17:07:43.194350 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 16 17:07:43.194350 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Jun 16 17:07:43.202992 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 437/866] 10.222.0.39 () {56 vars in 1132 bytes} [Thu Jun 16 17:07:42 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:07:43.203755 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7979325d-5f77-4d28-8212-3c910113ceb7 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:43.248460 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54092d39-8900-439d-b00c-d7b7aea72476 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:43.287187 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02552664-eeeb-4629-84d3-f696625964ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:43.287859 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02552664-eeeb-4629-84d3-f696625964ac None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:43.288148 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02552664-eeeb-4629-84d3-f696625964ac None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:43.288433 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02552664-eeeb-4629-84d3-f696625964ac None admin] PATH_INFO: `/v3/projects` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:43.289226 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02552664-eeeb-4629-84d3-f696625964ac None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80873) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:07:43.289544 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02552664-eeeb-4629-84d3-f696625964ac None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:43.291028 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02552664-eeeb-4629-84d3-f696625964ac None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:43.309611 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 430/867] 10.222.0.39 () {56 vars in 1148 bytes} [Thu Jun 16 17:07:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:07:43.310915 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02552664-eeeb-4629-84d3-f696625964ac None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:43.345712 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7979325d-5f77-4d28-8212-3c910113ceb7 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:43.388095 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:43.392547 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaa0c0c-177a-42e6-b75c-da96de8157f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:43.393900 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaa0c0c-177a-42e6-b75c-da96de8157f2 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:43.394417 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaa0c0c-177a-42e6-b75c-da96de8157f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:43.395239 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaa0c0c-177a-42e6-b75c-da96de8157f2 None admin] PATH_INFO: `/v3/services` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:43.396159 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeaa0c0c-177a-42e6-b75c-da96de8157f2 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:07:43.396954 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeaa0c0c-177a-42e6-b75c-da96de8157f2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:43.398853 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeaa0c0c-177a-42e6-b75c-da96de8157f2 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:43.409976 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 438/868] 10.222.0.39 () {56 vars in 1126 bytes} [Thu Jun 16 17:07:43 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 17:07:43.412203 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaa0c0c-177a-42e6-b75c-da96de8157f2 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:43.415583 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:43.424985 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02552664-eeeb-4629-84d3-f696625964ac None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:43.460467 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68863b5b-9901-4505-861f-cb76dc6d6de2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:43.461131 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68863b5b-9901-4505-861f-cb76dc6d6de2 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:43.461418 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68863b5b-9901-4505-861f-cb76dc6d6de2 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:43.461698 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68863b5b-9901-4505-861f-cb76dc6d6de2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:43.462566 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68863b5b-9901-4505-861f-cb76dc6d6de2 None admin] RBAC: Adding query filter params (role.id=dba744f8ab2a4c45b9d3212f8d203aba, scope.project.id=73015da4de1f48c29f57fff1040d2c10, user.id=bbec2dfe63764ed88a23e172ead0afa4) {{(pid=80873) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:07:43.462937 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68863b5b-9901-4505-861f-cb76dc6d6de2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:43.465081 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68863b5b-9901-4505-861f-cb76dc6d6de2 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:43.477896 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 431/869] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jun 16 17:07:43 2022] GET /identity/v3/role_assignments?user.id=bbec2dfe63764ed88a23e172ead0afa4&scope.project.id=73015da4de1f48c29f57fff1040d2c10&role.id=dba744f8ab2a4c45b9d3212f8d203aba => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:07:43.539034 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaa0c0c-177a-42e6-b75c-da96de8157f2 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:43.579004 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc083341-f841-42e3-a7a4-340d4b4f4ee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:43.580060 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc083341-f841-42e3-a7a4-340d4b4f4ee3 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:43.580576 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc083341-f841-42e3-a7a4-340d4b4f4ee3 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:43.581061 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc083341-f841-42e3-a7a4-340d4b4f4ee3 None admin] PATH_INFO: `/v3/services` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:43.582027 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc083341-f841-42e3-a7a4-340d4b4f4ee3 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:07:43.582560 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc083341-f841-42e3-a7a4-340d4b4f4ee3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:43.584166 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc083341-f841-42e3-a7a4-340d4b4f4ee3 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:43.590222 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 439/870] 10.222.0.39 () {56 vars in 1126 bytes} [Thu Jun 16 17:07:43 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:07:44.680904 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6af0e8-c3d7-4dbf-896b-9857058fa002 None None] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:44.681418 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6af0e8-c3d7-4dbf-896b-9857058fa002 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:44.681528 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6af0e8-c3d7-4dbf-896b-9857058fa002 None None] PATH_INFO: `/` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:44.683206 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 432/871] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 17:07:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:07:44.688472 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc31912c-1243-4238-a000-496d2b698913 None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:44.688895 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc31912c-1243-4238-a000-496d2b698913 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:44.689100 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc31912c-1243-4238-a000-496d2b698913 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:44.707136 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-cc31912c-1243-4238-a000-496d2b698913 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:07:44.708355 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-cc31912c-1243-4238-a000-496d2b698913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:07:44.771820 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:44.779981 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 440/872] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 17:07:44 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 17:07:44.802414 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6af0e8-c3d7-4dbf-896b-9857058fa002 None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:44.911618 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6af0e8-c3d7-4dbf-896b-9857058fa002 None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:44.947109 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ecbe1d-f2fa-4f9e-a6a8-77bcf682691b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:44.947776 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ecbe1d-f2fa-4f9e-a6a8-77bcf682691b None admin] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:44.948607 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ecbe1d-f2fa-4f9e-a6a8-77bcf682691b None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:44.948887 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ecbe1d-f2fa-4f9e-a6a8-77bcf682691b None admin] PATH_INFO: `/v3/services` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:44.949623 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ecbe1d-f2fa-4f9e-a6a8-77bcf682691b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:44.951007 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ecbe1d-f2fa-4f9e-a6a8-77bcf682691b None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:44.955281 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:45.029431 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ad2fae-c0f3-4a4d-b8eb-c0ffa7f2578b None None] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:45.029807 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ad2fae-c0f3-4a4d-b8eb-c0ffa7f2578b None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:45.030038 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ad2fae-c0f3-4a4d-b8eb-c0ffa7f2578b None None] PATH_INFO: `/` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:45.031672 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 441/873] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 17:07:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:07:45.036316 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a6f851-de05-4786-aa1b-fc8c5f4b203b None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:45.036609 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a6f851-de05-4786-aa1b-fc8c5f4b203b None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:45.036890 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a6f851-de05-4786-aa1b-fc8c5f4b203b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:45.058884 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-77a6f851-de05-4786-aa1b-fc8c5f4b203b None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:07:45.060447 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-77a6f851-de05-4786-aa1b-fc8c5f4b203b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:07:45.080321 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 433/874] 10.222.0.39 () {60 vars in 1141 bytes} [Thu Jun 16 17:07:44 2022] POST /identity/v3/services => generated 251 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:07:45.161213 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 442/875] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 17:07:45 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 17:07:45.185416 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ecbe1d-f2fa-4f9e-a6a8-77bcf682691b None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:45.297641 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ecbe1d-f2fa-4f9e-a6a8-77bcf682691b None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:45.333043 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e10f30-15b8-41e1-ba0f-582adb05d9a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:45.333988 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e10f30-15b8-41e1-ba0f-582adb05d9a2 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:45.334275 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e10f30-15b8-41e1-ba0f-582adb05d9a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:45.334550 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e10f30-15b8-41e1-ba0f-582adb05d9a2 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:45.346376 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e10f30-15b8-41e1-ba0f-582adb05d9a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 17:07:45.355498 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application [None req-79e10f30-15b8-41e1-ba0f-582adb05d9a2 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 16 17:07:45.355498 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:07:45.355498 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:07:45.355498 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:07:45.355498 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:07:45.355498 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:07:45.355498 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:07:45.355498 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:07:45.355498 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:07:45.355498 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:07:45.355498 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:07:45.355498 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:07:45.355498 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 17:07:45.355498 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 17:07:45.355498 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 17:07:45.355498 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 17:07:45.356695 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 17:07:45.356695 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 17:07:45.356695 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 17:07:45.356695 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 17:07:45.356695 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:07:45.356695 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:07:45.356695 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:07:45.356695 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:07:45.356695 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:07:45.356695 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:07:45.356695 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:07:45.356695 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application with Lock( Jun 16 17:07:45.356695 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:07:45.356695 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:07:45.356695 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:07:45.356695 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:07:45.357806 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:07:45.357806 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:07:45.357806 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:07:45.357806 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:07:45.357806 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 17:07:45.357806 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 17:07:45.357806 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 17:07:45.357806 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 17:07:45.357806 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 17:07:45.357806 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 17:07:45.357806 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 16 17:07:45.357806 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Jun 16 17:07:45.357806 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 434/876] 10.222.0.39 () {56 vars in 1120 bytes} [Thu Jun 16 17:07:45 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:07:45.363067 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a6f851-de05-4786-aa1b-fc8c5f4b203b None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:45.470705 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a6f851-de05-4786-aa1b-fc8c5f4b203b None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:45.498903 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:45.507714 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f583b08d-797c-480f-8a82-bcf4099e3ba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:45.508388 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f583b08d-797c-480f-8a82-bcf4099e3ba9 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:45.508672 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f583b08d-797c-480f-8a82-bcf4099e3ba9 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:45.508949 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f583b08d-797c-480f-8a82-bcf4099e3ba9 None admin] PATH_INFO: `/v3/roles` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:45.509734 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f583b08d-797c-480f-8a82-bcf4099e3ba9 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:07:45.510161 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f583b08d-797c-480f-8a82-bcf4099e3ba9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:45.512143 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f583b08d-797c-480f-8a82-bcf4099e3ba9 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:45.521377 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 443/877] 10.222.0.39 () {56 vars in 1115 bytes} [Thu Jun 16 17:07:45 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:07:45.527094 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e10f30-15b8-41e1-ba0f-582adb05d9a2 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:45.587547 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:45.635397 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e10f30-15b8-41e1-ba0f-582adb05d9a2 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:45.673453 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e635d3-d71d-4c53-9f41-c7c49dbecc92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:45.674398 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e635d3-d71d-4c53-9f41-c7c49dbecc92 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:45.674687 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e635d3-d71d-4c53-9f41-c7c49dbecc92 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:45.674972 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e635d3-d71d-4c53-9f41-c7c49dbecc92 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:45.688668 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e635d3-d71d-4c53-9f41-c7c49dbecc92 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:45.690966 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e635d3-d71d-4c53-9f41-c7c49dbecc92 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:45.710163 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application [None req-31e635d3-d71d-4c53-9f41-c7c49dbecc92 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:07:45.710163 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:07:45.710163 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:07:45.710163 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:07:45.710163 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:07:45.710163 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:07:45.710163 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:07:45.710163 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:07:45.710163 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:07:45.710163 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:07:45.710163 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:07:45.710163 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:07:45.710163 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 17:07:45.710163 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 17:07:45.710163 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 17:07:45.711145 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 17:07:45.711145 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:07:45.711145 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:07:45.711145 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:07:45.711145 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:07:45.711145 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:07:45.711145 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:07:45.711145 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:07:45.711145 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application with Lock( Jun 16 17:07:45.711145 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:07:45.711145 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:07:45.711145 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:07:45.711145 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:07:45.711145 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:07:45.711145 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:07:45.711145 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:07:45.711145 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:07:45.712058 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 17:07:45.712058 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 17:07:45.712058 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:07:45.712058 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Jun 16 17:07:45.714470 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 435/878] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 17:07:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:07:45.723105 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f583b08d-797c-480f-8a82-bcf4099e3ba9 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:45.732099 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f7e5ae-35f7-454a-870c-1181988fa34a None None] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:45.732388 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f7e5ae-35f7-454a-870c-1181988fa34a None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:45.732667 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f7e5ae-35f7-454a-870c-1181988fa34a None None] PATH_INFO: `/` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:45.734080 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 436/879] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 17:07:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 17:07:45.739049 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5032ece-b4b9-46c5-9a15-d19422cf24ea None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:45.739342 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5032ece-b4b9-46c5-9a15-d19422cf24ea None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:45.739624 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5032ece-b4b9-46c5-9a15-d19422cf24ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:45.757313 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-c5032ece-b4b9-46c5-9a15-d19422cf24ea None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:07:45.758545 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-c5032ece-b4b9-46c5-9a15-d19422cf24ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:07:45.835965 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f583b08d-797c-480f-8a82-bcf4099e3ba9 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:45.848593 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 437/880] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 17:07:45 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 17:07:45.850356 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7fc306-514d-4739-9760-d0f6de5cb9ca None None] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:45.850793 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7fc306-514d-4739-9760-d0f6de5cb9ca None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:45.851080 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7fc306-514d-4739-9760-d0f6de5cb9ca None None] PATH_INFO: `/` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:45.853301 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 438/881] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 17:07:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:07:45.858873 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93566b4d-c546-4bd6-93df-fa44b2acd62b None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:45.859168 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93566b4d-c546-4bd6-93df-fa44b2acd62b None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:45.859452 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93566b4d-c546-4bd6-93df-fa44b2acd62b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:45.881389 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-93566b4d-c546-4bd6-93df-fa44b2acd62b None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:07:45.882599 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-93566b4d-c546-4bd6-93df-fa44b2acd62b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:07:45.886642 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be9bcaf-1dc2-4c72-9027-ce51925fc3c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:45.887568 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be9bcaf-1dc2-4c72-9027-ce51925fc3c3 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:45.888026 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be9bcaf-1dc2-4c72-9027-ce51925fc3c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:45.888476 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be9bcaf-1dc2-4c72-9027-ce51925fc3c3 None admin] PATH_INFO: `/v3/domains` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:45.889397 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be9bcaf-1dc2-4c72-9027-ce51925fc3c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:07:45.889936 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be9bcaf-1dc2-4c72-9027-ce51925fc3c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:45.891729 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be9bcaf-1dc2-4c72-9027-ce51925fc3c3 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:45.908971 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 444/882] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 16 17:07:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:07:45.908971 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be9bcaf-1dc2-4c72-9027-ce51925fc3c3 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:45.922251 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:45.953269 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:45.961148 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 439/883] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 17:07:45 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 17:07:45.962041 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93566b4d-c546-4bd6-93df-fa44b2acd62b None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:46.027564 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be9bcaf-1dc2-4c72-9027-ce51925fc3c3 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:46.063768 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63365c5e-b6ff-4382-a485-2553e7e79ad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:46.064565 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63365c5e-b6ff-4382-a485-2553e7e79ad0 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:46.064848 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63365c5e-b6ff-4382-a485-2553e7e79ad0 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:46.065122 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63365c5e-b6ff-4382-a485-2553e7e79ad0 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:46.065791 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63365c5e-b6ff-4382-a485-2553e7e79ad0 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:46.066468 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93566b4d-c546-4bd6-93df-fa44b2acd62b None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:46.067421 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63365c5e-b6ff-4382-a485-2553e7e79ad0 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:46.080541 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application [None req-63365c5e-b6ff-4382-a485-2553e7e79ad0 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 17:07:46.080541 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:07:46.080541 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 17:07:46.080541 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 17:07:46.080541 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 17:07:46.080541 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 17:07:46.080541 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 17:07:46.080541 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 17:07:46.080541 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 17:07:46.080541 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Jun 16 17:07:46.080541 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 17:07:46.080541 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Jun 16 17:07:46.080541 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:07:46.080541 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:07:46.080541 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:07:46.080541 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:07:46.080541 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:07:46.081585 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:07:46.081585 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:07:46.081585 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:07:46.081585 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:07:46.081585 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:07:46.081585 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:07:46.081585 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 17:07:46.081585 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 17:07:46.081585 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 17:07:46.081585 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 17:07:46.081585 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:07:46.081585 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:07:46.081585 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:07:46.081585 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:07:46.081585 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:07:46.081585 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:07:46.082488 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:07:46.082488 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application with Lock( Jun 16 17:07:46.082488 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:07:46.082488 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:07:46.082488 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:07:46.082488 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:07:46.082488 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:07:46.082488 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:07:46.082488 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:07:46.082488 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:07:46.082488 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 17:07:46.082488 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 17:07:46.082488 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 17:07:46.082488 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Jun 16 17:07:46.082488 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 445/884] 10.222.0.39 () {56 vars in 1126 bytes} [Thu Jun 16 17:07:45 2022] GET /identity/v3/services/object-store => generated 93 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:07:46.083305 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63365c5e-b6ff-4382-a485-2553e7e79ad0 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:46.114545 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67bcdd4-a85b-46df-8125-1f83166b74b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:46.115195 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67bcdd4-a85b-46df-8125-1f83166b74b1 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:46.115483 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67bcdd4-a85b-46df-8125-1f83166b74b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:46.115760 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67bcdd4-a85b-46df-8125-1f83166b74b1 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:46.123725 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67bcdd4-a85b-46df-8125-1f83166b74b1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:46.125167 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67bcdd4-a85b-46df-8125-1f83166b74b1 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:46.140753 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application [None req-c67bcdd4-a85b-46df-8125-1f83166b74b1 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 16 17:07:46.140753 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:07:46.140753 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:07:46.140753 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:07:46.140753 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:07:46.140753 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:07:46.140753 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:07:46.140753 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:07:46.140753 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:07:46.140753 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:07:46.140753 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:07:46.140753 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:07:46.140753 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 17:07:46.140753 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 17:07:46.140753 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 17:07:46.140753 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 17:07:46.141877 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:07:46.141877 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:07:46.141877 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 17:07:46.141877 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 17:07:46.141877 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 17:07:46.141877 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 17:07:46.141877 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:07:46.141877 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:07:46.141877 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:07:46.141877 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:07:46.141877 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:07:46.141877 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application with Lock( Jun 16 17:07:46.141877 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:07:46.141877 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:07:46.141877 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:07:46.141877 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:07:46.141877 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:07:46.141877 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:07:46.142857 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:07:46.142857 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:07:46.142857 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 17:07:46.142857 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 17:07:46.142857 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 17:07:46.142857 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 17:07:46.142857 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 17:07:46.142857 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 17:07:46.142857 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 16 17:07:46.142857 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Jun 16 17:07:46.142857 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 440/885] 10.222.0.39 () {56 vars in 1117 bytes} [Thu Jun 16 17:07:45 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:07:46.142857 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67bcdd4-a85b-46df-8125-1f83166b74b1 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:46.170951 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:46.209688 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63365c5e-b6ff-4382-a485-2553e7e79ad0 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:46.219184 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:46.246293 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b56c9a8-dcc0-4247-a137-312f28b57d94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:46.246985 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b56c9a8-dcc0-4247-a137-312f28b57d94 None admin] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:46.247505 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b56c9a8-dcc0-4247-a137-312f28b57d94 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:46.247787 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b56c9a8-dcc0-4247-a137-312f28b57d94 None admin] PATH_INFO: `/v3/services` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:46.249193 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b56c9a8-dcc0-4247-a137-312f28b57d94 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:46.252365 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b56c9a8-dcc0-4247-a137-312f28b57d94 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:46.257534 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67bcdd4-a85b-46df-8125-1f83166b74b1 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:46.293053 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd487ca4-88dd-48b8-8fe3-a0dbadc1b6f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:46.293720 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd487ca4-88dd-48b8-8fe3-a0dbadc1b6f1 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:46.294040 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd487ca4-88dd-48b8-8fe3-a0dbadc1b6f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:46.294321 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd487ca4-88dd-48b8-8fe3-a0dbadc1b6f1 None admin] PATH_INFO: `/v3/services` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:46.295108 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd487ca4-88dd-48b8-8fe3-a0dbadc1b6f1 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80873) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:07:46.295419 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd487ca4-88dd-48b8-8fe3-a0dbadc1b6f1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:46.296804 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd487ca4-88dd-48b8-8fe3-a0dbadc1b6f1 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:46.302513 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 441/886] 10.222.0.39 () {56 vars in 1122 bytes} [Thu Jun 16 17:07:46 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:07:46.304256 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd487ca4-88dd-48b8-8fe3-a0dbadc1b6f1 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:46.398219 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:46.407265 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd487ca4-88dd-48b8-8fe3-a0dbadc1b6f1 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:46.423715 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 446/887] 10.222.0.39 () {60 vars in 1141 bytes} [Thu Jun 16 17:07:46 2022] POST /identity/v3/services => generated 269 bytes in 341 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:07:46.424552 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b56c9a8-dcc0-4247-a137-312f28b57d94 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:46.465211 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9925e2-2ab9-4ebf-8b70-fb59d08e37ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:46.465940 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9925e2-2ab9-4ebf-8b70-fb59d08e37ec None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:46.466233 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9925e2-2ab9-4ebf-8b70-fb59d08e37ec None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:46.466513 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9925e2-2ab9-4ebf-8b70-fb59d08e37ec None admin] PATH_INFO: `/v3/users` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:46.467709 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9925e2-2ab9-4ebf-8b70-fb59d08e37ec None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80873) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:07:46.468027 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9925e2-2ab9-4ebf-8b70-fb59d08e37ec None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:46.470569 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9925e2-2ab9-4ebf-8b70-fb59d08e37ec None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:46.499275 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 442/888] 10.222.0.39 () {56 vars in 1149 bytes} [Thu Jun 16 17:07:46 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:07:46.504658 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9925e2-2ab9-4ebf-8b70-fb59d08e37ec None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:46.554961 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b56c9a8-dcc0-4247-a137-312f28b57d94 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:46.612425 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a556dbd0-cef4-4ba6-8896-877cc14bf7c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:46.613599 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a556dbd0-cef4-4ba6-8896-877cc14bf7c3 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:46.613927 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a556dbd0-cef4-4ba6-8896-877cc14bf7c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:46.614490 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a556dbd0-cef4-4ba6-8896-877cc14bf7c3 None admin] PATH_INFO: `/v3/services` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:46.615225 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a556dbd0-cef4-4ba6-8896-877cc14bf7c3 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:07:46.615545 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a556dbd0-cef4-4ba6-8896-877cc14bf7c3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:46.617912 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a556dbd0-cef4-4ba6-8896-877cc14bf7c3 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:46.625045 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 447/889] 10.222.0.39 () {56 vars in 1122 bytes} [Thu Jun 16 17:07:46 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:07:46.658858 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9925e2-2ab9-4ebf-8b70-fb59d08e37ec None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:46.700072 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d387b105-4255-427b-af6e-d3d599e3aa39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:46.700750 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d387b105-4255-427b-af6e-d3d599e3aa39 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:46.701024 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d387b105-4255-427b-af6e-d3d599e3aa39 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:46.701304 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d387b105-4255-427b-af6e-d3d599e3aa39 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:46.719011 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:46.781693 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d387b105-4255-427b-af6e-d3d599e3aa39 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:46.783494 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d387b105-4255-427b-af6e-d3d599e3aa39 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:46.909034 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 443/890] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 16 17:07:46 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 16 17:07:46.914583 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a556dbd0-cef4-4ba6-8896-877cc14bf7c3 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:46.948181 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:47.030404 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a556dbd0-cef4-4ba6-8896-877cc14bf7c3 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:47.067677 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e22088-6176-49de-a19e-86235661ed97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:47.068478 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e22088-6176-49de-a19e-86235661ed97 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:47.068768 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e22088-6176-49de-a19e-86235661ed97 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:47.069054 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e22088-6176-49de-a19e-86235661ed97 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:47.082836 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e22088-6176-49de-a19e-86235661ed97 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:47.091499 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e22088-6176-49de-a19e-86235661ed97 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:47.110751 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application [None req-e7e22088-6176-49de-a19e-86235661ed97 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:07:47.110751 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:07:47.110751 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:07:47.110751 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:07:47.110751 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:07:47.110751 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:07:47.110751 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:07:47.110751 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:07:47.110751 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:07:47.110751 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:07:47.110751 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:07:47.110751 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:07:47.110751 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 17:07:47.110751 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 17:07:47.110751 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 17:07:47.112670 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 17:07:47.112670 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:07:47.112670 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:07:47.112670 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:07:47.112670 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:07:47.112670 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:07:47.112670 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:07:47.112670 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:07:47.112670 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application with Lock( Jun 16 17:07:47.112670 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:07:47.112670 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:07:47.112670 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:07:47.112670 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:07:47.112670 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:07:47.112670 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:07:47.112670 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:07:47.112670 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:07:47.113880 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 17:07:47.113880 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 17:07:47.113880 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:07:47.113880 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Jun 16 17:07:47.113880 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 448/891] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 17:07:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:07:47.117586 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d387b105-4255-427b-af6e-d3d599e3aa39 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:47.167389 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:47.229547 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d387b105-4255-427b-af6e-d3d599e3aa39 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:47.266070 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab863897-6910-45c5-aa88-f365a77f09db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:47.266741 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab863897-6910-45c5-aa88-f365a77f09db None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:47.267030 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab863897-6910-45c5-aa88-f365a77f09db None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:47.267310 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab863897-6910-45c5-aa88-f365a77f09db None admin] PATH_INFO: `/v3/domains` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:47.268039 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab863897-6910-45c5-aa88-f365a77f09db None admin] RBAC: Adding query filter params (name=Default) {{(pid=80873) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:07:47.268352 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab863897-6910-45c5-aa88-f365a77f09db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:47.269708 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab863897-6910-45c5-aa88-f365a77f09db None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:47.282396 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 444/892] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 16 17:07:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:07:47.288135 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e22088-6176-49de-a19e-86235661ed97 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:47.389010 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:47.407169 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e22088-6176-49de-a19e-86235661ed97 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:47.420337 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609f2258-7d21-4596-9bb3-365be4e8a190 None None] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:47.420617 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609f2258-7d21-4596-9bb3-365be4e8a190 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:47.422129 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609f2258-7d21-4596-9bb3-365be4e8a190 None None] PATH_INFO: `/` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:47.423111 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 445/893] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 17:07:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 17:07:47.433494 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0d8375-0fd0-415d-afdc-cbc881116605 None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:47.434094 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0d8375-0fd0-415d-afdc-cbc881116605 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:47.434588 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0d8375-0fd0-415d-afdc-cbc881116605 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:47.454253 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca079113-3cbb-41ff-b5ce-2620aa5259fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:47.456333 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca079113-3cbb-41ff-b5ce-2620aa5259fa None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:47.456333 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca079113-3cbb-41ff-b5ce-2620aa5259fa None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:47.456333 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca079113-3cbb-41ff-b5ce-2620aa5259fa None admin] PATH_INFO: `/v3/projects/service` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:47.466740 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca079113-3cbb-41ff-b5ce-2620aa5259fa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:47.467800 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-ed0d8375-0fd0-415d-afdc-cbc881116605 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:07:47.469233 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-ed0d8375-0fd0-415d-afdc-cbc881116605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:07:47.469416 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca079113-3cbb-41ff-b5ce-2620aa5259fa None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:47.496595 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application [None req-ca079113-3cbb-41ff-b5ce-2620aa5259fa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 17:07:47.496595 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:07:47.496595 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:07:47.496595 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:07:47.496595 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:07:47.496595 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:07:47.496595 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:07:47.496595 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:07:47.496595 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:07:47.496595 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:07:47.496595 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:07:47.496595 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:07:47.496595 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 17:07:47.496595 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 17:07:47.496595 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 17:07:47.498767 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 17:07:47.498767 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:07:47.498767 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:07:47.498767 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:07:47.498767 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:07:47.498767 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:07:47.498767 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:07:47.498767 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:07:47.498767 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application with Lock( Jun 16 17:07:47.498767 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:07:47.498767 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:07:47.498767 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:07:47.498767 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:07:47.498767 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:07:47.498767 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:07:47.498767 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:07:47.498767 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:07:47.500351 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 17:07:47.500351 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 17:07:47.500351 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 17:07:47.500351 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 17:07:47.500351 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 17:07:47.500351 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 17:07:47.500351 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 17:07:47.500351 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Jun 16 17:07:47.502199 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 449/894] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 16 17:07:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:07:47.508430 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca079113-3cbb-41ff-b5ce-2620aa5259fa None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:47.573785 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 446/895] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 17:07:47 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 17:07:47.591405 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0d8375-0fd0-415d-afdc-cbc881116605 None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:47.639227 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca079113-3cbb-41ff-b5ce-2620aa5259fa None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:47.650150 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:47.684245 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b468a965-0f4f-4789-b05e-c983a648193d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:47.685644 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b468a965-0f4f-4789-b05e-c983a648193d None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:47.686720 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b468a965-0f4f-4789-b05e-c983a648193d None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:47.687491 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b468a965-0f4f-4789-b05e-c983a648193d None admin] PATH_INFO: `/v3/projects` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:47.688577 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b468a965-0f4f-4789-b05e-c983a648193d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:07:47.689227 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b468a965-0f4f-4789-b05e-c983a648193d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:47.691629 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b468a965-0f4f-4789-b05e-c983a648193d None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:47.708010 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 450/896] 10.222.0.39 () {56 vars in 1148 bytes} [Thu Jun 16 17:07:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:07:47.714118 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b468a965-0f4f-4789-b05e-c983a648193d None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:47.715678 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0d8375-0fd0-415d-afdc-cbc881116605 None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:47.720774 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:47.764630 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04d38b7-eada-43d2-8466-422da8176d9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:47.765447 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04d38b7-eada-43d2-8466-422da8176d9e None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:47.765728 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04d38b7-eada-43d2-8466-422da8176d9e None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:47.766039 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04d38b7-eada-43d2-8466-422da8176d9e None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:47.766703 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04d38b7-eada-43d2-8466-422da8176d9e None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:47.768066 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04d38b7-eada-43d2-8466-422da8176d9e None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:47.784700 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application [None req-f04d38b7-eada-43d2-8466-422da8176d9e None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 16 17:07:47.784700 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:07:47.784700 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 17:07:47.784700 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 17:07:47.784700 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 17:07:47.784700 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 17:07:47.784700 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 17:07:47.784700 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 17:07:47.784700 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 16 17:07:47.784700 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Jun 16 17:07:47.784700 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 17:07:47.784700 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Jun 16 17:07:47.784700 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:07:47.784700 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:07:47.784700 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:07:47.784700 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:07:47.784700 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:07:47.785802 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:07:47.785802 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:07:47.785802 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:07:47.785802 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:07:47.785802 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:07:47.785802 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:07:47.785802 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 17:07:47.785802 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 17:07:47.785802 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 17:07:47.785802 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 17:07:47.785802 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:07:47.785802 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:07:47.785802 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:07:47.785802 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:07:47.785802 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:07:47.785802 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:07:47.786855 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:07:47.786855 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application with Lock( Jun 16 17:07:47.786855 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:07:47.786855 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:07:47.786855 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:07:47.786855 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:07:47.786855 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:07:47.786855 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:07:47.786855 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:07:47.786855 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:07:47.786855 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 17:07:47.786855 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 17:07:47.786855 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 16 17:07:47.786855 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Jun 16 17:07:47.788107 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 447/897] 10.222.0.39 () {56 vars in 1114 bytes} [Thu Jun 16 17:07:47 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 17:07:47.798882 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04d38b7-eada-43d2-8466-422da8176d9e None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:47.857788 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b468a965-0f4f-4789-b05e-c983a648193d None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:47.902701 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00981070-4963-4b16-87e6-e44a574b69e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:47.903905 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00981070-4963-4b16-87e6-e44a574b69e6 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:47.904348 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00981070-4963-4b16-87e6-e44a574b69e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:47.905091 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00981070-4963-4b16-87e6-e44a574b69e6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:47.906114 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00981070-4963-4b16-87e6-e44a574b69e6 None admin] RBAC: Adding query filter params (role.id=db26ca9731b944aea5051916653e9ffd, scope.project.id=73015da4de1f48c29f57fff1040d2c10, user.id=f7f35c1c15a84a92863d4f3f96d76830) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:07:47.906743 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00981070-4963-4b16-87e6-e44a574b69e6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:47.908969 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00981070-4963-4b16-87e6-e44a574b69e6 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:47.916901 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 451/898] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jun 16 17:07:47 2022] GET /identity/v3/role_assignments?user.id=f7f35c1c15a84a92863d4f3f96d76830&scope.project.id=73015da4de1f48c29f57fff1040d2c10&role.id=db26ca9731b944aea5051916653e9ffd => generated 259 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:07:47.924347 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:47.928014 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04d38b7-eada-43d2-8466-422da8176d9e None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:47.972728 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b85d532-f17f-4d91-96b9-a322a33c2e80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:47.973991 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b85d532-f17f-4d91-96b9-a322a33c2e80 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:47.974479 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b85d532-f17f-4d91-96b9-a322a33c2e80 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:47.974952 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b85d532-f17f-4d91-96b9-a322a33c2e80 None admin] PATH_INFO: `/v3/services` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:47.975857 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b85d532-f17f-4d91-96b9-a322a33c2e80 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80873) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:07:47.976327 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b85d532-f17f-4d91-96b9-a322a33c2e80 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:47.977977 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b85d532-f17f-4d91-96b9-a322a33c2e80 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:47.989579 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 448/899] 10.222.0.39 () {56 vars in 1114 bytes} [Thu Jun 16 17:07:47 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:07:47.991273 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00981070-4963-4b16-87e6-e44a574b69e6 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:48.068960 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:48.105978 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00981070-4963-4b16-87e6-e44a574b69e6 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:48.141527 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c996b8-5132-4973-8537-8d7fdc800400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:48.142510 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c996b8-5132-4973-8537-8d7fdc800400 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:48.142949 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c996b8-5132-4973-8537-8d7fdc800400 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:48.143400 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c996b8-5132-4973-8537-8d7fdc800400 None admin] PATH_INFO: `/v3/services` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:48.144246 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c996b8-5132-4973-8537-8d7fdc800400 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:07:48.144708 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c996b8-5132-4973-8537-8d7fdc800400 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:48.146420 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c996b8-5132-4973-8537-8d7fdc800400 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:48.156938 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 452/900] 10.222.0.39 () {56 vars in 1114 bytes} [Thu Jun 16 17:07:47 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:07:48.158559 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b85d532-f17f-4d91-96b9-a322a33c2e80 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:48.270907 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b85d532-f17f-4d91-96b9-a322a33c2e80 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:48.309548 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a92c5e7-46b4-402e-addd-93f0545fe739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:48.310520 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a92c5e7-46b4-402e-addd-93f0545fe739 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:48.310958 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a92c5e7-46b4-402e-addd-93f0545fe739 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:48.311413 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a92c5e7-46b4-402e-addd-93f0545fe739 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:48.312360 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a92c5e7-46b4-402e-addd-93f0545fe739 None admin] RBAC: Adding query filter params (interface=public, service_id=bd2d35e8655d4ac281e0268dad0cf778, region_id=RegionOne) {{(pid=80873) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:07:48.312827 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a92c5e7-46b4-402e-addd-93f0545fe739 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:48.314372 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a92c5e7-46b4-402e-addd-93f0545fe739 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:48.327135 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 449/901] 10.222.0.39 () {56 vars in 1251 bytes} [Thu Jun 16 17:07:48 2022] GET /identity/v3/endpoints?service_id=bd2d35e8655d4ac281e0268dad0cf778&interface=public®ion_id=RegionOne => generated 194 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:07:48.328817 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c996b8-5132-4973-8537-8d7fdc800400 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:48.437329 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c996b8-5132-4973-8537-8d7fdc800400 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:48.471537 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:48.475668 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70051fe-0b94-4bc9-93e9-dc1ff4e3f0c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:48.476346 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70051fe-0b94-4bc9-93e9-dc1ff4e3f0c9 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:48.476635 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70051fe-0b94-4bc9-93e9-dc1ff4e3f0c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:48.476913 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70051fe-0b94-4bc9-93e9-dc1ff4e3f0c9 None admin] PATH_INFO: `/v3/services` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:48.477608 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70051fe-0b94-4bc9-93e9-dc1ff4e3f0c9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:48.479101 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70051fe-0b94-4bc9-93e9-dc1ff4e3f0c9 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:48.489918 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 453/902] 10.222.0.39 () {56 vars in 1087 bytes} [Thu Jun 16 17:07:48 2022] GET /identity/v3/services => generated 1268 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:07:48.875760 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a77e8e3-8fa5-4e05-963a-9fc92a64429a None None] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:48.876366 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a77e8e3-8fa5-4e05-963a-9fc92a64429a None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:48.876366 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a77e8e3-8fa5-4e05-963a-9fc92a64429a None None] PATH_INFO: `/` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:48.877972 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 450/903] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 17:07:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:07:48.878080 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f52cf14-c1e2-4f33-9d83-aa25a9558c1c None None] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:48.878380 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f52cf14-c1e2-4f33-9d83-aa25a9558c1c None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:48.878670 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f52cf14-c1e2-4f33-9d83-aa25a9558c1c None None] PATH_INFO: `/` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:48.880355 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 454/904] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 17:07:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:07:48.885815 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b79027f-0400-4c96-9ba2-de3c024f08a6 None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:48.886120 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b79027f-0400-4c96-9ba2-de3c024f08a6 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:48.886415 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b79027f-0400-4c96-9ba2-de3c024f08a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:48.889116 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c56be5-8a13-4fd2-8679-b18e06bfbe96 None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:48.889411 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c56be5-8a13-4fd2-8679-b18e06bfbe96 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:48.889695 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c56be5-8a13-4fd2-8679-b18e06bfbe96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:48.907266 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-9b79027f-0400-4c96-9ba2-de3c024f08a6 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:07:48.908465 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-9b79027f-0400-4c96-9ba2-de3c024f08a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:07:48.910089 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-18c56be5-8a13-4fd2-8679-b18e06bfbe96 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:07:48.911695 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-18c56be5-8a13-4fd2-8679-b18e06bfbe96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:07:48.933046 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:49.001783 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 455/905] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 17:07:48 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 17:07:49.002293 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 451/906] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 17:07:48 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 17:07:49.020247 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c56be5-8a13-4fd2-8679-b18e06bfbe96 None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:49.022541 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b79027f-0400-4c96-9ba2-de3c024f08a6 None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:49.148357 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b79027f-0400-4c96-9ba2-de3c024f08a6 None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:49.155340 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c56be5-8a13-4fd2-8679-b18e06bfbe96 None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:49.182909 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:49.188836 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b3c63c-b116-43a6-8349-bb5bb192da28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:49.189920 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b3c63c-b116-43a6-8349-bb5bb192da28 None admin] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:49.190464 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b3c63c-b116-43a6-8349-bb5bb192da28 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:49.190955 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b3c63c-b116-43a6-8349-bb5bb192da28 None admin] PATH_INFO: `/v3/services` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:49.192107 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b3c63c-b116-43a6-8349-bb5bb192da28 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:49.192886 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c2110b-0c46-47db-b5fa-2149b16626b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:49.193704 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c2110b-0c46-47db-b5fa-2149b16626b4 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:49.194037 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c2110b-0c46-47db-b5fa-2149b16626b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:49.199661 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c2110b-0c46-47db-b5fa-2149b16626b4 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:49.199775 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b3c63c-b116-43a6-8349-bb5bb192da28 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:49.199872 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c2110b-0c46-47db-b5fa-2149b16626b4 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:49.199872 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c2110b-0c46-47db-b5fa-2149b16626b4 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:49.209428 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application [None req-b0c2110b-0c46-47db-b5fa-2149b16626b4 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 16 17:07:49.209428 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:07:49.209428 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 17:07:49.209428 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 17:07:49.209428 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 17:07:49.209428 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 17:07:49.209428 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 17:07:49.209428 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 17:07:49.209428 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 16 17:07:49.209428 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Jun 16 17:07:49.209428 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 17:07:49.209428 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Jun 16 17:07:49.209428 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:07:49.209428 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:07:49.209428 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:07:49.209428 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:07:49.211738 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:07:49.211738 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:07:49.211738 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:07:49.211738 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:07:49.211738 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:07:49.211738 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:07:49.211738 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:07:49.211738 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 17:07:49.211738 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 17:07:49.211738 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 17:07:49.211738 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 17:07:49.211738 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:07:49.211738 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:07:49.211738 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:07:49.211738 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:07:49.211738 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:07:49.212573 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:07:49.212573 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:07:49.212573 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application with Lock( Jun 16 17:07:49.212573 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:07:49.212573 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:07:49.212573 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:07:49.212573 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:07:49.212573 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:07:49.212573 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:07:49.212573 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:07:49.212573 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:07:49.212573 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 17:07:49.212573 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 17:07:49.212573 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 16 17:07:49.212573 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Jun 16 17:07:49.216268 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 456/907] 10.222.0.39 () {56 vars in 1132 bytes} [Thu Jun 16 17:07:49 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:07:49.217079 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c2110b-0c46-47db-b5fa-2149b16626b4 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:49.288765 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 452/908] 10.222.0.39 () {60 vars in 1141 bytes} [Thu Jun 16 17:07:49 2022] POST /identity/v3/services => generated 241 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 17:07:49.341354 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c2110b-0c46-47db-b5fa-2149b16626b4 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:49.390719 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0be74f-cb2d-4ad1-a5c7-90e3146f908e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:49.391802 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0be74f-cb2d-4ad1-a5c7-90e3146f908e None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:49.392245 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0be74f-cb2d-4ad1-a5c7-90e3146f908e None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:49.392667 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0be74f-cb2d-4ad1-a5c7-90e3146f908e None admin] PATH_INFO: `/v3/services` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:49.393540 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0be74f-cb2d-4ad1-a5c7-90e3146f908e None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:07:49.394046 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0be74f-cb2d-4ad1-a5c7-90e3146f908e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:49.395637 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0be74f-cb2d-4ad1-a5c7-90e3146f908e None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:49.402687 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 457/909] 10.222.0.39 () {56 vars in 1126 bytes} [Thu Jun 16 17:07:49 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:07:49.408563 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b3c63c-b116-43a6-8349-bb5bb192da28 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:49.433237 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:49.524262 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b3c63c-b116-43a6-8349-bb5bb192da28 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:49.563057 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361d7059-206a-46b9-8b3c-5be1bb6c0cbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:49.564027 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361d7059-206a-46b9-8b3c-5be1bb6c0cbd None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:49.564458 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361d7059-206a-46b9-8b3c-5be1bb6c0cbd None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:49.564903 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361d7059-206a-46b9-8b3c-5be1bb6c0cbd None admin] PATH_INFO: `/v3/services` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:49.565779 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361d7059-206a-46b9-8b3c-5be1bb6c0cbd None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80873) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:07:49.566333 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361d7059-206a-46b9-8b3c-5be1bb6c0cbd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:49.567888 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361d7059-206a-46b9-8b3c-5be1bb6c0cbd None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:49.573877 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 453/910] 10.222.0.39 () {56 vars in 1126 bytes} [Thu Jun 16 17:07:49 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 17:07:49.579733 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0be74f-cb2d-4ad1-a5c7-90e3146f908e None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:49.638382 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:49.693212 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0be74f-cb2d-4ad1-a5c7-90e3146f908e None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:49.731084 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16ddd43-fa49-4e8a-9a73-2e18b09b938e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:49.731995 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16ddd43-fa49-4e8a-9a73-2e18b09b938e None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:49.732428 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16ddd43-fa49-4e8a-9a73-2e18b09b938e None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:49.732851 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16ddd43-fa49-4e8a-9a73-2e18b09b938e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:49.733848 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16ddd43-fa49-4e8a-9a73-2e18b09b938e None admin] RBAC: Adding query filter params (interface=public, service_id=c61fd5fe527e4c16a3854515a8ddea26, region_id=RegionOne) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:07:49.734314 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16ddd43-fa49-4e8a-9a73-2e18b09b938e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:49.735950 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16ddd43-fa49-4e8a-9a73-2e18b09b938e None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:49.742466 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 458/911] 10.222.0.39 () {56 vars in 1251 bytes} [Thu Jun 16 17:07:49 2022] GET /identity/v3/endpoints?service_id=c61fd5fe527e4c16a3854515a8ddea26&interface=public®ion_id=RegionOne => generated 194 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:07:49.748757 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361d7059-206a-46b9-8b3c-5be1bb6c0cbd None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:49.839736 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:49.858742 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361d7059-206a-46b9-8b3c-5be1bb6c0cbd None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:49.894960 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99513f2d-ad85-4957-aa17-531bc6afc2d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:49.895631 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99513f2d-ad85-4957-aa17-531bc6afc2d5 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:49.895919 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99513f2d-ad85-4957-aa17-531bc6afc2d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:49.896204 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99513f2d-ad85-4957-aa17-531bc6afc2d5 None admin] PATH_INFO: `/v3/services` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:49.896888 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99513f2d-ad85-4957-aa17-531bc6afc2d5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:49.898299 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99513f2d-ad85-4957-aa17-531bc6afc2d5 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:49.904880 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 454/912] 10.222.0.39 () {56 vars in 1087 bytes} [Thu Jun 16 17:07:49 2022] GET /identity/v3/services => generated 1497 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:07:50.123106 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7b3c10-3c25-4d8c-b03a-ff6d18984b94 None None] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:50.123651 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7b3c10-3c25-4d8c-b03a-ff6d18984b94 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:50.123651 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7b3c10-3c25-4d8c-b03a-ff6d18984b94 None None] PATH_INFO: `/` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:50.125262 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 459/913] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 17:07:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:07:50.130780 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9c35de-162e-4b6b-92c9-85a5b8015ddf None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:50.131075 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9c35de-162e-4b6b-92c9-85a5b8015ddf None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:50.131353 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9c35de-162e-4b6b-92c9-85a5b8015ddf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:50.152760 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-dd9c35de-162e-4b6b-92c9-85a5b8015ddf None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:07:50.153986 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-dd9c35de-162e-4b6b-92c9-85a5b8015ddf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:07:50.224660 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 455/914] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 17:07:50 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 17:07:50.247511 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7b3c10-3c25-4d8c-b03a-ff6d18984b94 None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:50.358699 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7b3c10-3c25-4d8c-b03a-ff6d18984b94 None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:50.373542 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:50.394684 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2837431a-ea06-41de-a54b-4050e41da5db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:50.395489 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2837431a-ea06-41de-a54b-4050e41da5db None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:50.403602 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2837431a-ea06-41de-a54b-4050e41da5db None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:50.403602 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2837431a-ea06-41de-a54b-4050e41da5db None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:50.407761 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2837431a-ea06-41de-a54b-4050e41da5db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 17:07:50.416696 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application [None req-2837431a-ea06-41de-a54b-4050e41da5db None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 16 17:07:50.416696 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:07:50.416696 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:07:50.416696 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:07:50.416696 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:07:50.416696 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:07:50.416696 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:07:50.416696 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:07:50.416696 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:07:50.416696 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:07:50.416696 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:07:50.416696 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:07:50.416696 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 17:07:50.416696 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 17:07:50.416696 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 17:07:50.416696 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 17:07:50.417646 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 17:07:50.417646 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 17:07:50.417646 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 17:07:50.417646 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 17:07:50.417646 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:07:50.417646 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:07:50.417646 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:07:50.417646 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:07:50.417646 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:07:50.417646 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:07:50.417646 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:07:50.417646 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application with Lock( Jun 16 17:07:50.417646 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:07:50.417646 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:07:50.417646 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:07:50.417646 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:07:50.418514 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:07:50.418514 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:07:50.418514 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:07:50.418514 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:07:50.418514 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 17:07:50.418514 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 17:07:50.418514 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 17:07:50.418514 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 17:07:50.418514 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 17:07:50.418514 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 17:07:50.418514 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 16 17:07:50.418514 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Jun 16 17:07:50.418514 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 460/915] 10.222.0.39 () {56 vars in 1120 bytes} [Thu Jun 16 17:07:50 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:07:50.429500 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9c35de-162e-4b6b-92c9-85a5b8015ddf None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:50.510813 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:50.533311 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9c35de-162e-4b6b-92c9-85a5b8015ddf None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:50.570487 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7e6018-af6c-4adb-8779-9fe6c8d4e6b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:50.571159 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7e6018-af6c-4adb-8779-9fe6c8d4e6b9 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:50.571445 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7e6018-af6c-4adb-8779-9fe6c8d4e6b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:50.571723 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7e6018-af6c-4adb-8779-9fe6c8d4e6b9 None admin] PATH_INFO: `/v3/roles` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:50.573271 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7e6018-af6c-4adb-8779-9fe6c8d4e6b9 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80873) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:07:50.573819 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7e6018-af6c-4adb-8779-9fe6c8d4e6b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:50.575746 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7e6018-af6c-4adb-8779-9fe6c8d4e6b9 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:50.584940 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 456/916] 10.222.0.39 () {56 vars in 1115 bytes} [Thu Jun 16 17:07:50 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:07:50.590901 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2837431a-ea06-41de-a54b-4050e41da5db None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:50.700635 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2837431a-ea06-41de-a54b-4050e41da5db None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:50.738414 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78b29b1-b0c4-4d37-8c46-6d56b1d739c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:50.739269 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78b29b1-b0c4-4d37-8c46-6d56b1d739c3 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:50.739552 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78b29b1-b0c4-4d37-8c46-6d56b1d739c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:50.739829 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78b29b1-b0c4-4d37-8c46-6d56b1d739c3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:50.752206 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7423aab6-51e1-4b46-bb6e-5ff7ab2904c6 None None] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:50.754541 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7423aab6-51e1-4b46-bb6e-5ff7ab2904c6 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:50.754541 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7423aab6-51e1-4b46-bb6e-5ff7ab2904c6 None None] PATH_INFO: `/` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:50.754740 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78b29b1-b0c4-4d37-8c46-6d56b1d739c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:50.754835 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 457/917] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 17:07:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 17:07:50.755609 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78b29b1-b0c4-4d37-8c46-6d56b1d739c3 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:50.759722 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d155498c-4c0e-4198-8768-cb901d99e801 None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:50.760106 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d155498c-4c0e-4198-8768-cb901d99e801 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:50.760390 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d155498c-4c0e-4198-8768-cb901d99e801 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:50.777507 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application [None req-e78b29b1-b0c4-4d37-8c46-6d56b1d739c3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:07:50.777507 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:07:50.777507 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:07:50.777507 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:07:50.777507 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:07:50.777507 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:07:50.777507 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:07:50.777507 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:07:50.777507 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:07:50.777507 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:07:50.777507 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:07:50.777507 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:07:50.777507 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 17:07:50.777507 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 17:07:50.777507 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 17:07:50.778617 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 17:07:50.778617 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:07:50.778617 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:07:50.778617 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:07:50.778617 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:07:50.778617 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:07:50.778617 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:07:50.778617 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:07:50.778617 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application with Lock( Jun 16 17:07:50.778617 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:07:50.778617 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:07:50.778617 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:07:50.778617 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:07:50.778617 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:07:50.778617 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:07:50.778617 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:07:50.778617 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:07:50.779527 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 17:07:50.779527 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 17:07:50.779527 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:07:50.779527 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Jun 16 17:07:50.779748 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-d155498c-4c0e-4198-8768-cb901d99e801 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:07:50.779748 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-d155498c-4c0e-4198-8768-cb901d99e801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:07:50.782119 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 461/918] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 17:07:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:07:50.787254 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78b29b1-b0c4-4d37-8c46-6d56b1d739c3 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:50.821832 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:50.873783 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 458/919] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 17:07:50 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 17:07:50.898043 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d155498c-4c0e-4198-8768-cb901d99e801 None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:50.908745 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78b29b1-b0c4-4d37-8c46-6d56b1d739c3 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:50.946380 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018c552c-db12-4bb3-9945-21c328f2f431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:50.947993 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018c552c-db12-4bb3-9945-21c328f2f431 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:50.948487 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018c552c-db12-4bb3-9945-21c328f2f431 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:50.949063 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018c552c-db12-4bb3-9945-21c328f2f431 None admin] PATH_INFO: `/v3/domains` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:50.950026 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018c552c-db12-4bb3-9945-21c328f2f431 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:07:50.950631 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018c552c-db12-4bb3-9945-21c328f2f431 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:50.952414 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018c552c-db12-4bb3-9945-21c328f2f431 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:50.970691 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 462/920] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 16 17:07:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 17:07:50.971964 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018c552c-db12-4bb3-9945-21c328f2f431 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:50.979949 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:51.023217 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d155498c-4c0e-4198-8768-cb901d99e801 None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:51.064320 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79798f1-3496-4cb7-8e4b-199f6a28cfca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:51.065120 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79798f1-3496-4cb7-8e4b-199f6a28cfca None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:51.065402 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79798f1-3496-4cb7-8e4b-199f6a28cfca None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:51.065677 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79798f1-3496-4cb7-8e4b-199f6a28cfca None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:51.066384 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79798f1-3496-4cb7-8e4b-199f6a28cfca None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:51.067752 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79798f1-3496-4cb7-8e4b-199f6a28cfca None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:51.081160 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application [None req-a79798f1-3496-4cb7-8e4b-199f6a28cfca None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 16 17:07:51.081160 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:07:51.081160 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 17:07:51.081160 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 17:07:51.081160 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 17:07:51.081160 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 17:07:51.081160 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 17:07:51.081160 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 17:07:51.081160 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 16 17:07:51.081160 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Jun 16 17:07:51.081160 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 17:07:51.081160 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Jun 16 17:07:51.081160 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:07:51.081160 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:07:51.081160 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:07:51.081160 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:07:51.081160 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:07:51.082245 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:07:51.082245 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:07:51.082245 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:07:51.082245 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:07:51.082245 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:07:51.082245 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:07:51.082245 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 17:07:51.082245 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 17:07:51.082245 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 17:07:51.082245 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 17:07:51.082245 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:07:51.082245 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:07:51.082245 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:07:51.082245 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:07:51.082245 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:07:51.082245 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:07:51.083098 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:07:51.083098 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application with Lock( Jun 16 17:07:51.083098 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:07:51.083098 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:07:51.083098 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:07:51.083098 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:07:51.083098 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:07:51.083098 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:07:51.083098 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:07:51.083098 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:07:51.083098 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 17:07:51.083098 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 17:07:51.083098 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 16 17:07:51.083098 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Jun 16 17:07:51.086115 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 459/921] 10.222.0.39 () {56 vars in 1114 bytes} [Thu Jun 16 17:07:50 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:07:51.088951 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:51.089419 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79798f1-3496-4cb7-8e4b-199f6a28cfca None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:51.110436 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018c552c-db12-4bb3-9945-21c328f2f431 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:51.164194 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0ac994-d1d1-4582-862a-8a4cdd315302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:51.165055 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0ac994-d1d1-4582-862a-8a4cdd315302 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:51.165291 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0ac994-d1d1-4582-862a-8a4cdd315302 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:51.165569 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0ac994-d1d1-4582-862a-8a4cdd315302 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:51.176395 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0ac994-d1d1-4582-862a-8a4cdd315302 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:51.177869 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0ac994-d1d1-4582-862a-8a4cdd315302 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:51.195257 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application [None req-ca0ac994-d1d1-4582-862a-8a4cdd315302 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 16 17:07:51.195257 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:07:51.195257 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:07:51.195257 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:07:51.195257 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:07:51.195257 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:07:51.195257 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:07:51.195257 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:07:51.195257 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:07:51.195257 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:07:51.195257 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:07:51.195257 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:07:51.195257 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 17:07:51.195257 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 17:07:51.195257 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 17:07:51.195257 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 17:07:51.196252 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:07:51.196252 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:07:51.196252 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 17:07:51.196252 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 17:07:51.196252 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 17:07:51.196252 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 17:07:51.196252 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:07:51.196252 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:07:51.196252 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:07:51.196252 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:07:51.196252 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:07:51.196252 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application with Lock( Jun 16 17:07:51.196252 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:07:51.196252 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:07:51.196252 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:07:51.196252 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:07:51.196252 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:07:51.196252 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:07:51.197818 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:07:51.197818 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:07:51.197818 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 17:07:51.197818 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 17:07:51.197818 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 17:07:51.197818 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 17:07:51.197818 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 17:07:51.197818 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 17:07:51.197818 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 16 17:07:51.197818 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Jun 16 17:07:51.200166 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 463/922] 10.222.0.39 () {56 vars in 1117 bytes} [Thu Jun 16 17:07:50 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:07:51.206043 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0ac994-d1d1-4582-862a-8a4cdd315302 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:51.214121 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79798f1-3496-4cb7-8e4b-199f6a28cfca None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:51.248645 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:51.259501 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c584b876-8ff5-4efb-8d58-f690bbf2b6d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:51.261472 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c584b876-8ff5-4efb-8d58-f690bbf2b6d7 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:51.261973 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c584b876-8ff5-4efb-8d58-f690bbf2b6d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:51.262419 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c584b876-8ff5-4efb-8d58-f690bbf2b6d7 None admin] PATH_INFO: `/v3/services` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:51.263983 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c584b876-8ff5-4efb-8d58-f690bbf2b6d7 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80873) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:07:51.264502 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c584b876-8ff5-4efb-8d58-f690bbf2b6d7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:51.266544 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c584b876-8ff5-4efb-8d58-f690bbf2b6d7 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:51.279594 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 460/923] 10.222.0.39 () {56 vars in 1114 bytes} [Thu Jun 16 17:07:51 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 17:07:51.282076 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c584b876-8ff5-4efb-8d58-f690bbf2b6d7 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:51.332356 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0ac994-d1d1-4582-862a-8a4cdd315302 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:51.370041 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236ea4b9-093b-4804-a2a6-0f33d030427c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:51.370742 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236ea4b9-093b-4804-a2a6-0f33d030427c None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:51.371008 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236ea4b9-093b-4804-a2a6-0f33d030427c None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:51.371289 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236ea4b9-093b-4804-a2a6-0f33d030427c None admin] PATH_INFO: `/v3/users` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:51.372340 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236ea4b9-093b-4804-a2a6-0f33d030427c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:07:51.372745 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236ea4b9-093b-4804-a2a6-0f33d030427c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:51.374255 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236ea4b9-093b-4804-a2a6-0f33d030427c None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:51.397874 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 464/924] 10.222.0.39 () {56 vars in 1149 bytes} [Thu Jun 16 17:07:51 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:07:51.399178 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236ea4b9-093b-4804-a2a6-0f33d030427c None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:51.402949 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:51.408514 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c584b876-8ff5-4efb-8d58-f690bbf2b6d7 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:51.446161 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8970704f-5883-41bd-8278-14a6c0d45017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:51.447286 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8970704f-5883-41bd-8278-14a6c0d45017 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:51.448329 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8970704f-5883-41bd-8278-14a6c0d45017 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:51.448878 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8970704f-5883-41bd-8278-14a6c0d45017 None admin] PATH_INFO: `/v3/services` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:51.449893 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8970704f-5883-41bd-8278-14a6c0d45017 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80873) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:07:51.450448 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8970704f-5883-41bd-8278-14a6c0d45017 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:51.452100 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8970704f-5883-41bd-8278-14a6c0d45017 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:51.463767 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 461/925] 10.222.0.39 () {56 vars in 1114 bytes} [Thu Jun 16 17:07:51 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:07:51.465146 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8970704f-5883-41bd-8278-14a6c0d45017 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:51.511252 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236ea4b9-093b-4804-a2a6-0f33d030427c None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:51.529889 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:51.548727 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34f2cb0-864b-48d0-8525-a1679165b1a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:51.549581 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34f2cb0-864b-48d0-8525-a1679165b1a6 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:51.549900 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34f2cb0-864b-48d0-8525-a1679165b1a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:51.550181 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34f2cb0-864b-48d0-8525-a1679165b1a6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:51.562435 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34f2cb0-864b-48d0-8525-a1679165b1a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:51.564354 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34f2cb0-864b-48d0-8525-a1679165b1a6 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:51.574874 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8970704f-5883-41bd-8278-14a6c0d45017 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:51.587275 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application [None req-f34f2cb0-864b-48d0-8525-a1679165b1a6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:07:51.587275 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:07:51.587275 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:07:51.587275 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:07:51.587275 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:07:51.587275 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:07:51.587275 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:07:51.587275 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:07:51.587275 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:07:51.587275 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:07:51.587275 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:07:51.587275 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:07:51.587275 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 17:07:51.587275 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 17:07:51.587275 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 17:07:51.588246 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 17:07:51.588246 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:07:51.588246 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:07:51.588246 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:07:51.588246 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:07:51.588246 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:07:51.588246 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:07:51.588246 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:07:51.588246 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application with Lock( Jun 16 17:07:51.588246 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:07:51.588246 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:07:51.588246 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:07:51.588246 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:07:51.588246 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:07:51.588246 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:07:51.588246 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:07:51.588246 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:07:51.589208 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 17:07:51.589208 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 17:07:51.589208 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:07:51.589208 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Jun 16 17:07:51.589208 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 465/926] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 17:07:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:07:51.590142 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219e88b8-7396-4e01-b26e-f21cc2c9b6f7 None None] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:51.590411 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219e88b8-7396-4e01-b26e-f21cc2c9b6f7 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:51.590690 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219e88b8-7396-4e01-b26e-f21cc2c9b6f7 None None] PATH_INFO: `/` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:51.593829 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 466/927] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 17:07:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:07:51.595658 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219e88b8-7396-4e01-b26e-f21cc2c9b6f7 None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:51.619728 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5520085a-9d63-43f5-80d6-97d27eaae551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:51.620409 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5520085a-9d63-43f5-80d6-97d27eaae551 None admin] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:51.620696 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5520085a-9d63-43f5-80d6-97d27eaae551 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:51.620980 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5520085a-9d63-43f5-80d6-97d27eaae551 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:51.621727 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5520085a-9d63-43f5-80d6-97d27eaae551 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:51.623133 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5520085a-9d63-43f5-80d6-97d27eaae551 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:51.658735 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:51.704571 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219e88b8-7396-4e01-b26e-f21cc2c9b6f7 None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:51.707150 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 462/928] 10.222.0.39 () {60 vars in 1144 bytes} [Thu Jun 16 17:07:51 2022] POST /identity/v3/endpoints => generated 346 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:07:51.708588 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b280d2-f104-4e0f-9e5b-589500ea201f None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:51.708994 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b280d2-f104-4e0f-9e5b-589500ea201f None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:51.709373 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b280d2-f104-4e0f-9e5b-589500ea201f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:51.730816 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-64b280d2-f104-4e0f-9e5b-589500ea201f None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:07:51.732232 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-64b280d2-f104-4e0f-9e5b-589500ea201f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:07:51.780139 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd1f266-960c-405b-ba68-3eebdb309cb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:51.780833 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd1f266-960c-405b-ba68-3eebdb309cb1 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:51.781118 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd1f266-960c-405b-ba68-3eebdb309cb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:51.781397 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd1f266-960c-405b-ba68-3eebdb309cb1 None admin] PATH_INFO: `/v3/domains` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:51.782295 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd1f266-960c-405b-ba68-3eebdb309cb1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:07:51.782613 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd1f266-960c-405b-ba68-3eebdb309cb1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:51.784142 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd1f266-960c-405b-ba68-3eebdb309cb1 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:51.806163 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 467/929] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 16 17:07:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 17:07:51.807332 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd1f266-960c-405b-ba68-3eebdb309cb1 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:51.833161 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 463/930] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 17:07:51 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 17:07:51.857609 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b280d2-f104-4e0f-9e5b-589500ea201f None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:51.920672 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:51.950383 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd1f266-960c-405b-ba68-3eebdb309cb1 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:51.974137 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:51.994360 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b280d2-f104-4e0f-9e5b-589500ea201f None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:51.994535 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069bb601-8334-4ff7-8a37-0d054a99a34a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:51.995564 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069bb601-8334-4ff7-8a37-0d054a99a34a None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:51.995857 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069bb601-8334-4ff7-8a37-0d054a99a34a None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:51.996945 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069bb601-8334-4ff7-8a37-0d054a99a34a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:52.011566 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069bb601-8334-4ff7-8a37-0d054a99a34a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:52.014633 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069bb601-8334-4ff7-8a37-0d054a99a34a None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:52.030540 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application [None req-069bb601-8334-4ff7-8a37-0d054a99a34a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 17:07:52.030540 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:07:52.030540 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:07:52.030540 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:07:52.030540 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:07:52.030540 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:07:52.030540 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:07:52.030540 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:07:52.030540 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:07:52.030540 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:07:52.030540 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:07:52.030540 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:07:52.030540 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 17:07:52.030540 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 17:07:52.030540 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 17:07:52.031530 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 17:07:52.031530 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:07:52.031530 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:07:52.031530 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:07:52.031530 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:07:52.031530 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:07:52.031530 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:07:52.031530 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:07:52.031530 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application with Lock( Jun 16 17:07:52.031530 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:07:52.031530 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:07:52.031530 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:07:52.031530 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:07:52.031530 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:07:52.031530 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:07:52.031530 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:07:52.031530 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:07:52.032438 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 17:07:52.032438 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 17:07:52.032438 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 17:07:52.032438 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 17:07:52.032438 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 17:07:52.032438 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 17:07:52.032438 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 17:07:52.032438 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Jun 16 17:07:52.032438 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 468/931] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 16 17:07:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:07:52.037858 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069bb601-8334-4ff7-8a37-0d054a99a34a None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:52.040293 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64de037a-0683-4cc2-9698-b91db1988513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:52.041523 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64de037a-0683-4cc2-9698-b91db1988513 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:52.041843 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64de037a-0683-4cc2-9698-b91db1988513 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:52.042171 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64de037a-0683-4cc2-9698-b91db1988513 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:52.043739 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64de037a-0683-4cc2-9698-b91db1988513 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:52.045125 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64de037a-0683-4cc2-9698-b91db1988513 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:52.061521 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application [None req-64de037a-0683-4cc2-9698-b91db1988513 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 17:07:52.061521 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:07:52.061521 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 17:07:52.061521 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 17:07:52.061521 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 17:07:52.061521 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 17:07:52.061521 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 17:07:52.061521 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 17:07:52.061521 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 17:07:52.061521 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Jun 16 17:07:52.061521 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 17:07:52.061521 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Jun 16 17:07:52.061521 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:07:52.061521 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:07:52.061521 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:07:52.061521 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:07:52.061521 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:07:52.062903 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:07:52.062903 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:07:52.062903 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:07:52.062903 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:07:52.062903 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:07:52.062903 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:07:52.062903 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 17:07:52.062903 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 17:07:52.062903 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 17:07:52.062903 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 17:07:52.062903 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:07:52.062903 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:07:52.062903 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:07:52.062903 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:07:52.062903 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:07:52.062903 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:07:52.063754 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:07:52.063754 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application with Lock( Jun 16 17:07:52.063754 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:07:52.063754 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:07:52.063754 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:07:52.063754 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:07:52.063754 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:07:52.063754 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:07:52.063754 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:07:52.063754 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:07:52.063754 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 17:07:52.063754 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 17:07:52.063754 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 17:07:52.063754 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Jun 16 17:07:52.064499 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 464/932] 10.222.0.39 () {56 vars in 1126 bytes} [Thu Jun 16 17:07:51 2022] GET /identity/v3/services/object-store => generated 93 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 17:07:52.070049 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64de037a-0683-4cc2-9698-b91db1988513 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:52.161544 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069bb601-8334-4ff7-8a37-0d054a99a34a None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:52.186142 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64de037a-0683-4cc2-9698-b91db1988513 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:52.197216 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:52.206092 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e21865-5ef8-44fa-8b11-efc6063a9634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:52.206787 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e21865-5ef8-44fa-8b11-efc6063a9634 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:52.207050 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e21865-5ef8-44fa-8b11-efc6063a9634 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:52.207313 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e21865-5ef8-44fa-8b11-efc6063a9634 None admin] PATH_INFO: `/v3/projects` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:52.208101 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e21865-5ef8-44fa-8b11-efc6063a9634 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:07:52.208412 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e21865-5ef8-44fa-8b11-efc6063a9634 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:52.209858 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e21865-5ef8-44fa-8b11-efc6063a9634 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:52.221511 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d42e51-b258-4602-aeaa-af74c24bf95d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:52.222226 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d42e51-b258-4602-aeaa-af74c24bf95d None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:52.222515 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d42e51-b258-4602-aeaa-af74c24bf95d None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:52.223254 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 469/933] 10.222.0.39 () {56 vars in 1148 bytes} [Thu Jun 16 17:07:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 17:07:52.224623 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8033a3b-9a10-47f5-ab6b-927326b1e9b3 None None] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:52.224919 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8033a3b-9a10-47f5-ab6b-927326b1e9b3 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:52.225194 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8033a3b-9a10-47f5-ab6b-927326b1e9b3 None None] PATH_INFO: `/` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:52.226616 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 470/934] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 17:07:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:07:52.228007 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d42e51-b258-4602-aeaa-af74c24bf95d None admin] PATH_INFO: `/v3/services` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:52.228991 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d42e51-b258-4602-aeaa-af74c24bf95d None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80873) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:07:52.229335 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d42e51-b258-4602-aeaa-af74c24bf95d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:52.230693 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8033a3b-9a10-47f5-ab6b-927326b1e9b3 None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:52.231028 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d42e51-b258-4602-aeaa-af74c24bf95d None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:52.241289 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 465/935] 10.222.0.39 () {56 vars in 1122 bytes} [Thu Jun 16 17:07:52 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:07:52.242482 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d44cc5-c73e-4ccd-8c8f-8311461cd34c None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:52.242779 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d44cc5-c73e-4ccd-8c8f-8311461cd34c None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:52.243063 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d44cc5-c73e-4ccd-8c8f-8311461cd34c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:52.260897 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-83d44cc5-c73e-4ccd-8c8f-8311461cd34c None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:07:52.262047 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-83d44cc5-c73e-4ccd-8c8f-8311461cd34c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:07:52.265933 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:52.333814 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 466/936] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 17:07:52 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 17:07:52.333814 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d44cc5-c73e-4ccd-8c8f-8311461cd34c None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:52.365134 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8033a3b-9a10-47f5-ab6b-927326b1e9b3 None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:52.403721 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc065b2-1e71-44a2-a411-0b18a802fff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:52.404618 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc065b2-1e71-44a2-a411-0b18a802fff9 None admin] REQUEST_METHOD: `PUT` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:52.404905 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc065b2-1e71-44a2-a411-0b18a802fff9 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:52.405193 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc065b2-1e71-44a2-a411-0b18a802fff9 None admin] PATH_INFO: `/v3/projects/73015da4de1f48c29f57fff1040d2c10/users/f7f35c1c15a84a92863d4f3f96d76830/roles/db26ca9731b944aea5051916653e9ffd` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:52.407496 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc065b2-1e71-44a2-a411-0b18a802fff9 None admin] RBAC: Authorizing `identity:create_grant(project_id=73015da4de1f48c29f57fff1040d2c10, user_id=f7f35c1c15a84a92863d4f3f96d76830, role_id=db26ca9731b944aea5051916653e9ffd)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:52.408935 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc065b2-1e71-44a2-a411-0b18a802fff9 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:52.451119 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d44cc5-c73e-4ccd-8c8f-8311461cd34c None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:52.453725 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:52.492799 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba039dfc-a130-484f-85b7-8f4717276b13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:52.493479 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba039dfc-a130-484f-85b7-8f4717276b13 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:52.493788 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba039dfc-a130-484f-85b7-8f4717276b13 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:52.494080 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba039dfc-a130-484f-85b7-8f4717276b13 None admin] PATH_INFO: `/v3/services` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:52.495867 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba039dfc-a130-484f-85b7-8f4717276b13 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80873) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:07:52.496184 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba039dfc-a130-484f-85b7-8f4717276b13 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:52.497580 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba039dfc-a130-484f-85b7-8f4717276b13 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:52.504329 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 467/937] 10.222.0.39 () {56 vars in 1122 bytes} [Thu Jun 16 17:07:52 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:07:52.505145 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba039dfc-a130-484f-85b7-8f4717276b13 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:52.537858 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 471/938] 10.222.0.39 () {58 vars in 1439 bytes} [Thu Jun 16 17:07:52 2022] PUT /identity/v3/projects/73015da4de1f48c29f57fff1040d2c10/users/f7f35c1c15a84a92863d4f3f96d76830/roles/db26ca9731b944aea5051916653e9ffd => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:07:52.537858 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc065b2-1e71-44a2-a411-0b18a802fff9 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:52.640003 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba039dfc-a130-484f-85b7-8f4717276b13 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:52.669227 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:52.682708 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc065b2-1e71-44a2-a411-0b18a802fff9 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:52.685964 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9450d2c9-eab2-4219-bfd9-aa04883146fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:52.687353 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9450d2c9-eab2-4219-bfd9-aa04883146fe None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:52.689894 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9450d2c9-eab2-4219-bfd9-aa04883146fe None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:52.690331 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9450d2c9-eab2-4219-bfd9-aa04883146fe None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:52.691162 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9450d2c9-eab2-4219-bfd9-aa04883146fe None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:52.695936 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9450d2c9-eab2-4219-bfd9-aa04883146fe None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:52.713467 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application [None req-9450d2c9-eab2-4219-bfd9-aa04883146fe None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 16 17:07:52.713467 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:07:52.713467 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 17:07:52.713467 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 17:07:52.713467 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 17:07:52.713467 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 17:07:52.713467 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 17:07:52.713467 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 17:07:52.713467 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 16 17:07:52.713467 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Jun 16 17:07:52.713467 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 17:07:52.713467 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Jun 16 17:07:52.713467 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:07:52.713467 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:07:52.713467 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:07:52.713467 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:07:52.714521 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:07:52.714521 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:07:52.714521 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:07:52.714521 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:07:52.714521 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:07:52.714521 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:07:52.714521 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:07:52.714521 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 17:07:52.714521 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 17:07:52.714521 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 17:07:52.714521 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 17:07:52.714521 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:07:52.714521 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:07:52.714521 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:07:52.714521 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:07:52.714521 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:07:52.715365 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:07:52.715365 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:07:52.715365 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application with Lock( Jun 16 17:07:52.715365 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:07:52.715365 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:07:52.715365 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:07:52.715365 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:07:52.715365 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:07:52.715365 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:07:52.715365 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:07:52.715365 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:07:52.715365 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 17:07:52.715365 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 17:07:52.715365 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 16 17:07:52.715365 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Jun 16 17:07:52.717236 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 468/939] 10.222.0.39 () {56 vars in 1132 bytes} [Thu Jun 16 17:07:52 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:07:52.723764 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9450d2c9-eab2-4219-bfd9-aa04883146fe None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:52.741665 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519dc699-4cec-440a-9dc5-157c016cf620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:52.742711 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519dc699-4cec-440a-9dc5-157c016cf620 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:52.743029 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519dc699-4cec-440a-9dc5-157c016cf620 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:52.743314 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519dc699-4cec-440a-9dc5-157c016cf620 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:52.744512 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519dc699-4cec-440a-9dc5-157c016cf620 None admin] RBAC: Adding query filter params (interface=public, service_id=0ec349bcec2a4a75abdecc06c1d962a4, region_id=RegionOne) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:07:52.744832 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519dc699-4cec-440a-9dc5-157c016cf620 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:52.746796 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519dc699-4cec-440a-9dc5-157c016cf620 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:52.754407 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 472/940] 10.222.0.39 () {56 vars in 1251 bytes} [Thu Jun 16 17:07:52 2022] GET /identity/v3/endpoints?service_id=0ec349bcec2a4a75abdecc06c1d962a4&interface=public®ion_id=RegionOne => generated 194 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:07:52.760213 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519dc699-4cec-440a-9dc5-157c016cf620 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:52.763501 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:52.840552 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9450d2c9-eab2-4219-bfd9-aa04883146fe None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:52.882233 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a07705-c0f0-4d58-93a3-eab97cf45eef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:52.883347 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a07705-c0f0-4d58-93a3-eab97cf45eef None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:52.883645 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a07705-c0f0-4d58-93a3-eab97cf45eef None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:52.883931 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a07705-c0f0-4d58-93a3-eab97cf45eef None admin] PATH_INFO: `/v3/services` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:52.884689 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a07705-c0f0-4d58-93a3-eab97cf45eef None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80873) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:07:52.885229 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a07705-c0f0-4d58-93a3-eab97cf45eef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:52.887282 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a07705-c0f0-4d58-93a3-eab97cf45eef None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:52.900146 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 469/941] 10.222.0.39 () {56 vars in 1126 bytes} [Thu Jun 16 17:07:52 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 17:07:52.903695 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a07705-c0f0-4d58-93a3-eab97cf45eef None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:52.908978 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519dc699-4cec-440a-9dc5-157c016cf620 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:52.952787 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2d5228-6f97-48f9-9920-e22bf314b67d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:52.953451 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2d5228-6f97-48f9-9920-e22bf314b67d None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:52.953736 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2d5228-6f97-48f9-9920-e22bf314b67d None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:52.954039 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2d5228-6f97-48f9-9920-e22bf314b67d None admin] PATH_INFO: `/v3/services` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:52.954724 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2d5228-6f97-48f9-9920-e22bf314b67d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:52.956083 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2d5228-6f97-48f9-9920-e22bf314b67d None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:52.971388 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 473/942] 10.222.0.39 () {56 vars in 1087 bytes} [Thu Jun 16 17:07:52 2022] GET /identity/v3/services => generated 1497 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 17:07:53.034957 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:53.042319 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a07705-c0f0-4d58-93a3-eab97cf45eef None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:53.083900 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee55bcaa-d810-4177-a470-d3e4ba78dcb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:53.084591 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee55bcaa-d810-4177-a470-d3e4ba78dcb2 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:53.084880 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee55bcaa-d810-4177-a470-d3e4ba78dcb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:53.085161 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee55bcaa-d810-4177-a470-d3e4ba78dcb2 None admin] PATH_INFO: `/v3/services` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:53.085927 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee55bcaa-d810-4177-a470-d3e4ba78dcb2 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80873) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:07:53.086243 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee55bcaa-d810-4177-a470-d3e4ba78dcb2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:53.087645 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee55bcaa-d810-4177-a470-d3e4ba78dcb2 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:53.094627 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 470/943] 10.222.0.39 () {56 vars in 1126 bytes} [Thu Jun 16 17:07:52 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 17:07:53.100139 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2d5228-6f97-48f9-9920-e22bf314b67d None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:53.126124 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:53.222534 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2d5228-6f97-48f9-9920-e22bf314b67d None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:53.258426 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0fd97c-8ae8-46ff-9f15-7d75f2b35483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:53.259090 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0fd97c-8ae8-46ff-9f15-7d75f2b35483 None admin] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:53.259432 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0fd97c-8ae8-46ff-9f15-7d75f2b35483 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:53.260385 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0fd97c-8ae8-46ff-9f15-7d75f2b35483 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:53.261183 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0fd97c-8ae8-46ff-9f15-7d75f2b35483 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:53.262657 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0fd97c-8ae8-46ff-9f15-7d75f2b35483 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:53.398663 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 474/944] 10.222.0.39 () {60 vars in 1144 bytes} [Thu Jun 16 17:07:53 2022] POST /identity/v3/endpoints => generated 347 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:07:54.013547 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a472fb03-b838-43d5-a9d8-b621f7b37ae7 None None] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:54.013921 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a472fb03-b838-43d5-a9d8-b621f7b37ae7 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:54.014143 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a472fb03-b838-43d5-a9d8-b621f7b37ae7 None None] PATH_INFO: `/` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:54.015776 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 471/945] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 17:07:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:07:54.021066 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92e7625-a5c3-4a09-8408-e432c84b2850 None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:54.021365 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92e7625-a5c3-4a09-8408-e432c84b2850 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:54.021647 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92e7625-a5c3-4a09-8408-e432c84b2850 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:54.039911 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-e92e7625-a5c3-4a09-8408-e432c84b2850 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:07:54.041276 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-e92e7625-a5c3-4a09-8408-e432c84b2850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:07:54.116656 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 475/946] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 17:07:54 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 17:07:54.140741 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a472fb03-b838-43d5-a9d8-b621f7b37ae7 None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:54.249914 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a472fb03-b838-43d5-a9d8-b621f7b37ae7 None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:54.296534 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f409fd-9eb3-4fa6-8158-45eb7de4df98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:54.297607 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f409fd-9eb3-4fa6-8158-45eb7de4df98 None admin] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:54.298322 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f409fd-9eb3-4fa6-8158-45eb7de4df98 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:54.298905 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f409fd-9eb3-4fa6-8158-45eb7de4df98 None admin] PATH_INFO: `/v3/projects` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:54.299839 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f409fd-9eb3-4fa6-8158-45eb7de4df98 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:54.301490 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f409fd-9eb3-4fa6-8158-45eb7de4df98 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:54.303133 dv-cinder-837356-2-smb devstack@keystone.service[80873]: WARNING keystone.server.flask.common [None req-12f409fd-9eb3-4fa6-8158-45eb7de4df98 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 16 17:07:54.359546 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.sql.core [None req-12f409fd-9eb3-4fa6-8158-45eb7de4df98 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 16 17:07:54.359546 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 16 17:07:54.359546 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [parameters: {'id': 'ff1dadd5c4984414b6d20a8e51943b62', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 16 17:07:54.359546 dv-cinder-837356-2-smb devstack@keystone.service[80873]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80873) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 16 17:07:54.367936 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application [None req-12f409fd-9eb3-4fa6-8158-45eb7de4df98 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id ff1dadd5c4984414b6d20a8e51943b62.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id ff1dadd5c4984414b6d20a8e51943b62. Jun 16 17:07:54.367936 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:07:54.367936 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 16 17:07:54.367936 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 16 17:07:54.367936 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 16 17:07:54.367936 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 16 17:07:54.367936 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 16 17:07:54.367936 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application result = self._query(query) Jun 16 17:07:54.367936 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 16 17:07:54.367936 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application conn.query(q) Jun 16 17:07:54.367936 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 16 17:07:54.367936 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 16 17:07:54.367936 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 16 17:07:54.368741 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application result.read() Jun 16 17:07:54.368741 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 16 17:07:54.368741 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 16 17:07:54.368741 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 16 17:07:54.368741 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 16 17:07:54.368741 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 16 17:07:54.368741 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 16 17:07:54.368741 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 16 17:07:54.368741 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 16 17:07:54.368741 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 16 17:07:54.368741 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Jun 16 17:07:54.368741 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 16 17:07:54.368741 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Jun 16 17:07:54.368741 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:07:54.368741 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 16 17:07:54.368741 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 16 17:07:54.368741 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jun 16 17:07:54.368741 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return project_ref.to_dict() Jun 16 17:07:54.370817 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 16 17:07:54.370817 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application next(self.gen) Jun 16 17:07:54.370817 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 16 17:07:54.370817 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application yield resource Jun 16 17:07:54.370817 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 16 17:07:54.370817 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application next(self.gen) Jun 16 17:07:54.370817 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 16 17:07:54.370817 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application self.session.rollback() Jun 16 17:07:54.370817 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 16 17:07:54.370817 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application self.force_reraise() Jun 16 17:07:54.370817 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 16 17:07:54.370817 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application raise self.value Jun 16 17:07:54.370817 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 16 17:07:54.370817 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 16 17:07:54.370817 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 16 17:07:54.370817 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application session.commit() Jun 16 17:07:54.370817 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 16 17:07:54.371844 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 16 17:07:54.371844 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 16 17:07:54.371844 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application self._prepare_impl() Jun 16 17:07:54.371844 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 16 17:07:54.371844 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application self.session.flush() Jun 16 17:07:54.371844 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 16 17:07:54.371844 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application self._flush(objects) Jun 16 17:07:54.371844 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 16 17:07:54.371844 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 16 17:07:54.371844 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 16 17:07:54.371844 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application compat.raise_( Jun 16 17:07:54.371844 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 16 17:07:54.371844 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application raise exception Jun 16 17:07:54.371844 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 16 17:07:54.371844 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application flush_context.execute() Jun 16 17:07:54.371844 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 16 17:07:54.371844 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application rec.execute(self) Jun 16 17:07:54.372752 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 16 17:07:54.372752 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 16 17:07:54.372752 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 16 17:07:54.372752 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 16 17:07:54.372752 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 16 17:07:54.372752 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 16 17:07:54.372752 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 16 17:07:54.372752 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 16 17:07:54.372752 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 16 17:07:54.372752 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 16 17:07:54.372752 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 16 17:07:54.372752 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 16 17:07:54.372752 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 16 17:07:54.372752 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 16 17:07:54.372752 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 16 17:07:54.373555 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 16 17:07:54.373555 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 16 17:07:54.373555 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application raise exception Jun 16 17:07:54.373555 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 16 17:07:54.373555 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 16 17:07:54.373555 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 16 17:07:54.373555 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 16 17:07:54.373555 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 16 17:07:54.373555 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application result = self._query(query) Jun 16 17:07:54.373555 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 16 17:07:54.373555 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application conn.query(q) Jun 16 17:07:54.373555 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 16 17:07:54.373555 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 16 17:07:54.373555 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 16 17:07:54.373555 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application result.read() Jun 16 17:07:54.373555 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 16 17:07:54.373555 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 16 17:07:54.376661 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 16 17:07:54.376661 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 16 17:07:54.376661 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 16 17:07:54.376661 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 16 17:07:54.376661 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 16 17:07:54.376661 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 16 17:07:54.376661 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 16 17:07:54.376661 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 16 17:07:54.376661 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application [parameters: {'id': 'ff1dadd5c4984414b6d20a8e51943b62', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 16 17:07:54.376661 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 16 17:07:54.376661 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Jun 16 17:07:54.376661 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 17:07:54.376661 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Jun 16 17:07:54.376661 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:07:54.376661 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jun 16 17:07:54.377491 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jun 16 17:07:54.377491 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 16 17:07:54.377491 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 16 17:07:54.377491 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jun 16 17:07:54.377491 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Jun 16 17:07:54.377491 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 17:07:54.377491 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Jun 16 17:07:54.377491 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:07:54.377491 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:07:54.377491 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:07:54.377491 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:07:54.377491 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:07:54.377491 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:07:54.377491 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:07:54.377491 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:07:54.377491 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:07:54.377491 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:07:54.378445 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:07:54.378445 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jun 16 17:07:54.378445 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jun 16 17:07:54.378445 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:07:54.378445 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:07:54.378445 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jun 16 17:07:54.378445 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application raise exception.Conflict( Jun 16 17:07:54.378445 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id ff1dadd5c4984414b6d20a8e51943b62. Jun 16 17:07:54.378445 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Jun 16 17:07:54.378445 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 472/947] 10.222.0.39 () {60 vars in 1140 bytes} [Thu Jun 16 17:07:54 2022] POST /identity/v3/projects => generated 262 bytes in 237 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:07:54.382909 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92e7625-a5c3-4a09-8408-e432c84b2850 None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:54.385169 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:54.490932 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92e7625-a5c3-4a09-8408-e432c84b2850 None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:54.529899 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12139e21-f09f-4143-abc7-5623a3b1d3e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:54.530703 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12139e21-f09f-4143-abc7-5623a3b1d3e4 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:54.530993 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12139e21-f09f-4143-abc7-5623a3b1d3e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:54.531276 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12139e21-f09f-4143-abc7-5623a3b1d3e4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:54.538419 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12139e21-f09f-4143-abc7-5623a3b1d3e4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:54.539864 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12139e21-f09f-4143-abc7-5623a3b1d3e4 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:54.554291 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application [None req-12139e21-f09f-4143-abc7-5623a3b1d3e4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 17:07:54.554291 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:07:54.554291 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:07:54.554291 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:07:54.554291 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:07:54.554291 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:07:54.554291 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:07:54.554291 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:07:54.554291 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:07:54.554291 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:07:54.554291 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:07:54.554291 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:07:54.554291 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 17:07:54.554291 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 17:07:54.554291 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 17:07:54.555231 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 17:07:54.555231 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:07:54.555231 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:07:54.555231 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:07:54.555231 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:07:54.555231 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:07:54.555231 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:07:54.555231 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:07:54.555231 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application with Lock( Jun 16 17:07:54.555231 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:07:54.555231 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:07:54.555231 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:07:54.555231 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:07:54.555231 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:07:54.555231 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:07:54.555231 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:07:54.555231 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:07:54.557144 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 17:07:54.557144 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 17:07:54.557144 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 17:07:54.557144 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 17:07:54.557144 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 17:07:54.557144 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 17:07:54.557144 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 17:07:54.557144 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Jun 16 17:07:54.557144 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 476/948] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 16 17:07:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:07:54.564310 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f409fd-9eb3-4fa6-8158-45eb7de4df98 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:54.584964 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:54.680511 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f409fd-9eb3-4fa6-8158-45eb7de4df98 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:54.723878 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d218721c-60d1-4505-90bb-97010e7e87a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:54.724643 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d218721c-60d1-4505-90bb-97010e7e87a2 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:54.724977 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d218721c-60d1-4505-90bb-97010e7e87a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:54.725353 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d218721c-60d1-4505-90bb-97010e7e87a2 None admin] PATH_INFO: `/v3/projects` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:54.726341 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d218721c-60d1-4505-90bb-97010e7e87a2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80873) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:07:54.726747 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d218721c-60d1-4505-90bb-97010e7e87a2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:54.729132 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d218721c-60d1-4505-90bb-97010e7e87a2 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:54.750722 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 473/949] 10.222.0.39 () {56 vars in 1112 bytes} [Thu Jun 16 17:07:54 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:07:54.761611 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1701ab-15a9-45fb-b9c5-bb43fefb5ac9 None None] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:54.761963 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1701ab-15a9-45fb-b9c5-bb43fefb5ac9 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:54.762228 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1701ab-15a9-45fb-b9c5-bb43fefb5ac9 None None] PATH_INFO: `/` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:54.763973 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 477/950] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 17:07:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:07:54.769801 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83610ad9-c044-4f77-acde-bfb82b924f5a None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:54.770117 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83610ad9-c044-4f77-acde-bfb82b924f5a None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:54.770386 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83610ad9-c044-4f77-acde-bfb82b924f5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:54.788939 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-83610ad9-c044-4f77-acde-bfb82b924f5a None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:07:54.790554 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-83610ad9-c044-4f77-acde-bfb82b924f5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:07:54.865753 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 474/951] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 17:07:54 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 17:07:54.890343 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1701ab-15a9-45fb-b9c5-bb43fefb5ac9 None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:54.959831 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:55.003753 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1701ab-15a9-45fb-b9c5-bb43fefb5ac9 None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:55.039124 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e381460-6af3-4f8b-9219-f59e0d476093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:55.039943 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e381460-6af3-4f8b-9219-f59e0d476093 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:55.040232 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e381460-6af3-4f8b-9219-f59e0d476093 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:55.040513 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e381460-6af3-4f8b-9219-f59e0d476093 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:55.051762 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e381460-6af3-4f8b-9219-f59e0d476093 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 17:07:55.062422 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application [None req-5e381460-6af3-4f8b-9219-f59e0d476093 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 16 17:07:55.062422 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:07:55.062422 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:07:55.062422 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:07:55.062422 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:07:55.062422 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:07:55.062422 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:07:55.062422 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:07:55.062422 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:07:55.062422 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:07:55.062422 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:07:55.062422 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:07:55.062422 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 17:07:55.062422 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 17:07:55.062422 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 17:07:55.062422 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 17:07:55.064009 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 17:07:55.064009 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 17:07:55.064009 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 17:07:55.064009 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 17:07:55.064009 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:07:55.064009 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:07:55.064009 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:07:55.064009 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:07:55.064009 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:07:55.064009 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:07:55.064009 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:07:55.064009 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application with Lock( Jun 16 17:07:55.064009 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:07:55.064009 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:07:55.064009 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:07:55.064009 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:07:55.064957 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:07:55.064957 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:07:55.064957 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:07:55.064957 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:07:55.064957 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 17:07:55.064957 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 17:07:55.064957 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 17:07:55.064957 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 17:07:55.064957 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 17:07:55.064957 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 17:07:55.064957 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 16 17:07:55.064957 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Jun 16 17:07:55.064957 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 478/952] 10.222.0.39 () {56 vars in 1120 bytes} [Thu Jun 16 17:07:54 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:07:55.070179 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83610ad9-c044-4f77-acde-bfb82b924f5a None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:55.078560 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:55.178449 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83610ad9-c044-4f77-acde-bfb82b924f5a None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:55.214916 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd2cca6-586f-4ac4-ab67-d0afdc3de680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:55.215596 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd2cca6-586f-4ac4-ab67-d0afdc3de680 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:55.215882 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd2cca6-586f-4ac4-ab67-d0afdc3de680 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:55.216155 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd2cca6-586f-4ac4-ab67-d0afdc3de680 None admin] PATH_INFO: `/v3/roles` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:55.216905 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd2cca6-586f-4ac4-ab67-d0afdc3de680 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80873) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:07:55.217266 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd2cca6-586f-4ac4-ab67-d0afdc3de680 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:55.218772 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd2cca6-586f-4ac4-ab67-d0afdc3de680 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:55.228168 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 475/953] 10.222.0.39 () {56 vars in 1115 bytes} [Thu Jun 16 17:07:55 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:07:55.234240 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e381460-6af3-4f8b-9219-f59e0d476093 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:55.350281 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e381460-6af3-4f8b-9219-f59e0d476093 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:55.371761 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3791bbb7-e19a-4169-a2aa-c19c94638acb None None] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:55.372217 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3791bbb7-e19a-4169-a2aa-c19c94638acb None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:55.372597 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3791bbb7-e19a-4169-a2aa-c19c94638acb None None] PATH_INFO: `/` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:55.374434 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 476/954] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 17:07:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 17:07:55.378342 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:55.379824 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beda4425-19af-4be6-b3b8-0656cf2600cd None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:55.380218 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beda4425-19af-4be6-b3b8-0656cf2600cd None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:55.380599 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beda4425-19af-4be6-b3b8-0656cf2600cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:55.391464 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ed90f6-3b5f-4d23-af54-b3555766904e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:55.392272 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ed90f6-3b5f-4d23-af54-b3555766904e None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:55.392565 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ed90f6-3b5f-4d23-af54-b3555766904e None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:55.392850 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ed90f6-3b5f-4d23-af54-b3555766904e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:55.400939 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-beda4425-19af-4be6-b3b8-0656cf2600cd None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:07:55.402309 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-beda4425-19af-4be6-b3b8-0656cf2600cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:07:55.404658 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ed90f6-3b5f-4d23-af54-b3555766904e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:55.406275 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ed90f6-3b5f-4d23-af54-b3555766904e None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:55.424930 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application [None req-f7ed90f6-3b5f-4d23-af54-b3555766904e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:07:55.424930 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:07:55.424930 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:07:55.424930 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:07:55.424930 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:07:55.424930 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:07:55.424930 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:07:55.424930 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:07:55.424930 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:07:55.424930 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:07:55.424930 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:07:55.424930 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:07:55.424930 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 17:07:55.424930 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 17:07:55.424930 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 17:07:55.426023 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 17:07:55.426023 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:07:55.426023 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:07:55.426023 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:07:55.426023 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:07:55.426023 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:07:55.426023 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:07:55.426023 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:07:55.426023 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application with Lock( Jun 16 17:07:55.426023 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:07:55.426023 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:07:55.426023 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:07:55.426023 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:07:55.426023 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:07:55.426023 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:07:55.426023 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:07:55.426023 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:07:55.427147 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 17:07:55.427147 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 17:07:55.427147 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:07:55.427147 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Jun 16 17:07:55.427147 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 479/955] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 17:07:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:07:55.433689 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ed90f6-3b5f-4d23-af54-b3555766904e None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:55.490530 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:55.498528 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 477/956] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 17:07:55 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 17:07:55.522577 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beda4425-19af-4be6-b3b8-0656cf2600cd None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:55.573697 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ed90f6-3b5f-4d23-af54-b3555766904e None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:55.617658 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d21d0f-eb88-4e1b-9cfb-94f987f735a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:55.618286 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d21d0f-eb88-4e1b-9cfb-94f987f735a6 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:55.618574 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d21d0f-eb88-4e1b-9cfb-94f987f735a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:55.619466 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d21d0f-eb88-4e1b-9cfb-94f987f735a6 None admin] PATH_INFO: `/v3/domains` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:55.620763 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d21d0f-eb88-4e1b-9cfb-94f987f735a6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:07:55.621082 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d21d0f-eb88-4e1b-9cfb-94f987f735a6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:55.623029 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d21d0f-eb88-4e1b-9cfb-94f987f735a6 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:55.637076 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beda4425-19af-4be6-b3b8-0656cf2600cd None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:55.638175 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 480/957] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 16 17:07:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 17:07:55.645036 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d21d0f-eb88-4e1b-9cfb-94f987f735a6 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:55.679670 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de40405e-cdff-425f-b867-48743ebf799c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:55.680530 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de40405e-cdff-425f-b867-48743ebf799c None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:55.680816 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de40405e-cdff-425f-b867-48743ebf799c None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:55.681093 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de40405e-cdff-425f-b867-48743ebf799c None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:55.681971 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de40405e-cdff-425f-b867-48743ebf799c None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:55.683402 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de40405e-cdff-425f-b867-48743ebf799c None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:55.692415 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:55.696729 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application [None req-de40405e-cdff-425f-b867-48743ebf799c None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 17:07:55.696729 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:07:55.696729 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 17:07:55.696729 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 17:07:55.696729 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 17:07:55.696729 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 17:07:55.696729 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 17:07:55.696729 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 17:07:55.696729 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 17:07:55.696729 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Jun 16 17:07:55.696729 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 17:07:55.696729 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Jun 16 17:07:55.696729 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:07:55.696729 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:07:55.696729 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:07:55.696729 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:07:55.696729 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:07:55.699798 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:07:55.699798 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:07:55.699798 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:07:55.699798 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:07:55.699798 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:07:55.699798 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:07:55.699798 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 17:07:55.699798 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 17:07:55.699798 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 17:07:55.699798 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 17:07:55.699798 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:07:55.699798 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:07:55.699798 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:07:55.699798 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:07:55.699798 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:07:55.699798 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:07:55.701825 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:07:55.701825 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application with Lock( Jun 16 17:07:55.701825 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:07:55.701825 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:07:55.701825 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:07:55.701825 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:07:55.701825 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:07:55.701825 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:07:55.701825 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:07:55.701825 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:07:55.701825 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 17:07:55.701825 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 17:07:55.701825 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 17:07:55.701825 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Jun 16 17:07:55.710350 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 478/958] 10.222.0.39 () {56 vars in 1126 bytes} [Thu Jun 16 17:07:55 2022] GET /identity/v3/services/object-store => generated 93 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 17:07:55.710350 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de40405e-cdff-425f-b867-48743ebf799c None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:55.777954 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:55.784435 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d21d0f-eb88-4e1b-9cfb-94f987f735a6 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:55.818413 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de40405e-cdff-425f-b867-48743ebf799c None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:55.819407 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7446c01-3a3f-47e6-8af5-3a5cb06824c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:55.820221 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7446c01-3a3f-47e6-8af5-3a5cb06824c7 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:55.820511 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7446c01-3a3f-47e6-8af5-3a5cb06824c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:55.820802 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7446c01-3a3f-47e6-8af5-3a5cb06824c7 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:55.828536 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7446c01-3a3f-47e6-8af5-3a5cb06824c7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:55.830000 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7446c01-3a3f-47e6-8af5-3a5cb06824c7 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:55.845565 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application [None req-d7446c01-3a3f-47e6-8af5-3a5cb06824c7 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 16 17:07:55.845565 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:07:55.845565 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:07:55.845565 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:07:55.845565 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:07:55.845565 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:07:55.845565 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:07:55.845565 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:07:55.845565 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:07:55.845565 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:07:55.845565 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:07:55.845565 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:07:55.845565 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 17:07:55.845565 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 17:07:55.845565 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 17:07:55.845565 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 17:07:55.846707 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:07:55.846707 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:07:55.846707 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 17:07:55.846707 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 17:07:55.846707 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 17:07:55.846707 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 17:07:55.846707 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:07:55.846707 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:07:55.846707 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:07:55.846707 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:07:55.846707 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:07:55.846707 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application with Lock( Jun 16 17:07:55.846707 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:07:55.846707 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:07:55.846707 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:07:55.846707 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:07:55.846707 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:07:55.846707 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:07:55.847737 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:07:55.847737 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:07:55.847737 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 17:07:55.847737 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 17:07:55.847737 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 17:07:55.847737 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 17:07:55.847737 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 17:07:55.847737 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 17:07:55.847737 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 16 17:07:55.847737 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Jun 16 17:07:55.847737 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 481/959] 10.222.0.39 () {56 vars in 1117 bytes} [Thu Jun 16 17:07:55 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 17:07:55.848678 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf58114-a63f-485d-aeb9-eb6c273f28f9 None None] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:55.848971 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf58114-a63f-485d-aeb9-eb6c273f28f9 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:55.849252 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf58114-a63f-485d-aeb9-eb6c273f28f9 None None] PATH_INFO: `/` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:55.850673 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 482/960] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 17:07:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:07:55.855484 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf58114-a63f-485d-aeb9-eb6c273f28f9 None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:55.860960 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f5f276-7367-423d-a311-3ae9cfcf0120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:55.861820 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f5f276-7367-423d-a311-3ae9cfcf0120 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:55.862284 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f5f276-7367-423d-a311-3ae9cfcf0120 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:55.862706 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f5f276-7367-423d-a311-3ae9cfcf0120 None admin] PATH_INFO: `/v3/services` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:55.863558 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f5f276-7367-423d-a311-3ae9cfcf0120 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80873) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:07:55.864108 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f5f276-7367-423d-a311-3ae9cfcf0120 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:55.865603 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f5f276-7367-423d-a311-3ae9cfcf0120 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:55.871856 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 479/961] 10.222.0.39 () {56 vars in 1122 bytes} [Thu Jun 16 17:07:55 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:07:55.877389 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b227b11-c29b-4f88-b729-91228bbd2772 None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:55.877687 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b227b11-c29b-4f88-b729-91228bbd2772 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:55.878011 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b227b11-c29b-4f88-b729-91228bbd2772 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:55.900094 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-7b227b11-c29b-4f88-b729-91228bbd2772 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:07:55.901351 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-7b227b11-c29b-4f88-b729-91228bbd2772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:07:55.961271 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:55.970285 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf58114-a63f-485d-aeb9-eb6c273f28f9 None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:55.982318 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 480/962] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 17:07:55 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 17:07:55.982318 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b227b11-c29b-4f88-b729-91228bbd2772 None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:56.013675 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4b7c53-3ae4-4cbc-b5e2-11d4094b15fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:56.014551 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4b7c53-3ae4-4cbc-b5e2-11d4094b15fa None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:56.014942 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4b7c53-3ae4-4cbc-b5e2-11d4094b15fa None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:56.015223 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4b7c53-3ae4-4cbc-b5e2-11d4094b15fa None admin] PATH_INFO: `/v3/users` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:56.016075 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4b7c53-3ae4-4cbc-b5e2-11d4094b15fa None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:07:56.016387 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4b7c53-3ae4-4cbc-b5e2-11d4094b15fa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:56.017847 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4b7c53-3ae4-4cbc-b5e2-11d4094b15fa None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:56.039277 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 483/963] 10.222.0.39 () {56 vars in 1149 bytes} [Thu Jun 16 17:07:55 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:07:56.040046 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4b7c53-3ae4-4cbc-b5e2-11d4094b15fa None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:56.061029 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:56.112039 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b227b11-c29b-4f88-b729-91228bbd2772 None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:56.144210 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4b7c53-3ae4-4cbc-b5e2-11d4094b15fa None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:56.149296 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7067d5-5ae0-47b6-b570-a729e3bd8680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:56.150533 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7067d5-5ae0-47b6-b570-a729e3bd8680 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:56.150894 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7067d5-5ae0-47b6-b570-a729e3bd8680 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:56.151243 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7067d5-5ae0-47b6-b570-a729e3bd8680 None admin] PATH_INFO: `/v3/services` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:56.151890 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7067d5-5ae0-47b6-b570-a729e3bd8680 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80873) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:07:56.152441 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7067d5-5ae0-47b6-b570-a729e3bd8680 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:56.153564 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7067d5-5ae0-47b6-b570-a729e3bd8680 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:56.163289 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 481/964] 10.222.0.39 () {56 vars in 1122 bytes} [Thu Jun 16 17:07:55 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:07:56.163289 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7067d5-5ae0-47b6-b570-a729e3bd8680 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:56.191268 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601cdb67-237a-4bf4-8d29-4f6b749203f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:56.192530 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601cdb67-237a-4bf4-8d29-4f6b749203f8 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:56.192828 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601cdb67-237a-4bf4-8d29-4f6b749203f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:56.193254 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601cdb67-237a-4bf4-8d29-4f6b749203f8 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:56.193955 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601cdb67-237a-4bf4-8d29-4f6b749203f8 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:56.195325 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601cdb67-237a-4bf4-8d29-4f6b749203f8 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:56.207165 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application [None req-601cdb67-237a-4bf4-8d29-4f6b749203f8 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 16 17:07:56.207165 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:07:56.207165 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 17:07:56.207165 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 17:07:56.207165 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 17:07:56.207165 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 17:07:56.207165 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 17:07:56.207165 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 17:07:56.207165 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 16 17:07:56.207165 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Jun 16 17:07:56.207165 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 17:07:56.207165 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Jun 16 17:07:56.207165 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:07:56.207165 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:07:56.207165 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:07:56.207165 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:07:56.207165 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:07:56.208190 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:07:56.208190 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:07:56.208190 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:07:56.208190 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:07:56.208190 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:07:56.208190 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:07:56.208190 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 17:07:56.208190 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 17:07:56.208190 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 17:07:56.208190 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 17:07:56.208190 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:07:56.208190 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:07:56.208190 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:07:56.208190 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:07:56.208190 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:07:56.208190 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:07:56.209071 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:07:56.209071 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application with Lock( Jun 16 17:07:56.209071 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:07:56.209071 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:07:56.209071 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:07:56.209071 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:07:56.209071 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:07:56.209071 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:07:56.209071 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:07:56.209071 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:07:56.209071 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 17:07:56.209071 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 17:07:56.209071 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 16 17:07:56.209071 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Jun 16 17:07:56.213875 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 484/965] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 16 17:07:56 2022] GET /identity/v3/services/compute => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:07:56.214908 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601cdb67-237a-4bf4-8d29-4f6b749203f8 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:56.237320 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:56.268720 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7067d5-5ae0-47b6-b570-a729e3bd8680 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:56.291855 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:56.307305 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69cb225-a82e-49ec-9680-5a4ae0505440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:56.307971 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69cb225-a82e-49ec-9680-5a4ae0505440 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:56.308257 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69cb225-a82e-49ec-9680-5a4ae0505440 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:56.308540 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69cb225-a82e-49ec-9680-5a4ae0505440 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:56.331644 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601cdb67-237a-4bf4-8d29-4f6b749203f8 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:56.369938 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7444ed-9b7c-4d55-b4f0-c14a1864014f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:56.370607 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7444ed-9b7c-4d55-b4f0-c14a1864014f None admin] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:56.370897 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7444ed-9b7c-4d55-b4f0-c14a1864014f None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:56.371178 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7444ed-9b7c-4d55-b4f0-c14a1864014f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:56.371927 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7444ed-9b7c-4d55-b4f0-c14a1864014f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:56.373411 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7444ed-9b7c-4d55-b4f0-c14a1864014f None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:56.387265 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69cb225-a82e-49ec-9680-5a4ae0505440 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:56.388747 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69cb225-a82e-49ec-9680-5a4ae0505440 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:56.466273 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 485/966] 10.222.0.39 () {60 vars in 1144 bytes} [Thu Jun 16 17:07:56 2022] POST /identity/v3/endpoints => generated 349 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:07:56.475089 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7444ed-9b7c-4d55-b4f0-c14a1864014f None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:56.503374 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 482/967] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 16 17:07:56 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 17:07:56.504302 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69cb225-a82e-49ec-9680-5a4ae0505440 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:56.594448 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:56.614229 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:56.618442 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69cb225-a82e-49ec-9680-5a4ae0505440 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:56.645315 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7444ed-9b7c-4d55-b4f0-c14a1864014f None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:56.670818 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0aa1db-1cd1-4649-94c8-b3efeb6c2916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:56.671194 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0aa1db-1cd1-4649-94c8-b3efeb6c2916 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:56.671459 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0aa1db-1cd1-4649-94c8-b3efeb6c2916 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:56.672244 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0aa1db-1cd1-4649-94c8-b3efeb6c2916 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:56.687474 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0aa1db-1cd1-4649-94c8-b3efeb6c2916 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:56.688920 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0aa1db-1cd1-4649-94c8-b3efeb6c2916 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:56.695396 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638484c9-4681-41b1-b5c8-a6c8c2ad1fcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:56.696345 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638484c9-4681-41b1-b5c8-a6c8c2ad1fcb None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:56.696829 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638484c9-4681-41b1-b5c8-a6c8c2ad1fcb None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:56.697699 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638484c9-4681-41b1-b5c8-a6c8c2ad1fcb None admin] PATH_INFO: `/v3/services` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:56.699343 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638484c9-4681-41b1-b5c8-a6c8c2ad1fcb None admin] RBAC: Adding query filter params (name=compute) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:07:56.699343 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638484c9-4681-41b1-b5c8-a6c8c2ad1fcb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:56.700739 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638484c9-4681-41b1-b5c8-a6c8c2ad1fcb None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:56.707239 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 486/968] 10.222.0.39 () {56 vars in 1112 bytes} [Thu Jun 16 17:07:56 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:07:56.711334 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application [None req-1e0aa1db-1cd1-4649-94c8-b3efeb6c2916 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:07:56.711334 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:07:56.711334 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:07:56.711334 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:07:56.711334 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:07:56.711334 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:07:56.711334 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:07:56.711334 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:07:56.711334 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:07:56.711334 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:07:56.711334 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:07:56.711334 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:07:56.711334 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 17:07:56.711334 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 17:07:56.711334 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 17:07:56.712309 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 17:07:56.712309 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:07:56.712309 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:07:56.712309 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:07:56.712309 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:07:56.712309 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:07:56.712309 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:07:56.712309 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:07:56.712309 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application with Lock( Jun 16 17:07:56.712309 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:07:56.712309 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:07:56.712309 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:07:56.712309 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:07:56.712309 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:07:56.712309 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:07:56.712309 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:07:56.712309 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:07:56.713804 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 17:07:56.713804 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 17:07:56.713804 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:07:56.713804 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Jun 16 17:07:56.713804 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 483/969] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 17:07:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:07:56.720340 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638484c9-4681-41b1-b5c8-a6c8c2ad1fcb None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:56.720472 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0aa1db-1cd1-4649-94c8-b3efeb6c2916 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:56.808192 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:56.848713 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638484c9-4681-41b1-b5c8-a6c8c2ad1fcb None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:56.852966 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0aa1db-1cd1-4649-94c8-b3efeb6c2916 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:56.892682 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:56.897471 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2727998b-8234-4e66-a7e3-b22b02b2afac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:56.898397 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2727998b-8234-4e66-a7e3-b22b02b2afac None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:56.898832 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2727998b-8234-4e66-a7e3-b22b02b2afac None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:56.899261 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2727998b-8234-4e66-a7e3-b22b02b2afac None admin] PATH_INFO: `/v3/domains` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:56.900766 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2727998b-8234-4e66-a7e3-b22b02b2afac None admin] RBAC: Adding query filter params (name=Default) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:07:56.901238 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2727998b-8234-4e66-a7e3-b22b02b2afac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:56.902797 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2727998b-8234-4e66-a7e3-b22b02b2afac None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:56.906370 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc12b42-2fab-4a36-8423-9a4c64116833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:56.907204 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc12b42-2fab-4a36-8423-9a4c64116833 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:56.907590 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc12b42-2fab-4a36-8423-9a4c64116833 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:56.907940 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc12b42-2fab-4a36-8423-9a4c64116833 None admin] PATH_INFO: `/v3/services` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:56.908723 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc12b42-2fab-4a36-8423-9a4c64116833 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80873) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:07:56.909119 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc12b42-2fab-4a36-8423-9a4c64116833 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:56.910654 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc12b42-2fab-4a36-8423-9a4c64116833 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:56.922684 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 487/971] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 16 17:07:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:07:56.924068 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2727998b-8234-4e66-a7e3-b22b02b2afac None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:56.924996 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 484/971] 10.222.0.39 () {56 vars in 1112 bytes} [Thu Jun 16 17:07:56 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 17:07:57.049687 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2727998b-8234-4e66-a7e3-b22b02b2afac None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:57.078868 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372d926b-ed0c-4786-aaf4-55c4f08340b2 None None] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:57.079196 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372d926b-ed0c-4786-aaf4-55c4f08340b2 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:57.079439 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372d926b-ed0c-4786-aaf4-55c4f08340b2 None None] PATH_INFO: `/` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:57.081008 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 485/972] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 17:07:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 17:07:57.090433 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0986bcf-9129-436e-8325-ee86b571f9ba None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:57.090787 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0986bcf-9129-436e-8325-ee86b571f9ba None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:57.091016 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0986bcf-9129-436e-8325-ee86b571f9ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:57.094253 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf66cf21-2eb7-4c2b-9830-9679cf00506f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:57.095364 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf66cf21-2eb7-4c2b-9830-9679cf00506f None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:57.095865 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf66cf21-2eb7-4c2b-9830-9679cf00506f None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:57.096346 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf66cf21-2eb7-4c2b-9830-9679cf00506f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:57.104555 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf66cf21-2eb7-4c2b-9830-9679cf00506f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:57.106374 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf66cf21-2eb7-4c2b-9830-9679cf00506f None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:57.110130 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-d0986bcf-9129-436e-8325-ee86b571f9ba None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:07:57.111346 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-d0986bcf-9129-436e-8325-ee86b571f9ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:07:57.121623 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application [None req-bf66cf21-2eb7-4c2b-9830-9679cf00506f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 17:07:57.121623 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:07:57.121623 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:07:57.121623 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:07:57.121623 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:07:57.121623 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:07:57.121623 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:07:57.121623 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:07:57.121623 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:07:57.121623 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:07:57.121623 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:07:57.121623 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:07:57.121623 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 17:07:57.121623 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 17:07:57.121623 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 17:07:57.122681 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 17:07:57.122681 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:07:57.122681 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:07:57.122681 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:07:57.122681 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:07:57.122681 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:07:57.122681 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:07:57.122681 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:07:57.122681 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application with Lock( Jun 16 17:07:57.122681 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:07:57.122681 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:07:57.122681 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:07:57.122681 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:07:57.122681 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:07:57.122681 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:07:57.122681 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:07:57.122681 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:07:57.123605 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 17:07:57.123605 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 17:07:57.123605 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 17:07:57.123605 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 17:07:57.123605 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 17:07:57.123605 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 17:07:57.123605 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 17:07:57.123605 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Jun 16 17:07:57.123605 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 488/973] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 16 17:07:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:07:57.128490 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf66cf21-2eb7-4c2b-9830-9679cf00506f None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:57.201655 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:57.205976 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 486/974] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 17:07:57 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 17:07:57.224705 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0986bcf-9129-436e-8325-ee86b571f9ba None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:57.261364 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf66cf21-2eb7-4c2b-9830-9679cf00506f None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:57.298548 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:57.310581 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41826451-ad53-447d-a907-4dd43311ff02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:57.311927 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41826451-ad53-447d-a907-4dd43311ff02 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:57.312498 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41826451-ad53-447d-a907-4dd43311ff02 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:57.313284 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41826451-ad53-447d-a907-4dd43311ff02 None admin] PATH_INFO: `/v3/projects` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:57.314393 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41826451-ad53-447d-a907-4dd43311ff02 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:07:57.315706 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41826451-ad53-447d-a907-4dd43311ff02 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:57.316536 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41826451-ad53-447d-a907-4dd43311ff02 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:57.331198 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 489/975] 10.222.0.39 () {56 vars in 1148 bytes} [Thu Jun 16 17:07:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 17:07:57.336672 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41826451-ad53-447d-a907-4dd43311ff02 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:57.343704 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0986bcf-9129-436e-8325-ee86b571f9ba None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:57.388434 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807ea2ea-a56b-432f-a1f5-8c61d6bd34f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:57.389505 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807ea2ea-a56b-432f-a1f5-8c61d6bd34f3 None admin] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:57.390047 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807ea2ea-a56b-432f-a1f5-8c61d6bd34f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:57.390533 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807ea2ea-a56b-432f-a1f5-8c61d6bd34f3 None admin] PATH_INFO: `/v3/users` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:57.391876 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807ea2ea-a56b-432f-a1f5-8c61d6bd34f3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:57.393984 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807ea2ea-a56b-432f-a1f5-8c61d6bd34f3 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:57.438811 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.sql.core [None req-807ea2ea-a56b-432f-a1f5-8c61d6bd34f3 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 16 17:07:57.438811 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 16 17:07:57.438811 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [parameters: {'user_id': 'b67445b3d1f04ad0a8c0d66844f2468b', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 16 17:07:57.438811 dv-cinder-837356-2-smb devstack@keystone.service[80873]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80873) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 16 17:07:57.444672 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41826451-ad53-447d-a907-4dd43311ff02 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:57.447613 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application [None req-807ea2ea-a56b-432f-a1f5-8c61d6bd34f3 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 16 17:07:57.447613 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:07:57.447613 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 16 17:07:57.447613 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 16 17:07:57.447613 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 16 17:07:57.447613 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 16 17:07:57.447613 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 16 17:07:57.447613 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application result = self._query(query) Jun 16 17:07:57.447613 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 16 17:07:57.447613 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application conn.query(q) Jun 16 17:07:57.447613 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 16 17:07:57.447613 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 16 17:07:57.447613 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 16 17:07:57.447613 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application result.read() Jun 16 17:07:57.447613 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 16 17:07:57.448518 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 16 17:07:57.448518 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 16 17:07:57.448518 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 16 17:07:57.448518 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 16 17:07:57.448518 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 16 17:07:57.448518 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 16 17:07:57.448518 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 16 17:07:57.448518 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 16 17:07:57.448518 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Jun 16 17:07:57.448518 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 16 17:07:57.448518 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Jun 16 17:07:57.448518 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:07:57.448518 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 16 17:07:57.448518 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 16 17:07:57.448518 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jun 16 17:07:57.448518 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jun 16 17:07:57.448518 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 16 17:07:57.448518 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application next(self.gen) Jun 16 17:07:57.449482 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 16 17:07:57.449482 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application yield resource Jun 16 17:07:57.449482 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 16 17:07:57.449482 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application next(self.gen) Jun 16 17:07:57.449482 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 16 17:07:57.449482 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application self.session.rollback() Jun 16 17:07:57.449482 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 16 17:07:57.449482 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application self.force_reraise() Jun 16 17:07:57.449482 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 16 17:07:57.449482 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application raise self.value Jun 16 17:07:57.449482 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 16 17:07:57.449482 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 16 17:07:57.449482 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 16 17:07:57.449482 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application session.commit() Jun 16 17:07:57.449482 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 16 17:07:57.449482 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 16 17:07:57.449482 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 16 17:07:57.450420 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application self._prepare_impl() Jun 16 17:07:57.450420 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 16 17:07:57.450420 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application self.session.flush() Jun 16 17:07:57.450420 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 16 17:07:57.450420 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application self._flush(objects) Jun 16 17:07:57.450420 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 16 17:07:57.450420 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 16 17:07:57.450420 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 16 17:07:57.450420 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application compat.raise_( Jun 16 17:07:57.450420 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 16 17:07:57.450420 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application raise exception Jun 16 17:07:57.450420 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 16 17:07:57.450420 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application flush_context.execute() Jun 16 17:07:57.450420 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 16 17:07:57.450420 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application rec.execute(self) Jun 16 17:07:57.450420 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 16 17:07:57.450420 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 16 17:07:57.451325 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 16 17:07:57.451325 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 16 17:07:57.451325 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jun 16 17:07:57.451325 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application result = connection._execute_20( Jun 16 17:07:57.451325 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 16 17:07:57.451325 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 16 17:07:57.451325 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 16 17:07:57.451325 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 16 17:07:57.451325 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 16 17:07:57.451325 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 16 17:07:57.451325 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 16 17:07:57.451325 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 16 17:07:57.451325 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 16 17:07:57.451325 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 16 17:07:57.451325 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 16 17:07:57.451325 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application raise exception Jun 16 17:07:57.452171 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 16 17:07:57.452171 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 16 17:07:57.452171 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 16 17:07:57.452171 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 16 17:07:57.452171 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 16 17:07:57.452171 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application result = self._query(query) Jun 16 17:07:57.452171 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 16 17:07:57.452171 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application conn.query(q) Jun 16 17:07:57.452171 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 16 17:07:57.452171 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 16 17:07:57.452171 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 16 17:07:57.452171 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application result.read() Jun 16 17:07:57.452171 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 16 17:07:57.452171 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 16 17:07:57.452171 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 16 17:07:57.452171 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 16 17:07:57.453026 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 16 17:07:57.453026 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 16 17:07:57.453026 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 16 17:07:57.453026 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 16 17:07:57.453026 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 16 17:07:57.453026 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 16 17:07:57.453026 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application [parameters: {'user_id': 'b67445b3d1f04ad0a8c0d66844f2468b', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 16 17:07:57.453026 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 16 17:07:57.453026 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Jun 16 17:07:57.453026 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 17:07:57.453026 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Jun 16 17:07:57.453026 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:07:57.453026 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:07:57.453026 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:07:57.453026 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:07:57.453854 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:07:57.453854 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:07:57.453854 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:07:57.453854 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:07:57.453854 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:07:57.453854 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:07:57.453854 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:07:57.453854 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jun 16 17:07:57.453854 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jun 16 17:07:57.453854 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:07:57.453854 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:07:57.453854 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 17:07:57.453854 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 17:07:57.453854 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 17:07:57.453854 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 17:07:57.453854 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jun 16 17:07:57.453854 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jun 16 17:07:57.454776 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jun 16 17:07:57.454776 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jun 16 17:07:57.454776 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 16 17:07:57.454776 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 16 17:07:57.454776 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 16 17:07:57.454776 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Jun 16 17:07:57.458228 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 487/976] 10.222.0.39 () {60 vars in 1131 bytes} [Thu Jun 16 17:07:57 2022] POST /identity/v3/users => generated 160 bytes in 234 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jun 16 17:07:57.460366 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:57.464813 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807ea2ea-a56b-432f-a1f5-8c61d6bd34f3 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:57.485187 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2b78a1-a350-4350-b937-eedf66f6f413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:57.486070 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2b78a1-a350-4350-b937-eedf66f6f413 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:57.486567 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2b78a1-a350-4350-b937-eedf66f6f413 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:57.486858 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2b78a1-a350-4350-b937-eedf66f6f413 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:57.488133 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2b78a1-a350-4350-b937-eedf66f6f413 None admin] RBAC: Adding query filter params (role.id=db26ca9731b944aea5051916653e9ffd, scope.project.id=73015da4de1f48c29f57fff1040d2c10, user.id=f7f35c1c15a84a92863d4f3f96d76830) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:07:57.488455 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2b78a1-a350-4350-b937-eedf66f6f413 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:57.490220 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2b78a1-a350-4350-b937-eedf66f6f413 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:57.509953 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 490/977] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jun 16 17:07:57 2022] GET /identity/v3/role_assignments?user.id=f7f35c1c15a84a92863d4f3f96d76830&scope.project.id=73015da4de1f48c29f57fff1040d2c10&role.id=db26ca9731b944aea5051916653e9ffd => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:07:57.613223 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807ea2ea-a56b-432f-a1f5-8c61d6bd34f3 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:57.645265 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:57.655348 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f351eec5-e618-406f-aa7c-7fa72e5346cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:57.659623 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f351eec5-e618-406f-aa7c-7fa72e5346cc None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:57.659623 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f351eec5-e618-406f-aa7c-7fa72e5346cc None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:57.659623 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f351eec5-e618-406f-aa7c-7fa72e5346cc None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:57.667113 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f351eec5-e618-406f-aa7c-7fa72e5346cc None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:57.669006 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f351eec5-e618-406f-aa7c-7fa72e5346cc None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:57.686132 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application [None req-f351eec5-e618-406f-aa7c-7fa72e5346cc None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 16 17:07:57.686132 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:07:57.686132 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:07:57.686132 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:07:57.686132 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:07:57.686132 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:07:57.686132 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:07:57.686132 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:07:57.686132 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:07:57.686132 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:07:57.686132 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:07:57.686132 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:07:57.686132 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 17:07:57.686132 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 17:07:57.686132 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 17:07:57.686132 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 17:07:57.687175 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:07:57.687175 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:07:57.687175 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 17:07:57.687175 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 17:07:57.687175 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 17:07:57.687175 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 17:07:57.687175 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:07:57.687175 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:07:57.687175 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:07:57.687175 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:07:57.687175 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:07:57.687175 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application with Lock( Jun 16 17:07:57.687175 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:07:57.687175 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:07:57.687175 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:07:57.687175 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:07:57.687175 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:07:57.687175 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:07:57.688138 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:07:57.688138 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:07:57.688138 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 17:07:57.688138 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 17:07:57.688138 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 17:07:57.688138 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 17:07:57.688138 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 17:07:57.688138 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 17:07:57.688138 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 16 17:07:57.688138 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Jun 16 17:07:57.688138 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 488/978] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 16 17:07:57 2022] GET /identity/v3/users/cinder => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:07:57.693509 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2b78a1-a350-4350-b937-eedf66f6f413 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:57.805138 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2b78a1-a350-4350-b937-eedf66f6f413 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:57.842172 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7401626f-435b-4baa-92f2-5d8b63cbc8a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:57.843207 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7401626f-435b-4baa-92f2-5d8b63cbc8a7 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:57.843727 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7401626f-435b-4baa-92f2-5d8b63cbc8a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:57.844237 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7401626f-435b-4baa-92f2-5d8b63cbc8a7 None admin] PATH_INFO: `/v3/users` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:57.845275 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7401626f-435b-4baa-92f2-5d8b63cbc8a7 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:07:57.845812 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7401626f-435b-4baa-92f2-5d8b63cbc8a7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:57.847437 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7401626f-435b-4baa-92f2-5d8b63cbc8a7 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:57.886310 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 491/979] 10.222.0.39 () {56 vars in 1101 bytes} [Thu Jun 16 17:07:57 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:07:58.750216 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ced6d91-f907-47ff-afc3-05e52270ab06 None None] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:58.750765 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ced6d91-f907-47ff-afc3-05e52270ab06 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:58.750765 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ced6d91-f907-47ff-afc3-05e52270ab06 None None] PATH_INFO: `/` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:58.755029 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 489/980] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 17:07:58 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:07:58.760740 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6a265a-485d-4d95-8b5e-ec9645ee1a42 None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:58.761152 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6a265a-485d-4d95-8b5e-ec9645ee1a42 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:58.761317 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6a265a-485d-4d95-8b5e-ec9645ee1a42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:58.778610 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-5e6a265a-485d-4d95-8b5e-ec9645ee1a42 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:07:58.779844 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-5e6a265a-485d-4d95-8b5e-ec9645ee1a42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:07:58.808192 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:58.849558 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 492/981] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 17:07:58 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 17:07:58.873256 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ced6d91-f907-47ff-afc3-05e52270ab06 None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:58.982248 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ced6d91-f907-47ff-afc3-05e52270ab06 None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:59.016427 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9923df-574e-4d1e-982f-2d92da2f4f28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:59.017158 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9923df-574e-4d1e-982f-2d92da2f4f28 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:59.017444 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9923df-574e-4d1e-982f-2d92da2f4f28 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:59.017722 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9923df-574e-4d1e-982f-2d92da2f4f28 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:59.018404 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9923df-574e-4d1e-982f-2d92da2f4f28 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:59.019763 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9923df-574e-4d1e-982f-2d92da2f4f28 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:59.031853 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application [None req-6d9923df-574e-4d1e-982f-2d92da2f4f28 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 17:07:59.031853 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:07:59.031853 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 17:07:59.031853 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 17:07:59.031853 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 17:07:59.031853 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 17:07:59.031853 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 17:07:59.031853 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 17:07:59.031853 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 17:07:59.031853 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Jun 16 17:07:59.031853 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 17:07:59.031853 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Jun 16 17:07:59.031853 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:07:59.031853 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:07:59.031853 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:07:59.031853 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:07:59.031853 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:07:59.033210 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:07:59.033210 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:07:59.033210 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:07:59.033210 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:07:59.033210 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:07:59.033210 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:07:59.033210 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 17:07:59.033210 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 17:07:59.033210 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 17:07:59.033210 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 17:07:59.033210 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:07:59.033210 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:07:59.033210 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:07:59.033210 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:07:59.033210 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:07:59.033210 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:07:59.034101 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:07:59.034101 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application with Lock( Jun 16 17:07:59.034101 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:07:59.034101 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:07:59.034101 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:07:59.034101 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:07:59.034101 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:07:59.034101 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:07:59.034101 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:07:59.034101 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:07:59.034101 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 17:07:59.034101 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 17:07:59.034101 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 17:07:59.034101 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Jun 16 17:07:59.034101 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 490/982] 10.222.0.39 () {56 vars in 1126 bytes} [Thu Jun 16 17:07:58 2022] GET /identity/v3/services/object-store => generated 93 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:07:59.039116 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6a265a-485d-4d95-8b5e-ec9645ee1a42 None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:59.148237 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6a265a-485d-4d95-8b5e-ec9645ee1a42 None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:59.154489 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0862b1fe-ca9c-4cfd-8efd-ddc0cc15ac0b None None] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:59.154787 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0862b1fe-ca9c-4cfd-8efd-ddc0cc15ac0b None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:59.155070 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0862b1fe-ca9c-4cfd-8efd-ddc0cc15ac0b None None] PATH_INFO: `/` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:59.156462 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 491/983] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 17:07:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:07:59.161299 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af198b03-5d30-4065-8842-6c75e8663f2e None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:59.161660 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af198b03-5d30-4065-8842-6c75e8663f2e None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:59.162056 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af198b03-5d30-4065-8842-6c75e8663f2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:59.180556 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-af198b03-5d30-4065-8842-6c75e8663f2e None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:07:59.182264 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-af198b03-5d30-4065-8842-6c75e8663f2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:07:59.184177 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd8b761-b2a6-42f9-b6ed-6da3b9aad3d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:59.184849 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd8b761-b2a6-42f9-b6ed-6da3b9aad3d3 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:59.185133 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd8b761-b2a6-42f9-b6ed-6da3b9aad3d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:59.185412 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd8b761-b2a6-42f9-b6ed-6da3b9aad3d3 None admin] PATH_INFO: `/v3/services` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:59.186179 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd8b761-b2a6-42f9-b6ed-6da3b9aad3d3 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:07:59.186490 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd8b761-b2a6-42f9-b6ed-6da3b9aad3d3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:59.187859 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd8b761-b2a6-42f9-b6ed-6da3b9aad3d3 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:59.193797 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 493/984] 10.222.0.39 () {56 vars in 1122 bytes} [Thu Jun 16 17:07:59 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 17:07:59.198594 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd8b761-b2a6-42f9-b6ed-6da3b9aad3d3 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:59.232929 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:59.251519 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:59.277198 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 492/985] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 17:07:59 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 17:07:59.300070 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af198b03-5d30-4065-8842-6c75e8663f2e None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:59.310151 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd8b761-b2a6-42f9-b6ed-6da3b9aad3d3 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:59.358469 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ce7c25-de29-4849-aeba-19df51ad3e86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:59.359149 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ce7c25-de29-4849-aeba-19df51ad3e86 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:59.365383 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ce7c25-de29-4849-aeba-19df51ad3e86 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:59.365383 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ce7c25-de29-4849-aeba-19df51ad3e86 None admin] PATH_INFO: `/v3/services` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:59.365383 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ce7c25-de29-4849-aeba-19df51ad3e86 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:07:59.365383 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ce7c25-de29-4849-aeba-19df51ad3e86 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:59.365383 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ce7c25-de29-4849-aeba-19df51ad3e86 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:59.377028 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 494/986] 10.222.0.39 () {56 vars in 1122 bytes} [Thu Jun 16 17:07:59 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 17:07:59.379180 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ce7c25-de29-4849-aeba-19df51ad3e86 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:59.424428 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af198b03-5d30-4065-8842-6c75e8663f2e None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:59.458955 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4fce91-0a41-4974-94de-a2feaaf43977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:59.459619 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4fce91-0a41-4974-94de-a2feaaf43977 None admin] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:59.459905 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4fce91-0a41-4974-94de-a2feaaf43977 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:59.460183 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4fce91-0a41-4974-94de-a2feaaf43977 None admin] PATH_INFO: `/v3/services` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:59.460910 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4fce91-0a41-4974-94de-a2feaaf43977 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:59.462370 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4fce91-0a41-4974-94de-a2feaaf43977 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:59.480303 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:59.488681 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ce7c25-de29-4849-aeba-19df51ad3e86 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:59.521932 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3c5924-e3a3-4041-bc1d-2fc1d612b918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:59.522583 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3c5924-e3a3-4041-bc1d-2fc1d612b918 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:59.522865 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3c5924-e3a3-4041-bc1d-2fc1d612b918 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:59.523138 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3c5924-e3a3-4041-bc1d-2fc1d612b918 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:59.523923 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3c5924-e3a3-4041-bc1d-2fc1d612b918 None admin] RBAC: Adding query filter params (interface=admin, service_id=0ec349bcec2a4a75abdecc06c1d962a4, region_id=RegionOne) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:07:59.524237 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3c5924-e3a3-4041-bc1d-2fc1d612b918 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:59.525847 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3c5924-e3a3-4041-bc1d-2fc1d612b918 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:59.536702 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 495/987] 10.222.0.39 () {56 vars in 1249 bytes} [Thu Jun 16 17:07:59 2022] GET /identity/v3/endpoints?service_id=0ec349bcec2a4a75abdecc06c1d962a4&interface=admin®ion_id=RegionOne => generated 193 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:07:59.537744 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 493/988] 10.222.0.39 () {60 vars in 1141 bytes} [Thu Jun 16 17:07:59 2022] POST /identity/v3/services => generated 242 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 17:07:59.537900 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3c5924-e3a3-4041-bc1d-2fc1d612b918 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:59.654421 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3c5924-e3a3-4041-bc1d-2fc1d612b918 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:07:59.705279 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b33b8d-de68-4def-918b-32e3df34c5bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:07:59.706008 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b33b8d-de68-4def-918b-32e3df34c5bf None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:59.706303 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b33b8d-de68-4def-918b-32e3df34c5bf None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:59.706588 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b33b8d-de68-4def-918b-32e3df34c5bf None admin] PATH_INFO: `/v3/services` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:59.707298 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b33b8d-de68-4def-918b-32e3df34c5bf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:07:59.708726 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b33b8d-de68-4def-918b-32e3df34c5bf None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:07:59.716120 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 496/989] 10.222.0.39 () {56 vars in 1087 bytes} [Thu Jun 16 17:07:59 2022] GET /identity/v3/services => generated 1727 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 17:07:59.772232 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61715482-acbe-464a-ad38-a6ffc655a80a None None] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:59.772792 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61715482-acbe-464a-ad38-a6ffc655a80a None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:59.772792 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61715482-acbe-464a-ad38-a6ffc655a80a None None] PATH_INFO: `/` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:59.774467 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 494/990] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 17:07:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:07:59.780344 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c12d56-1569-42c7-82a3-92d170e12187 None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:07:59.780854 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c12d56-1569-42c7-82a3-92d170e12187 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:07:59.780960 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c12d56-1569-42c7-82a3-92d170e12187 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:07:59.798672 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-c9c12d56-1569-42c7-82a3-92d170e12187 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:07:59.799812 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-c9c12d56-1569-42c7-82a3-92d170e12187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:07:59.813138 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:07:59.875557 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 497/991] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 17:07:59 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 17:07:59.898723 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61715482-acbe-464a-ad38-a6ffc655a80a None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:07:59.948506 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:08:00.008771 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61715482-acbe-464a-ad38-a6ffc655a80a None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:08:00.044534 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0b75a1-1a05-4abe-b69e-139c3451277d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:08:00.045333 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0b75a1-1a05-4abe-b69e-139c3451277d None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:08:00.045619 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0b75a1-1a05-4abe-b69e-139c3451277d None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:08:00.045932 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0b75a1-1a05-4abe-b69e-139c3451277d None admin] PATH_INFO: `/v3/services/image` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:08:00.046657 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0b75a1-1a05-4abe-b69e-139c3451277d None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:08:00.048022 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0b75a1-1a05-4abe-b69e-139c3451277d None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:08:00.060140 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application [None req-4b0b75a1-1a05-4abe-b69e-139c3451277d None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 16 17:08:00.060140 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:08:00.060140 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 17:08:00.060140 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 17:08:00.060140 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 17:08:00.060140 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 17:08:00.060140 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 17:08:00.060140 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 17:08:00.060140 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 16 17:08:00.060140 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Jun 16 17:08:00.060140 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 17:08:00.060140 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Jun 16 17:08:00.060140 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:08:00.060140 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:08:00.060140 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:08:00.060140 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:08:00.060140 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:08:00.061182 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:08:00.061182 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:08:00.061182 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:08:00.061182 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:08:00.061182 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:08:00.061182 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:08:00.061182 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 17:08:00.061182 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 17:08:00.061182 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 17:08:00.061182 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 17:08:00.061182 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:08:00.061182 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:08:00.061182 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:08:00.061182 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:08:00.061182 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:08:00.061182 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:08:00.062107 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:08:00.062107 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application with Lock( Jun 16 17:08:00.062107 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:08:00.062107 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:08:00.062107 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:08:00.062107 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:08:00.062107 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:08:00.062107 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:08:00.062107 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:08:00.062107 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:08:00.062107 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 17:08:00.062107 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 17:08:00.062107 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 16 17:08:00.062107 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Jun 16 17:08:00.062107 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 495/992] 10.222.0.39 () {56 vars in 1105 bytes} [Thu Jun 16 17:07:59 2022] GET /identity/v3/services/image => generated 86 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:08:00.067190 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c12d56-1569-42c7-82a3-92d170e12187 None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:08:00.171059 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c12d56-1569-42c7-82a3-92d170e12187 None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:08:00.205358 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f263383-3466-4a2a-ba80-10aacd879147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:08:00.207741 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f263383-3466-4a2a-ba80-10aacd879147 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:08:00.207741 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f263383-3466-4a2a-ba80-10aacd879147 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:08:00.207741 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f263383-3466-4a2a-ba80-10aacd879147 None admin] PATH_INFO: `/v3/services` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:08:00.207741 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f263383-3466-4a2a-ba80-10aacd879147 None admin] RBAC: Adding query filter params (name=image) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:08:00.207741 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f263383-3466-4a2a-ba80-10aacd879147 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:08:00.208972 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f263383-3466-4a2a-ba80-10aacd879147 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:08:00.219247 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 498/993] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 17:08:00 2022] GET /identity/v3/services?name=image => generated 122 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:08:00.220833 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0b75a1-1a05-4abe-b69e-139c3451277d None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:08:00.327040 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0b75a1-1a05-4abe-b69e-139c3451277d None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:08:00.334019 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:08:00.361899 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e5a635-f983-49df-8c98-8761cefa0e3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:08:00.362574 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e5a635-f983-49df-8c98-8761cefa0e3f None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:08:00.362861 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e5a635-f983-49df-8c98-8761cefa0e3f None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:08:00.363143 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e5a635-f983-49df-8c98-8761cefa0e3f None admin] PATH_INFO: `/v3/services` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:08:00.363857 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e5a635-f983-49df-8c98-8761cefa0e3f None admin] RBAC: Adding query filter params (type=image) {{(pid=80873) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:08:00.364172 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e5a635-f983-49df-8c98-8761cefa0e3f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:08:00.365531 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e5a635-f983-49df-8c98-8761cefa0e3f None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:08:00.377887 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 496/994] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 17:08:00 2022] GET /identity/v3/services?type=image => generated 122 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:08:01.685316 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5509466-75d1-494e-8273-be2ae8166d61 None None] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:08:01.686011 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5509466-75d1-494e-8273-be2ae8166d61 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:08:01.686011 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5509466-75d1-494e-8273-be2ae8166d61 None None] PATH_INFO: `/` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:08:01.687443 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 499/995] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 17:08:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:08:01.692372 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deab882b-6de9-4069-abf7-73fd37217d3d None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:08:01.692767 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deab882b-6de9-4069-abf7-73fd37217d3d None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:08:01.692954 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deab882b-6de9-4069-abf7-73fd37217d3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:08:01.710102 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-deab882b-6de9-4069-abf7-73fd37217d3d None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:08:01.711274 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-deab882b-6de9-4069-abf7-73fd37217d3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:08:01.784113 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 497/996] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 17:08:01 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 17:08:01.806316 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5509466-75d1-494e-8273-be2ae8166d61 None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:08:01.819465 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:08:01.902875 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cc2232-eb57-40b8-8aaf-6c5decc2605f None None] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:08:01.903181 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cc2232-eb57-40b8-8aaf-6c5decc2605f None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:08:01.903469 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cc2232-eb57-40b8-8aaf-6c5decc2605f None None] PATH_INFO: `/` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:08:01.904856 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 498/997] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 17:08:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:08:01.909591 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6156c8-aa82-4be2-a0e1-8e7c4d649727 None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:08:01.909977 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6156c8-aa82-4be2-a0e1-8e7c4d649727 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:08:01.910265 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6156c8-aa82-4be2-a0e1-8e7c4d649727 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:08:01.926590 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-8d6156c8-aa82-4be2-a0e1-8e7c4d649727 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:08:01.927771 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-8d6156c8-aa82-4be2-a0e1-8e7c4d649727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:08:01.928288 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5509466-75d1-494e-8273-be2ae8166d61 None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:08:01.965672 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971706eb-9eb3-45c1-b179-18b3c7e8df51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:08:01.966786 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971706eb-9eb3-45c1-b179-18b3c7e8df51 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:08:01.967215 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971706eb-9eb3-45c1-b179-18b3c7e8df51 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:08:01.967635 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971706eb-9eb3-45c1-b179-18b3c7e8df51 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:08:01.968524 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971706eb-9eb3-45c1-b179-18b3c7e8df51 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:08:01.970072 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971706eb-9eb3-45c1-b179-18b3c7e8df51 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:08:01.983162 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application [None req-971706eb-9eb3-45c1-b179-18b3c7e8df51 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 16 17:08:01.983162 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:08:01.983162 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 17:08:01.983162 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 17:08:01.983162 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 17:08:01.983162 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 17:08:01.983162 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 17:08:01.983162 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 17:08:01.983162 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 16 17:08:01.983162 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Jun 16 17:08:01.983162 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 17:08:01.983162 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Jun 16 17:08:01.983162 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:08:01.983162 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:08:01.983162 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:08:01.983162 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:08:01.983162 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:08:01.984268 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:08:01.984268 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:08:01.984268 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:08:01.984268 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:08:01.984268 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:08:01.984268 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:08:01.984268 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 17:08:01.984268 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 17:08:01.984268 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 17:08:01.984268 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 17:08:01.984268 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:08:01.984268 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:08:01.984268 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:08:01.984268 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:08:01.984268 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:08:01.984268 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:08:01.985127 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:08:01.985127 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application with Lock( Jun 16 17:08:01.985127 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:08:01.985127 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:08:01.985127 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:08:01.985127 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:08:01.985127 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:08:01.985127 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:08:01.985127 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:08:01.985127 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:08:01.985127 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 17:08:01.985127 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 17:08:01.985127 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 16 17:08:01.985127 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Jun 16 17:08:01.985127 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 500/998] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 16 17:08:01 2022] GET /identity/v3/services/compute => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:08:01.990943 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971706eb-9eb3-45c1-b179-18b3c7e8df51 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:08:02.000668 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 499/999] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 17:08:01 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 17:08:02.023647 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6156c8-aa82-4be2-a0e1-8e7c4d649727 None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:08:02.053943 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:08:02.093511 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:08:02.125671 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971706eb-9eb3-45c1-b179-18b3c7e8df51 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:08:02.130378 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6156c8-aa82-4be2-a0e1-8e7c4d649727 None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:08:02.166348 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d4ca3b-effa-4380-bb95-d5984bff568f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:08:02.166907 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e904186-988d-4991-8fba-59b351d14490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:08:02.167047 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d4ca3b-effa-4380-bb95-d5984bff568f None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:08:02.167294 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d4ca3b-effa-4380-bb95-d5984bff568f None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:08:02.167572 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d4ca3b-effa-4380-bb95-d5984bff568f None admin] PATH_INFO: `/v3/services` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:08:02.167671 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e904186-988d-4991-8fba-59b351d14490 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:08:02.167939 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e904186-988d-4991-8fba-59b351d14490 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:08:02.168216 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e904186-988d-4991-8fba-59b351d14490 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:08:02.168373 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d4ca3b-effa-4380-bb95-d5984bff568f None admin] RBAC: Adding query filter params (name=compute) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:08:02.168660 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d4ca3b-effa-4380-bb95-d5984bff568f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:08:02.168867 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e904186-988d-4991-8fba-59b351d14490 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:08:02.170105 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d4ca3b-effa-4380-bb95-d5984bff568f None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:08:02.170267 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e904186-988d-4991-8fba-59b351d14490 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:08:02.179991 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 501/1000] 10.222.0.39 () {56 vars in 1112 bytes} [Thu Jun 16 17:08:01 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 17:08:02.180645 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d4ca3b-effa-4380-bb95-d5984bff568f None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:08:02.182955 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application [None req-4e904186-988d-4991-8fba-59b351d14490 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 17:08:02.182955 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:08:02.182955 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 17:08:02.182955 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 17:08:02.182955 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 17:08:02.182955 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 17:08:02.182955 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 17:08:02.182955 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 17:08:02.182955 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 17:08:02.182955 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Jun 16 17:08:02.182955 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 17:08:02.182955 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Jun 16 17:08:02.182955 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:08:02.182955 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:08:02.182955 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:08:02.182955 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:08:02.182955 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:08:02.183964 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:08:02.183964 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:08:02.183964 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:08:02.183964 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:08:02.183964 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:08:02.183964 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:08:02.183964 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 17:08:02.183964 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 17:08:02.183964 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 17:08:02.183964 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 17:08:02.183964 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:08:02.183964 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:08:02.183964 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:08:02.183964 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:08:02.183964 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:08:02.183964 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:08:02.184832 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:08:02.184832 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application with Lock( Jun 16 17:08:02.184832 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:08:02.184832 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:08:02.184832 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:08:02.184832 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:08:02.184832 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:08:02.184832 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:08:02.184832 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:08:02.184832 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:08:02.184832 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 17:08:02.184832 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 17:08:02.184832 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 17:08:02.184832 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Jun 16 17:08:02.184832 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 500/1001] 10.222.0.39 () {56 vars in 1126 bytes} [Thu Jun 16 17:08:02 2022] GET /identity/v3/services/object-store => generated 93 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 17:08:02.189885 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e904186-988d-4991-8fba-59b351d14490 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:08:02.287465 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:08:02.293668 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d4ca3b-effa-4380-bb95-d5984bff568f None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:08:02.296791 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e904186-988d-4991-8fba-59b351d14490 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:08:02.331053 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c47a6c0-7e95-49af-9415-a76342b149bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:08:02.331725 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c47a6c0-7e95-49af-9415-a76342b149bc None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:08:02.332013 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c47a6c0-7e95-49af-9415-a76342b149bc None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:08:02.332293 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c47a6c0-7e95-49af-9415-a76342b149bc None admin] PATH_INFO: `/v3/services` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:08:02.333000 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c47a6c0-7e95-49af-9415-a76342b149bc None admin] RBAC: Adding query filter params (type=compute) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:08:02.336054 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c47a6c0-7e95-49af-9415-a76342b149bc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:08:02.336165 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4257be5-adcb-4cf6-b330-ea891d6eb818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:08:02.336260 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c47a6c0-7e95-49af-9415-a76342b149bc None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:08:02.336346 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4257be5-adcb-4cf6-b330-ea891d6eb818 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:08:02.336346 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4257be5-adcb-4cf6-b330-ea891d6eb818 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:08:02.336346 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4257be5-adcb-4cf6-b330-ea891d6eb818 None admin] PATH_INFO: `/v3/services` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:08:02.336677 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4257be5-adcb-4cf6-b330-ea891d6eb818 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80873) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:08:02.336974 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4257be5-adcb-4cf6-b330-ea891d6eb818 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:08:02.338982 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4257be5-adcb-4cf6-b330-ea891d6eb818 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:08:02.340733 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 502/1002] 10.222.0.39 () {56 vars in 1112 bytes} [Thu Jun 16 17:08:02 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:08:02.349162 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 501/1003] 10.222.0.39 () {56 vars in 1122 bytes} [Thu Jun 16 17:08:02 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 17:08:02.349322 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c47a6c0-7e95-49af-9415-a76342b149bc None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:08:02.349705 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:08:02.351150 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4257be5-adcb-4cf6-b330-ea891d6eb818 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:08:02.462780 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c47a6c0-7e95-49af-9415-a76342b149bc None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:08:02.463629 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4257be5-adcb-4cf6-b330-ea891d6eb818 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:08:02.500520 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b463f11b-572c-48ab-9057-4919a96d0dbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:08:02.500765 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c985bd9-81dd-46d3-b43d-7a93ec824c04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:08:02.501191 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b463f11b-572c-48ab-9057-4919a96d0dbb None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:08:02.501293 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c985bd9-81dd-46d3-b43d-7a93ec824c04 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:08:02.501479 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b463f11b-572c-48ab-9057-4919a96d0dbb None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:08:02.501584 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c985bd9-81dd-46d3-b43d-7a93ec824c04 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:08:02.501776 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b463f11b-572c-48ab-9057-4919a96d0dbb None admin] PATH_INFO: `/v3/services` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:08:02.501875 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c985bd9-81dd-46d3-b43d-7a93ec824c04 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:08:02.502493 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b463f11b-572c-48ab-9057-4919a96d0dbb None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80873) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:08:02.502668 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c985bd9-81dd-46d3-b43d-7a93ec824c04 None admin] RBAC: Adding query filter params (interface=public, service_id=0011faf359e8444fb50a41291d7747f0, region_id=RegionOne) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:08:02.502813 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b463f11b-572c-48ab-9057-4919a96d0dbb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:08:02.502989 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c985bd9-81dd-46d3-b43d-7a93ec824c04 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:08:02.504174 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b463f11b-572c-48ab-9057-4919a96d0dbb None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:08:02.504343 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c985bd9-81dd-46d3-b43d-7a93ec824c04 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:08:02.513500 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 502/1004] 10.222.0.39 () {56 vars in 1122 bytes} [Thu Jun 16 17:08:02 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:08:02.513669 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 503/1005] 10.222.0.39 () {56 vars in 1251 bytes} [Thu Jun 16 17:08:02 2022] GET /identity/v3/endpoints?service_id=0011faf359e8444fb50a41291d7747f0&interface=public®ion_id=RegionOne => generated 194 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:08:02.513751 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3aebe4f-8dbe-4014-9a26-b6c533476e86 None None] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:08:02.513751 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3aebe4f-8dbe-4014-9a26-b6c533476e86 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:08:02.513751 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3aebe4f-8dbe-4014-9a26-b6c533476e86 None None] PATH_INFO: `/` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:08:02.513751 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 503/1006] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 17:08:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:08:02.514571 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c985bd9-81dd-46d3-b43d-7a93ec824c04 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:08:02.517190 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3aebe4f-8dbe-4014-9a26-b6c533476e86 None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:08:02.542284 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:08:02.579877 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:08:02.615095 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c985bd9-81dd-46d3-b43d-7a93ec824c04 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:08:02.621975 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3aebe4f-8dbe-4014-9a26-b6c533476e86 None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:08:02.649175 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09959254-a5dd-4bd7-a7cb-a183fa111c66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:08:02.650802 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09959254-a5dd-4bd7-a7cb-a183fa111c66 None admin] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:08:02.650802 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09959254-a5dd-4bd7-a7cb-a183fa111c66 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:08:02.651031 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09959254-a5dd-4bd7-a7cb-a183fa111c66 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:08:02.651737 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09959254-a5dd-4bd7-a7cb-a183fa111c66 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:08:02.653109 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09959254-a5dd-4bd7-a7cb-a183fa111c66 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:08:02.655975 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07460c4-3d02-4a7c-8877-4cfbd2b94b59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:08:02.656638 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07460c4-3d02-4a7c-8877-4cfbd2b94b59 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:08:02.656978 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07460c4-3d02-4a7c-8877-4cfbd2b94b59 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:08:02.657259 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07460c4-3d02-4a7c-8877-4cfbd2b94b59 None admin] PATH_INFO: `/v3/services` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:08:02.657973 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07460c4-3d02-4a7c-8877-4cfbd2b94b59 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:08:02.659312 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07460c4-3d02-4a7c-8877-4cfbd2b94b59 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:08:02.666453 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 504/1007] 10.222.0.39 () {56 vars in 1087 bytes} [Thu Jun 16 17:08:02 2022] GET /identity/v3/services => generated 1727 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:08:02.667646 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee64b54-18ef-4226-9997-7ef6b89c58dc None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:08:02.667939 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee64b54-18ef-4226-9997-7ef6b89c58dc None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:08:02.669653 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee64b54-18ef-4226-9997-7ef6b89c58dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:08:02.686746 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-5ee64b54-18ef-4226-9997-7ef6b89c58dc None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:08:02.687993 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-5ee64b54-18ef-4226-9997-7ef6b89c58dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:08:02.729315 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 504/1008] 10.222.0.39 () {60 vars in 1144 bytes} [Thu Jun 16 17:08:02 2022] POST /identity/v3/endpoints => generated 325 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:08:02.790319 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 505/1009] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 17:08:02 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 17:08:02.814323 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09959254-a5dd-4bd7-a7cb-a183fa111c66 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:08:02.937744 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09959254-a5dd-4bd7-a7cb-a183fa111c66 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:08:02.966061 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:08:02.975293 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6abbef-8728-4d9e-8062-849d3051b025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:08:02.995863 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6abbef-8728-4d9e-8062-849d3051b025 None admin] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:08:02.995863 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6abbef-8728-4d9e-8062-849d3051b025 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:08:02.995863 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6abbef-8728-4d9e-8062-849d3051b025 None admin] PATH_INFO: `/v3/services` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:08:02.995863 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6abbef-8728-4d9e-8062-849d3051b025 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:08:02.995863 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6abbef-8728-4d9e-8062-849d3051b025 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:08:03.106126 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 505/1010] 10.222.0.39 () {60 vars in 1141 bytes} [Thu Jun 16 17:08:02 2022] POST /identity/v3/services => generated 242 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:08:04.883767 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3e42ec-9bf1-4f8a-95df-0c0a66eda884 None None] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:08:04.883767 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3e42ec-9bf1-4f8a-95df-0c0a66eda884 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:08:04.883767 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3e42ec-9bf1-4f8a-95df-0c0a66eda884 None None] PATH_INFO: `/` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:08:04.885030 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 506/1011] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 17:08:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:08:04.891235 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfcfe5f-7bed-4f93-8945-059719e284a5 None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:08:04.891757 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfcfe5f-7bed-4f93-8945-059719e284a5 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:08:04.892032 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfcfe5f-7bed-4f93-8945-059719e284a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:08:04.909867 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-9cfcfe5f-7bed-4f93-8945-059719e284a5 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:08:04.911075 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-9cfcfe5f-7bed-4f93-8945-059719e284a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:08:04.941014 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0990a5-5eff-466e-a452-0916501137ee None None] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:08:04.941323 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0990a5-5eff-466e-a452-0916501137ee None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:08:04.941585 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0990a5-5eff-466e-a452-0916501137ee None None] PATH_INFO: `/` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:08:04.943051 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 507/1012] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 17:08:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:08:04.948595 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aed146-25d7-416e-abb3-be586646e115 None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:08:04.948890 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aed146-25d7-416e-abb3-be586646e115 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:08:04.949180 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aed146-25d7-416e-abb3-be586646e115 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:08:04.966329 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-33aed146-25d7-416e-abb3-be586646e115 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:08:04.967533 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-33aed146-25d7-416e-abb3-be586646e115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:08:04.976752 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:08:04.989245 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 506/1013] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 17:08:04 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 17:08:05.013263 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfcfe5f-7bed-4f93-8945-059719e284a5 None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:08:05.042667 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 508/1014] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 17:08:04 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 17:08:05.065551 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33aed146-25d7-416e-abb3-be586646e115 None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:08:05.122430 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfcfe5f-7bed-4f93-8945-059719e284a5 None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:08:05.137645 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:08:05.161075 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3aa016-3254-432d-89ff-8ac2b94c4104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:08:05.161914 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3aa016-3254-432d-89ff-8ac2b94c4104 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:08:05.162203 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3aa016-3254-432d-89ff-8ac2b94c4104 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:08:05.162484 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3aa016-3254-432d-89ff-8ac2b94c4104 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:08:05.163146 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3aa016-3254-432d-89ff-8ac2b94c4104 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:08:05.164520 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3aa016-3254-432d-89ff-8ac2b94c4104 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:08:05.173646 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33aed146-25d7-416e-abb3-be586646e115 None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:08:05.177461 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application [None req-ba3aa016-3254-432d-89ff-8ac2b94c4104 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 16 17:08:05.177461 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:08:05.177461 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 17:08:05.177461 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 17:08:05.177461 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 17:08:05.177461 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 17:08:05.177461 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 17:08:05.177461 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 17:08:05.177461 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 16 17:08:05.177461 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Jun 16 17:08:05.177461 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 17:08:05.177461 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Jun 16 17:08:05.177461 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:08:05.177461 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:08:05.177461 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:08:05.177461 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:08:05.177461 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:08:05.178737 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:08:05.178737 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:08:05.178737 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:08:05.178737 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:08:05.178737 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:08:05.178737 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:08:05.178737 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 17:08:05.178737 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 17:08:05.178737 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 17:08:05.178737 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 17:08:05.178737 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:08:05.178737 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:08:05.178737 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:08:05.178737 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:08:05.178737 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:08:05.178737 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:08:05.179823 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:08:05.179823 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application with Lock( Jun 16 17:08:05.179823 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:08:05.179823 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:08:05.179823 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:08:05.179823 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:08:05.179823 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:08:05.179823 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:08:05.179823 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:08:05.179823 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:08:05.179823 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 17:08:05.179823 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 17:08:05.179823 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 16 17:08:05.179823 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Jun 16 17:08:05.188433 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 507/1015] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 16 17:08:05 2022] GET /identity/v3/services/compute => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 17:08:05.189595 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3aa016-3254-432d-89ff-8ac2b94c4104 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:08:05.218283 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836c2cf7-e56a-41fe-b6ff-abcd67ec6218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:08:05.219116 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836c2cf7-e56a-41fe-b6ff-abcd67ec6218 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:08:05.219407 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836c2cf7-e56a-41fe-b6ff-abcd67ec6218 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:08:05.219690 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836c2cf7-e56a-41fe-b6ff-abcd67ec6218 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:08:05.220972 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836c2cf7-e56a-41fe-b6ff-abcd67ec6218 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:08:05.222769 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836c2cf7-e56a-41fe-b6ff-abcd67ec6218 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:08:05.224695 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 509/1016] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 17:08:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 17:08:05.231144 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836c2cf7-e56a-41fe-b6ff-abcd67ec6218 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:08:05.245144 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:08:05.305690 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3aa016-3254-432d-89ff-8ac2b94c4104 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:08:05.339576 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836c2cf7-e56a-41fe-b6ff-abcd67ec6218 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:08:05.340335 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f7558b-ac9a-4568-8913-3052c0a2b18a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:08:05.341000 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f7558b-ac9a-4568-8913-3052c0a2b18a None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:08:05.341291 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f7558b-ac9a-4568-8913-3052c0a2b18a None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:08:05.341567 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f7558b-ac9a-4568-8913-3052c0a2b18a None admin] PATH_INFO: `/v3/services` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:08:05.342310 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f7558b-ac9a-4568-8913-3052c0a2b18a None admin] RBAC: Adding query filter params (name=compute) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:08:05.342617 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f7558b-ac9a-4568-8913-3052c0a2b18a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:08:05.344043 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f7558b-ac9a-4568-8913-3052c0a2b18a None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:08:05.349537 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 508/1017] 10.222.0.39 () {56 vars in 1112 bytes} [Thu Jun 16 17:08:05 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:08:05.350772 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bcfe9c-d1d2-41f7-b7a3-11354303fe67 None None] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:08:05.351067 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bcfe9c-d1d2-41f7-b7a3-11354303fe67 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:08:05.351353 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bcfe9c-d1d2-41f7-b7a3-11354303fe67 None None] PATH_INFO: `/` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:08:05.353338 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 509/1018] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 17:08:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:08:05.355652 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bcfe9c-d1d2-41f7-b7a3-11354303fe67 None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:08:05.377753 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70d7745-dc63-4dba-8d55-e91eb098aaf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:08:05.378459 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70d7745-dc63-4dba-8d55-e91eb098aaf7 None admin] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:08:05.378749 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70d7745-dc63-4dba-8d55-e91eb098aaf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:08:05.379034 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70d7745-dc63-4dba-8d55-e91eb098aaf7 None admin] PATH_INFO: `/v3/projects` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:08:05.379760 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70d7745-dc63-4dba-8d55-e91eb098aaf7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:08:05.381187 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70d7745-dc63-4dba-8d55-e91eb098aaf7 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:08:05.402731 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:08:05.460045 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bcfe9c-d1d2-41f7-b7a3-11354303fe67 None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:08:05.471629 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 510/1019] 10.222.0.39 () {60 vars in 1141 bytes} [Thu Jun 16 17:08:05 2022] POST /identity/v3/projects => generated 311 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 17:08:05.474191 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66833732-efd6-484f-9564-e2f391894cf2 None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:08:05.474191 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66833732-efd6-484f-9564-e2f391894cf2 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:08:05.474191 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66833732-efd6-484f-9564-e2f391894cf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:08:05.497086 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a18be99-8892-4c67-a519-87e541c077d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:08:05.497841 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a18be99-8892-4c67-a519-87e541c077d8 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:08:05.498137 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a18be99-8892-4c67-a519-87e541c077d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:08:05.498429 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a18be99-8892-4c67-a519-87e541c077d8 None admin] PATH_INFO: `/v3/services` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:08:05.499230 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a18be99-8892-4c67-a519-87e541c077d8 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:08:05.499555 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a18be99-8892-4c67-a519-87e541c077d8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:08:05.500990 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a18be99-8892-4c67-a519-87e541c077d8 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:08:05.506227 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-66833732-efd6-484f-9564-e2f391894cf2 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:08:05.506766 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 510/1020] 10.222.0.39 () {56 vars in 1112 bytes} [Thu Jun 16 17:08:05 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 17:08:05.507924 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-66833732-efd6-484f-9564-e2f391894cf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:08:05.513206 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a18be99-8892-4c67-a519-87e541c077d8 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:08:05.579078 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:08:05.591636 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 511/1021] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 17:08:05 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 17:08:05.616724 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66833732-efd6-484f-9564-e2f391894cf2 None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:08:05.633200 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a18be99-8892-4c67-a519-87e541c077d8 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:08:05.635787 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:08:05.682798 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e01f7e5-4c7a-48ee-9c0e-d5c187e1a308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:08:05.683724 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e01f7e5-4c7a-48ee-9c0e-d5c187e1a308 None admin] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:08:05.684013 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e01f7e5-4c7a-48ee-9c0e-d5c187e1a308 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:08:05.684292 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e01f7e5-4c7a-48ee-9c0e-d5c187e1a308 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:08:05.685037 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e01f7e5-4c7a-48ee-9c0e-d5c187e1a308 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:08:05.686526 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e01f7e5-4c7a-48ee-9c0e-d5c187e1a308 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:08:05.728437 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66833732-efd6-484f-9564-e2f391894cf2 None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:08:05.759739 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 511/1022] 10.222.0.39 () {60 vars in 1144 bytes} [Thu Jun 16 17:08:05 2022] POST /identity/v3/endpoints => generated 334 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 17:08:05.773489 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f870aa42-ae85-4cc4-a415-5e8f09321d45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:08:05.775014 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f870aa42-ae85-4cc4-a415-5e8f09321d45 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:08:05.775354 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f870aa42-ae85-4cc4-a415-5e8f09321d45 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:08:05.775713 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f870aa42-ae85-4cc4-a415-5e8f09321d45 None admin] PATH_INFO: `/v3/services/image` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:08:05.776490 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f870aa42-ae85-4cc4-a415-5e8f09321d45 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:08:05.777955 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f870aa42-ae85-4cc4-a415-5e8f09321d45 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:08:05.791534 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application [None req-f870aa42-ae85-4cc4-a415-5e8f09321d45 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 16 17:08:05.791534 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:08:05.791534 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 17:08:05.791534 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 17:08:05.791534 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 17:08:05.791534 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 17:08:05.791534 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 17:08:05.791534 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 17:08:05.791534 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 16 17:08:05.791534 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Jun 16 17:08:05.791534 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 17:08:05.791534 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Jun 16 17:08:05.791534 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:08:05.791534 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:08:05.791534 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:08:05.791534 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:08:05.791534 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:08:05.792605 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:08:05.792605 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:08:05.792605 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:08:05.792605 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:08:05.792605 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:08:05.792605 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:08:05.792605 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 17:08:05.792605 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 17:08:05.792605 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 17:08:05.792605 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 17:08:05.792605 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:08:05.792605 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:08:05.792605 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:08:05.792605 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:08:05.792605 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:08:05.792605 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:08:05.793613 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:08:05.793613 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application with Lock( Jun 16 17:08:05.793613 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:08:05.793613 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:08:05.793613 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:08:05.793613 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:08:05.793613 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:08:05.793613 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:08:05.793613 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:08:05.793613 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:08:05.793613 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 17:08:05.793613 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 17:08:05.793613 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 16 17:08:05.793613 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Jun 16 17:08:05.793613 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 512/1023] 10.222.0.39 () {56 vars in 1105 bytes} [Thu Jun 16 17:08:05 2022] GET /identity/v3/services/image => generated 86 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 17:08:05.799198 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e01f7e5-4c7a-48ee-9c0e-d5c187e1a308 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:08:05.926350 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e01f7e5-4c7a-48ee-9c0e-d5c187e1a308 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:08:05.968454 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023d9f8f-9f0a-4de2-af55-6a75683e420b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:08:05.969392 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023d9f8f-9f0a-4de2-af55-6a75683e420b None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:08:05.969682 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023d9f8f-9f0a-4de2-af55-6a75683e420b None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:08:05.970045 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023d9f8f-9f0a-4de2-af55-6a75683e420b None admin] PATH_INFO: `/v3/services` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:08:05.970778 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023d9f8f-9f0a-4de2-af55-6a75683e420b None admin] RBAC: Adding query filter params (name=image) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:08:05.971089 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023d9f8f-9f0a-4de2-af55-6a75683e420b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:08:05.972737 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023d9f8f-9f0a-4de2-af55-6a75683e420b None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:08:05.978765 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 512/1024] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 17:08:05 2022] GET /identity/v3/services?name=image => generated 122 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:08:05.984736 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f870aa42-ae85-4cc4-a415-5e8f09321d45 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:08:06.043479 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:08:06.092899 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f870aa42-ae85-4cc4-a415-5e8f09321d45 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:08:06.129127 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fced6cd-2dad-425e-80a4-e0234ce2907d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:08:06.129866 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fced6cd-2dad-425e-80a4-e0234ce2907d None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:08:06.130144 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fced6cd-2dad-425e-80a4-e0234ce2907d None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:08:06.130393 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fced6cd-2dad-425e-80a4-e0234ce2907d None admin] PATH_INFO: `/v3/services` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:08:06.131103 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fced6cd-2dad-425e-80a4-e0234ce2907d None admin] RBAC: Adding query filter params (type=image) {{(pid=80873) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:08:06.131415 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fced6cd-2dad-425e-80a4-e0234ce2907d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:08:06.132769 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fced6cd-2dad-425e-80a4-e0234ce2907d None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:08:06.138720 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 513/1025] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 17:08:05 2022] GET /identity/v3/services?type=image => generated 350 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:08:06.144641 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023d9f8f-9f0a-4de2-af55-6a75683e420b None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:08:06.171998 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:08:06.249236 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023d9f8f-9f0a-4de2-af55-6a75683e420b None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:08:06.284102 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5a5760-8494-4c8f-9fc8-693a702327e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:08:06.284766 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5a5760-8494-4c8f-9fc8-693a702327e9 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:08:06.285056 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5a5760-8494-4c8f-9fc8-693a702327e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:08:06.285340 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5a5760-8494-4c8f-9fc8-693a702327e9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:08:06.286180 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5a5760-8494-4c8f-9fc8-693a702327e9 None admin] RBAC: Adding query filter params (interface=public, service_id=52bc2d82b5f046eb9a846f0c65bf5d61, region_id=RegionOne) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:08:06.286502 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5a5760-8494-4c8f-9fc8-693a702327e9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:08:06.287880 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5a5760-8494-4c8f-9fc8-693a702327e9 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:08:06.297909 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 513/1026] 10.222.0.39 () {56 vars in 1251 bytes} [Thu Jun 16 17:08:06 2022] GET /identity/v3/endpoints?service_id=52bc2d82b5f046eb9a846f0c65bf5d61&interface=public®ion_id=RegionOne => generated 194 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 17:08:06.299347 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fced6cd-2dad-425e-80a4-e0234ce2907d None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:08:06.404146 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fced6cd-2dad-425e-80a4-e0234ce2907d None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:08:06.421507 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:08:06.439874 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac8a428-1df4-45b1-a9fc-3b4b7b253906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:08:06.440665 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac8a428-1df4-45b1-a9fc-3b4b7b253906 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:08:06.440955 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac8a428-1df4-45b1-a9fc-3b4b7b253906 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:08:06.441237 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac8a428-1df4-45b1-a9fc-3b4b7b253906 None admin] PATH_INFO: `/v3/services` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:08:06.441957 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac8a428-1df4-45b1-a9fc-3b4b7b253906 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:08:06.443364 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac8a428-1df4-45b1-a9fc-3b4b7b253906 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:08:06.457813 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 514/1027] 10.222.0.39 () {56 vars in 1087 bytes} [Thu Jun 16 17:08:06 2022] GET /identity/v3/services => generated 1957 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 17:08:07.684235 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671f1331-4c17-472b-be07-bfcdd0c12c6b None None] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:08:07.684798 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671f1331-4c17-472b-be07-bfcdd0c12c6b None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:08:07.684798 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671f1331-4c17-472b-be07-bfcdd0c12c6b None None] PATH_INFO: `/` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:08:07.686393 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 514/1028] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 17:08:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:08:07.691496 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eba0d1-d439-4f99-8664-196727aac5a4 None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:08:07.691903 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eba0d1-d439-4f99-8664-196727aac5a4 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:08:07.692078 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eba0d1-d439-4f99-8664-196727aac5a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:08:07.708927 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-07eba0d1-d439-4f99-8664-196727aac5a4 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:08:07.710183 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-07eba0d1-d439-4f99-8664-196727aac5a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:08:07.781805 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 515/1029] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 17:08:07 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 17:08:07.810345 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671f1331-4c17-472b-be07-bfcdd0c12c6b None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:08:07.947378 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:08:07.960562 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671f1331-4c17-472b-be07-bfcdd0c12c6b None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:08:07.998638 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6694ec5f-9c0d-4450-9523-8b92401f3792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:08:07.999446 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6694ec5f-9c0d-4450-9523-8b92401f3792 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:08:07.999729 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6694ec5f-9c0d-4450-9523-8b92401f3792 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:08:08.000006 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6694ec5f-9c0d-4450-9523-8b92401f3792 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:08:08.001202 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6694ec5f-9c0d-4450-9523-8b92401f3792 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:08:08.002669 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6694ec5f-9c0d-4450-9523-8b92401f3792 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:08:08.004538 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 515/1030] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 17:08:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:08:08.010822 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07eba0d1-d439-4f99-8664-196727aac5a4 None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:08:08.085615 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2361b498-a1a9-485b-bf99-e483d8d4f3e5 None None] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:08:08.085951 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2361b498-a1a9-485b-bf99-e483d8d4f3e5 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:08:08.086242 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2361b498-a1a9-485b-bf99-e483d8d4f3e5 None None] PATH_INFO: `/` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:08:08.088289 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 516/1031] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 17:08:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:08:08.094001 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70716785-451c-496f-9921-daf302bec4bc None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:08:08.094374 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70716785-451c-496f-9921-daf302bec4bc None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:08:08.094734 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70716785-451c-496f-9921-daf302bec4bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:08:08.112141 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-70716785-451c-496f-9921-daf302bec4bc None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:08:08.113369 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-70716785-451c-496f-9921-daf302bec4bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:08:08.128960 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07eba0d1-d439-4f99-8664-196727aac5a4 None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:08:08.140807 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:08:08.164031 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891a6387-ea67-481d-88cc-034d65b67df1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:08:08.164795 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891a6387-ea67-481d-88cc-034d65b67df1 None admin] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:08:08.165092 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891a6387-ea67-481d-88cc-034d65b67df1 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:08:08.165373 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891a6387-ea67-481d-88cc-034d65b67df1 None admin] PATH_INFO: `/v3/users` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:08:08.166148 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891a6387-ea67-481d-88cc-034d65b67df1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:08:08.167597 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891a6387-ea67-481d-88cc-034d65b67df1 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:08:08.195005 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 517/1032] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 17:08:08 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 17:08:08.219528 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70716785-451c-496f-9921-daf302bec4bc None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:08:08.261793 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 516/1033] 10.222.0.39 () {60 vars in 1132 bytes} [Thu Jun 16 17:08:08 2022] POST /identity/v3/users => generated 285 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:08:08.328181 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:08:08.345862 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70716785-451c-496f-9921-daf302bec4bc None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:08:08.385245 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a70ccd-0a0c-48a2-b67c-a9119937186e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:08:08.386137 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a70ccd-0a0c-48a2-b67c-a9119937186e None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:08:08.386469 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a70ccd-0a0c-48a2-b67c-a9119937186e None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:08:08.386703 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a70ccd-0a0c-48a2-b67c-a9119937186e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:08:08.398893 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a70ccd-0a0c-48a2-b67c-a9119937186e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 17:08:08.407521 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application [None req-d9a70ccd-0a0c-48a2-b67c-a9119937186e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 16 17:08:08.407521 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:08:08.407521 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:08:08.407521 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:08:08.407521 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:08:08.407521 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:08:08.407521 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:08:08.407521 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:08:08.407521 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:08:08.407521 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:08:08.407521 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:08:08.407521 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:08:08.407521 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 17:08:08.407521 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 17:08:08.407521 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 17:08:08.407521 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 17:08:08.408553 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 17:08:08.408553 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 17:08:08.408553 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 17:08:08.408553 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 17:08:08.408553 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:08:08.408553 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:08:08.408553 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:08:08.408553 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:08:08.408553 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:08:08.408553 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:08:08.408553 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:08:08.408553 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application with Lock( Jun 16 17:08:08.408553 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:08:08.408553 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:08:08.408553 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:08:08.408553 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:08:08.409517 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:08:08.409517 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:08:08.409517 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:08:08.409517 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:08:08.409517 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 17:08:08.409517 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 17:08:08.409517 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 17:08:08.409517 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 17:08:08.409517 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 17:08:08.409517 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 17:08:08.409517 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 16 17:08:08.409517 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Jun 16 17:08:08.414110 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 518/1034] 10.222.0.39 () {56 vars in 1120 bytes} [Thu Jun 16 17:08:08 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 17:08:08.415786 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891a6387-ea67-481d-88cc-034d65b67df1 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:08:08.529572 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891a6387-ea67-481d-88cc-034d65b67df1 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:08:08.565796 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4497e254-eae8-4ee2-afdc-59998745e66c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:08:08.566502 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4497e254-eae8-4ee2-afdc-59998745e66c None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:08:08.566788 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4497e254-eae8-4ee2-afdc-59998745e66c None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:08:08.567062 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4497e254-eae8-4ee2-afdc-59998745e66c None admin] PATH_INFO: `/v3/roles` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:08:08.567845 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4497e254-eae8-4ee2-afdc-59998745e66c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80873) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:08:08.568155 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4497e254-eae8-4ee2-afdc-59998745e66c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:08:08.569569 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4497e254-eae8-4ee2-afdc-59998745e66c None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:08:08.579770 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 517/1035] 10.222.0.39 () {56 vars in 1115 bytes} [Thu Jun 16 17:08:08 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 17:08:08.585811 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a70ccd-0a0c-48a2-b67c-a9119937186e None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:08:08.636504 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5a52ad-3374-4c2a-a949-cae6e994d004 None None] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:08:08.636851 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5a52ad-3374-4c2a-a949-cae6e994d004 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:08:08.637098 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5a52ad-3374-4c2a-a949-cae6e994d004 None None] PATH_INFO: `/` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:08:08.638518 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 518/1036] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 17:08:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:08:08.643559 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9381a9-face-4525-b57a-e8304c453e50 None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:08:08.643848 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9381a9-face-4525-b57a-e8304c453e50 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:08:08.644135 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9381a9-face-4525-b57a-e8304c453e50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:08:08.662437 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-6e9381a9-face-4525-b57a-e8304c453e50 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:08:08.663648 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-6e9381a9-face-4525-b57a-e8304c453e50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:08:08.691014 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:08:08.719017 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a70ccd-0a0c-48a2-b67c-a9119937186e None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:08:08.749928 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 519/1037] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 17:08:08 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 17:08:08.758914 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57bdaf8-3569-4996-80cc-ac82206987d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:08:08.759818 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57bdaf8-3569-4996-80cc-ac82206987d5 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:08:08.760184 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57bdaf8-3569-4996-80cc-ac82206987d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:08:08.760541 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57bdaf8-3569-4996-80cc-ac82206987d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:08:08.771435 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9381a9-face-4525-b57a-e8304c453e50 None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:08:08.771941 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57bdaf8-3569-4996-80cc-ac82206987d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:08:08.773402 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57bdaf8-3569-4996-80cc-ac82206987d5 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:08:08.781390 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:08:08.793646 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application [None req-f57bdaf8-3569-4996-80cc-ac82206987d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:08:08.793646 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:08:08.793646 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:08:08.793646 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:08:08.793646 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:08:08.793646 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:08:08.793646 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:08:08.793646 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:08:08.793646 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:08:08.793646 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:08:08.793646 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:08:08.793646 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:08:08.793646 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 17:08:08.793646 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 17:08:08.793646 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 17:08:08.797743 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 17:08:08.797743 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:08:08.797743 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:08:08.797743 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:08:08.797743 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:08:08.797743 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:08:08.797743 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:08:08.797743 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:08:08.797743 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application with Lock( Jun 16 17:08:08.797743 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:08:08.797743 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:08:08.797743 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:08:08.797743 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:08:08.797743 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:08:08.797743 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:08:08.797743 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:08:08.797743 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:08:08.798830 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 17:08:08.798830 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 17:08:08.798830 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:08:08.798830 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Jun 16 17:08:08.798830 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 519/1038] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 17:08:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:08:08.800812 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57bdaf8-3569-4996-80cc-ac82206987d5 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:08:08.892923 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9381a9-face-4525-b57a-e8304c453e50 None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:08:08.920065 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57bdaf8-3569-4996-80cc-ac82206987d5 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:08:08.934758 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf7f493-7e2f-4c4f-81a0-f951d7ad3183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:08:08.935677 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf7f493-7e2f-4c4f-81a0-f951d7ad3183 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:08:08.936040 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf7f493-7e2f-4c4f-81a0-f951d7ad3183 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:08:08.936394 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf7f493-7e2f-4c4f-81a0-f951d7ad3183 None admin] PATH_INFO: `/v3/services/image` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:08:08.937128 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf7f493-7e2f-4c4f-81a0-f951d7ad3183 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:08:08.938622 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf7f493-7e2f-4c4f-81a0-f951d7ad3183 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:08:08.951690 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application [None req-acf7f493-7e2f-4c4f-81a0-f951d7ad3183 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 16 17:08:08.951690 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:08:08.951690 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 17:08:08.951690 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 17:08:08.951690 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 17:08:08.951690 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 17:08:08.951690 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 17:08:08.951690 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 17:08:08.951690 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 16 17:08:08.951690 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Jun 16 17:08:08.951690 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 17:08:08.951690 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Jun 16 17:08:08.951690 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:08:08.951690 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:08:08.951690 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:08:08.951690 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:08:08.951690 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:08:08.952789 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:08:08.952789 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:08:08.952789 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:08:08.952789 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:08:08.952789 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:08:08.952789 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:08:08.952789 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 17:08:08.952789 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 17:08:08.952789 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 17:08:08.952789 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 17:08:08.952789 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:08:08.952789 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:08:08.952789 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:08:08.952789 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:08:08.952789 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:08:08.952789 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:08:08.953669 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:08:08.953669 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application with Lock( Jun 16 17:08:08.953669 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:08:08.953669 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:08:08.953669 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:08:08.953669 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:08:08.953669 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:08:08.953669 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:08:08.953669 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:08:08.953669 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:08:08.953669 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 17:08:08.953669 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 17:08:08.953669 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 16 17:08:08.953669 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Jun 16 17:08:08.953669 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 520/1039] 10.222.0.39 () {56 vars in 1105 bytes} [Thu Jun 16 17:08:08 2022] GET /identity/v3/services/image => generated 86 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 17:08:08.958793 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf7f493-7e2f-4c4f-81a0-f951d7ad3183 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:08:08.960685 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c181d0-42c4-48c4-8ace-0642fb9233cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:08:08.961487 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c181d0-42c4-48c4-8ace-0642fb9233cb None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:08:08.961709 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c181d0-42c4-48c4-8ace-0642fb9233cb None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:08:08.961994 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c181d0-42c4-48c4-8ace-0642fb9233cb None admin] PATH_INFO: `/v3/domains` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:08:08.962796 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c181d0-42c4-48c4-8ace-0642fb9233cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:08:08.963879 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c181d0-42c4-48c4-8ace-0642fb9233cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:08:08.964513 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c181d0-42c4-48c4-8ace-0642fb9233cb None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:08:08.978302 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 520/1040] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 16 17:08:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:08:08.983695 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c181d0-42c4-48c4-8ace-0642fb9233cb None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:08:08.986210 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:08:09.054848 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:08:09.067074 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf7f493-7e2f-4c4f-81a0-f951d7ad3183 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:08:09.106919 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c181d0-42c4-48c4-8ace-0642fb9233cb None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:08:09.108940 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f837cff5-8af2-4d89-89d3-c1350861e7eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:08:09.109631 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f837cff5-8af2-4d89-89d3-c1350861e7eb None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:08:09.109948 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f837cff5-8af2-4d89-89d3-c1350861e7eb None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:08:09.110231 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f837cff5-8af2-4d89-89d3-c1350861e7eb None admin] PATH_INFO: `/v3/services` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:08:09.110948 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f837cff5-8af2-4d89-89d3-c1350861e7eb None admin] RBAC: Adding query filter params (name=image) {{(pid=80873) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:08:09.111262 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f837cff5-8af2-4d89-89d3-c1350861e7eb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:08:09.112621 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f837cff5-8af2-4d89-89d3-c1350861e7eb None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:08:09.118581 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 521/1041] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 17:08:08 2022] GET /identity/v3/services?name=image => generated 122 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 17:08:09.123839 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f837cff5-8af2-4d89-89d3-c1350861e7eb None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:08:09.147922 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9f2a82-70a3-4a74-80fb-4889250d46f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:08:09.148820 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9f2a82-70a3-4a74-80fb-4889250d46f7 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:08:09.149149 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9f2a82-70a3-4a74-80fb-4889250d46f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:08:09.150029 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9f2a82-70a3-4a74-80fb-4889250d46f7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:08:09.158792 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9f2a82-70a3-4a74-80fb-4889250d46f7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:08:09.160246 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9f2a82-70a3-4a74-80fb-4889250d46f7 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:08:09.176483 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application [None req-4d9f2a82-70a3-4a74-80fb-4889250d46f7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 16 17:08:09.176483 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:08:09.176483 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:08:09.176483 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:08:09.176483 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:08:09.176483 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:08:09.176483 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:08:09.176483 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:08:09.176483 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:08:09.176483 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:08:09.176483 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:08:09.176483 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:08:09.176483 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 17:08:09.176483 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 17:08:09.176483 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 17:08:09.176483 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 17:08:09.177477 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:08:09.177477 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:08:09.177477 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 17:08:09.177477 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 17:08:09.177477 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 17:08:09.177477 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 17:08:09.177477 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:08:09.177477 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:08:09.177477 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:08:09.177477 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:08:09.177477 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:08:09.177477 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application with Lock( Jun 16 17:08:09.177477 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:08:09.177477 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:08:09.177477 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:08:09.177477 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:08:09.177477 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:08:09.177477 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:08:09.178902 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:08:09.178902 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:08:09.178902 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 17:08:09.178902 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 17:08:09.178902 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 17:08:09.178902 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 17:08:09.178902 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 17:08:09.178902 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 17:08:09.178902 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 16 17:08:09.178902 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Jun 16 17:08:09.178902 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 521/1042] 10.222.0.39 () {56 vars in 1093 bytes} [Thu Jun 16 17:08:08 2022] GET /identity/v3/users/nova => generated 82 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:08:09.184168 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9f2a82-70a3-4a74-80fb-4889250d46f7 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:08:09.222526 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:08:09.237938 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f837cff5-8af2-4d89-89d3-c1350861e7eb None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:08:09.274132 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082e43d9-86d4-4d4a-a3fa-0c59b80106a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:08:09.275551 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082e43d9-86d4-4d4a-a3fa-0c59b80106a4 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:08:09.275842 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082e43d9-86d4-4d4a-a3fa-0c59b80106a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:08:09.276131 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082e43d9-86d4-4d4a-a3fa-0c59b80106a4 None admin] PATH_INFO: `/v3/services` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:08:09.276845 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082e43d9-86d4-4d4a-a3fa-0c59b80106a4 None admin] RBAC: Adding query filter params (type=image) {{(pid=80873) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:08:09.277160 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082e43d9-86d4-4d4a-a3fa-0c59b80106a4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:08:09.278550 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082e43d9-86d4-4d4a-a3fa-0c59b80106a4 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:08:09.283810 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 522/1043] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 17:08:09 2022] GET /identity/v3/services?type=image => generated 350 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 17:08:09.289209 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082e43d9-86d4-4d4a-a3fa-0c59b80106a4 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:08:09.298481 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9f2a82-70a3-4a74-80fb-4889250d46f7 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:08:09.319885 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:08:09.349688 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e182b78-2436-4bdc-b4cf-4cbb3165c321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:08:09.350399 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e182b78-2436-4bdc-b4cf-4cbb3165c321 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:08:09.350690 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e182b78-2436-4bdc-b4cf-4cbb3165c321 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:08:09.350972 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e182b78-2436-4bdc-b4cf-4cbb3165c321 None admin] PATH_INFO: `/v3/users` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:08:09.351819 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e182b78-2436-4bdc-b4cf-4cbb3165c321 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:08:09.352135 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e182b78-2436-4bdc-b4cf-4cbb3165c321 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:08:09.353965 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e182b78-2436-4bdc-b4cf-4cbb3165c321 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:08:09.433801 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 522/1044] 10.222.0.39 () {56 vars in 1133 bytes} [Thu Jun 16 17:08:09 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 17:08:09.435530 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e182b78-2436-4bdc-b4cf-4cbb3165c321 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:08:09.455106 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082e43d9-86d4-4d4a-a3fa-0c59b80106a4 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:08:09.495207 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a784fe-b4f6-4e1c-9630-5e01646e2b6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:08:09.495880 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a784fe-b4f6-4e1c-9630-5e01646e2b6f None admin] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:08:09.496171 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a784fe-b4f6-4e1c-9630-5e01646e2b6f None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:08:09.496452 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a784fe-b4f6-4e1c-9630-5e01646e2b6f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:08:09.497199 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a784fe-b4f6-4e1c-9630-5e01646e2b6f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:08:09.498600 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a784fe-b4f6-4e1c-9630-5e01646e2b6f None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:08:09.550146 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e182b78-2436-4bdc-b4cf-4cbb3165c321 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:08:09.583681 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bd79f2-3c8e-47b8-903b-4da6b1ff76e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:08:09.584261 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bd79f2-3c8e-47b8-903b-4da6b1ff76e2 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:08:09.584542 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bd79f2-3c8e-47b8-903b-4da6b1ff76e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:08:09.584818 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bd79f2-3c8e-47b8-903b-4da6b1ff76e2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:08:09.599135 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 523/1045] 10.222.0.39 () {60 vars in 1144 bytes} [Thu Jun 16 17:08:09 2022] POST /identity/v3/endpoints => generated 327 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 17:08:09.647537 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:08:09.674733 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bd79f2-3c8e-47b8-903b-4da6b1ff76e2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:08:09.676363 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bd79f2-3c8e-47b8-903b-4da6b1ff76e2 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:08:09.800384 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 523/1046] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 16 17:08:09 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 17:08:09.809657 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a784fe-b4f6-4e1c-9630-5e01646e2b6f None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:08:09.820818 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:08:09.934569 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a784fe-b4f6-4e1c-9630-5e01646e2b6f None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:08:09.970233 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccc8a7b-1a13-4ea0-aac8-c28308b7c5b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:08:09.971036 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccc8a7b-1a13-4ea0-aac8-c28308b7c5b5 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:08:09.971325 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccc8a7b-1a13-4ea0-aac8-c28308b7c5b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:08:09.971605 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccc8a7b-1a13-4ea0-aac8-c28308b7c5b5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:08:09.983607 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccc8a7b-1a13-4ea0-aac8-c28308b7c5b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:08:09.985061 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccc8a7b-1a13-4ea0-aac8-c28308b7c5b5 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:08:10.003392 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application [None req-bccc8a7b-1a13-4ea0-aac8-c28308b7c5b5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:08:10.003392 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:08:10.003392 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:08:10.003392 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:08:10.003392 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:08:10.003392 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:08:10.003392 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:08:10.003392 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:08:10.003392 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:08:10.003392 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:08:10.003392 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:08:10.003392 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:08:10.003392 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 17:08:10.003392 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 17:08:10.003392 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 17:08:10.004356 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 17:08:10.004356 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:08:10.004356 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:08:10.004356 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:08:10.004356 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:08:10.004356 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:08:10.004356 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:08:10.004356 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:08:10.004356 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application with Lock( Jun 16 17:08:10.004356 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:08:10.004356 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:08:10.004356 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:08:10.004356 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:08:10.004356 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:08:10.004356 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:08:10.004356 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:08:10.004356 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:08:10.005280 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 17:08:10.005280 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 17:08:10.005280 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:08:10.005280 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Jun 16 17:08:10.009478 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 524/1047] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 17:08:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:08:10.010673 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bd79f2-3c8e-47b8-903b-4da6b1ff76e2 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:08:10.090828 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:08:10.115022 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bd79f2-3c8e-47b8-903b-4da6b1ff76e2 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:08:10.152675 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10367c1-f0f8-4a4b-bfc4-2831065463d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:08:10.153270 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10367c1-f0f8-4a4b-bfc4-2831065463d6 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:08:10.153561 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10367c1-f0f8-4a4b-bfc4-2831065463d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:08:10.153889 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10367c1-f0f8-4a4b-bfc4-2831065463d6 None admin] PATH_INFO: `/v3/domains` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:08:10.154629 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10367c1-f0f8-4a4b-bfc4-2831065463d6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:08:10.154946 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10367c1-f0f8-4a4b-bfc4-2831065463d6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:08:10.156315 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10367c1-f0f8-4a4b-bfc4-2831065463d6 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:08:10.173329 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 524/1048] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 16 17:08:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:08:10.174738 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccc8a7b-1a13-4ea0-aac8-c28308b7c5b5 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:08:10.235361 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:08:10.280921 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccc8a7b-1a13-4ea0-aac8-c28308b7c5b5 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:08:10.315587 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfb7e08-ff81-4247-a2f9-d02edaaaa17a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:08:10.316380 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfb7e08-ff81-4247-a2f9-d02edaaaa17a None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:08:10.316670 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfb7e08-ff81-4247-a2f9-d02edaaaa17a None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:08:10.316949 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfb7e08-ff81-4247-a2f9-d02edaaaa17a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:08:10.324378 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfb7e08-ff81-4247-a2f9-d02edaaaa17a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:08:10.325847 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfb7e08-ff81-4247-a2f9-d02edaaaa17a None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:08:10.340195 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application [None req-0bfb7e08-ff81-4247-a2f9-d02edaaaa17a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 17:08:10.340195 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:08:10.340195 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:08:10.340195 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:08:10.340195 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:08:10.340195 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:08:10.340195 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:08:10.340195 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:08:10.340195 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:08:10.340195 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:08:10.340195 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:08:10.340195 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:08:10.340195 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 17:08:10.340195 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 17:08:10.340195 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 17:08:10.341149 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 17:08:10.341149 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:08:10.341149 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:08:10.341149 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:08:10.341149 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:08:10.341149 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:08:10.341149 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:08:10.341149 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:08:10.341149 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application with Lock( Jun 16 17:08:10.341149 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:08:10.341149 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:08:10.341149 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:08:10.341149 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:08:10.341149 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:08:10.341149 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:08:10.341149 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:08:10.341149 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:08:10.342108 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 17:08:10.342108 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 17:08:10.342108 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 17:08:10.342108 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 17:08:10.342108 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 17:08:10.342108 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 17:08:10.342108 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 17:08:10.342108 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Jun 16 17:08:10.342108 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 525/1049] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 16 17:08:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:08:10.348665 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10367c1-f0f8-4a4b-bfc4-2831065463d6 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:08:10.452255 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10367c1-f0f8-4a4b-bfc4-2831065463d6 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:08:10.491034 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5715c4-1ab6-41b4-bdb3-15e10ec62681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:08:10.491716 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5715c4-1ab6-41b4-bdb3-15e10ec62681 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:08:10.492067 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5715c4-1ab6-41b4-bdb3-15e10ec62681 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:08:10.492352 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5715c4-1ab6-41b4-bdb3-15e10ec62681 None admin] PATH_INFO: `/v3/projects` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:08:10.493356 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5715c4-1ab6-41b4-bdb3-15e10ec62681 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:08:10.493610 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5715c4-1ab6-41b4-bdb3-15e10ec62681 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:08:10.495087 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5715c4-1ab6-41b4-bdb3-15e10ec62681 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:08:10.498030 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:08:10.514173 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 525/1050] 10.222.0.39 () {56 vars in 1148 bytes} [Thu Jun 16 17:08:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:08:10.515515 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfb7e08-ff81-4247-a2f9-d02edaaaa17a None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:08:10.530101 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537db4a6-42f3-47eb-b16b-b54130010bc7 None None] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:08:10.530788 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537db4a6-42f3-47eb-b16b-b54130010bc7 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:08:10.530788 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537db4a6-42f3-47eb-b16b-b54130010bc7 None None] PATH_INFO: `/` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:08:10.532068 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 526/1051] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 17:08:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 17:08:10.538704 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c81c5cd-2984-4bfa-986c-6e0f912ca4bc None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:08:10.538992 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c81c5cd-2984-4bfa-986c-6e0f912ca4bc None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:08:10.539274 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c81c5cd-2984-4bfa-986c-6e0f912ca4bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:08:10.558059 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-0c81c5cd-2984-4bfa-986c-6e0f912ca4bc None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:08:10.559010 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-0c81c5cd-2984-4bfa-986c-6e0f912ca4bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:08:10.628131 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfb7e08-ff81-4247-a2f9-d02edaaaa17a None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:08:10.632143 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 527/1052] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 17:08:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 17:08:10.642892 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:08:10.656588 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c81c5cd-2984-4bfa-986c-6e0f912ca4bc None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:08:10.663930 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d057535a-bc79-447b-908a-eb43a2a2578e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:08:10.664702 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d057535a-bc79-447b-908a-eb43a2a2578e None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:08:10.665059 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d057535a-bc79-447b-908a-eb43a2a2578e None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:08:10.665408 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d057535a-bc79-447b-908a-eb43a2a2578e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:08:10.666337 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d057535a-bc79-447b-908a-eb43a2a2578e None admin] RBAC: Adding query filter params (role.id=db26ca9731b944aea5051916653e9ffd, scope.project.id=73015da4de1f48c29f57fff1040d2c10, user.id=3d381bb41dea4f1e90c3cf3815ac88dc) {{(pid=80873) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:08:10.666725 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d057535a-bc79-447b-908a-eb43a2a2578e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:08:10.668167 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d057535a-bc79-447b-908a-eb43a2a2578e None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:08:10.674069 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 526/1053] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jun 16 17:08:10 2022] GET /identity/v3/role_assignments?user.id=3d381bb41dea4f1e90c3cf3815ac88dc&scope.project.id=73015da4de1f48c29f57fff1040d2c10&role.id=db26ca9731b944aea5051916653e9ffd => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:08:10.766609 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c81c5cd-2984-4bfa-986c-6e0f912ca4bc None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:08:10.797214 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:08:10.807688 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea740ad6-768b-4c7f-ac4d-caa55cf3727e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:08:10.813054 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea740ad6-768b-4c7f-ac4d-caa55cf3727e None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:08:10.813054 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea740ad6-768b-4c7f-ac4d-caa55cf3727e None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:08:10.813054 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea740ad6-768b-4c7f-ac4d-caa55cf3727e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:08:10.820635 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea740ad6-768b-4c7f-ac4d-caa55cf3727e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 17:08:10.828830 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application [None req-ea740ad6-768b-4c7f-ac4d-caa55cf3727e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 17:08:10.828830 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:08:10.828830 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:08:10.828830 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:08:10.828830 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:08:10.828830 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:08:10.828830 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:08:10.828830 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:08:10.828830 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:08:10.828830 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:08:10.828830 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:08:10.828830 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:08:10.828830 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 17:08:10.828830 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 17:08:10.828830 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 17:08:10.828830 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 17:08:10.829890 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 17:08:10.829890 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 17:08:10.829890 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 17:08:10.829890 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 17:08:10.829890 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:08:10.829890 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:08:10.829890 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:08:10.829890 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:08:10.829890 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:08:10.829890 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:08:10.829890 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:08:10.829890 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application with Lock( Jun 16 17:08:10.829890 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:08:10.829890 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:08:10.829890 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:08:10.829890 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:08:10.830803 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:08:10.830803 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:08:10.830803 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:08:10.830803 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:08:10.830803 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 17:08:10.830803 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 17:08:10.830803 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 17:08:10.830803 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 17:08:10.830803 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 17:08:10.830803 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 17:08:10.830803 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 17:08:10.830803 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Jun 16 17:08:10.834115 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 528/1054] 10.222.0.39 () {56 vars in 1096 bytes} [Thu Jun 16 17:08:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 17:08:10.836161 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d057535a-bc79-447b-908a-eb43a2a2578e None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:08:10.949203 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d057535a-bc79-447b-908a-eb43a2a2578e None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:08:10.983594 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdcd82d-be6c-4948-8299-b3a4781d0c82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:08:10.984258 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdcd82d-be6c-4948-8299-b3a4781d0c82 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:08:10.984542 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdcd82d-be6c-4948-8299-b3a4781d0c82 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:08:10.984827 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdcd82d-be6c-4948-8299-b3a4781d0c82 None admin] PATH_INFO: `/v3/roles` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:08:10.985566 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdcd82d-be6c-4948-8299-b3a4781d0c82 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80873) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:08:10.985907 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdcd82d-be6c-4948-8299-b3a4781d0c82 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:08:10.987311 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdcd82d-be6c-4948-8299-b3a4781d0c82 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:08:10.996968 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 527/1055] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 16 17:08:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:08:11.001730 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea740ad6-768b-4c7f-ac4d-caa55cf3727e None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:08:11.101348 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea740ad6-768b-4c7f-ac4d-caa55cf3727e None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:08:11.139619 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b72eac-6501-408c-957b-5677d62977d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:08:11.144652 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b72eac-6501-408c-957b-5677d62977d2 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:08:11.146056 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b72eac-6501-408c-957b-5677d62977d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:08:11.146356 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b72eac-6501-408c-957b-5677d62977d2 None admin] PATH_INFO: `/v3/users/869b8f20c7c64d8086429dbd4caeff60` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:08:11.161574 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b72eac-6501-408c-957b-5677d62977d2 None admin] RBAC: Authorizing `identity:get_user(user_id=869b8f20c7c64d8086429dbd4caeff60)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:08:11.163058 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b72eac-6501-408c-957b-5677d62977d2 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:08:11.165404 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 529/1056] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jun 16 17:08:11 2022] GET /identity/v3/users/869b8f20c7c64d8086429dbd4caeff60 => generated 285 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 17:08:11.171053 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdcd82d-be6c-4948-8299-b3a4781d0c82 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:08:11.215068 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:08:11.276044 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdcd82d-be6c-4948-8299-b3a4781d0c82 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:08:11.310720 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717784e1-8d8f-4f9e-a755-4dc8f28d09db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:08:11.311381 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717784e1-8d8f-4f9e-a755-4dc8f28d09db None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:08:11.311667 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717784e1-8d8f-4f9e-a755-4dc8f28d09db None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:08:11.311946 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717784e1-8d8f-4f9e-a755-4dc8f28d09db None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:08:11.401140 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717784e1-8d8f-4f9e-a755-4dc8f28d09db None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:08:11.402629 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717784e1-8d8f-4f9e-a755-4dc8f28d09db None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:08:11.456511 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:08:11.530868 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 528/1057] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 16 17:08:11 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 17:08:11.536446 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b72eac-6501-408c-957b-5677d62977d2 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:08:11.584864 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:08:11.641921 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b72eac-6501-408c-957b-5677d62977d2 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:08:11.676172 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2331309-f628-44d1-ac9c-1ffdf224c36b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:08:11.676957 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2331309-f628-44d1-ac9c-1ffdf224c36b None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:08:11.677250 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2331309-f628-44d1-ac9c-1ffdf224c36b None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:08:11.677537 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2331309-f628-44d1-ac9c-1ffdf224c36b None admin] PATH_INFO: `/v3/projects/b4b3ecfc998f43e8897ed07279f5229f` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:08:11.678759 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2331309-f628-44d1-ac9c-1ffdf224c36b None admin] RBAC: Authorizing `identity:get_project(project_id=b4b3ecfc998f43e8897ed07279f5229f)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:08:11.680751 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2331309-f628-44d1-ac9c-1ffdf224c36b None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:08:11.682708 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 530/1058] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 16 17:08:11 2022] GET /identity/v3/projects/b4b3ecfc998f43e8897ed07279f5229f => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:08:11.688542 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717784e1-8d8f-4f9e-a755-4dc8f28d09db None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:08:11.808769 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717784e1-8d8f-4f9e-a755-4dc8f28d09db None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:08:11.851451 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcbadcb-502e-45c8-86b2-e884aca3bbfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:08:11.852720 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcbadcb-502e-45c8-86b2-e884aca3bbfd None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:08:11.853028 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcbadcb-502e-45c8-86b2-e884aca3bbfd None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:08:11.853254 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcbadcb-502e-45c8-86b2-e884aca3bbfd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:08:11.854117 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcbadcb-502e-45c8-86b2-e884aca3bbfd None admin] RBAC: Adding query filter params (role.id=dba744f8ab2a4c45b9d3212f8d203aba, scope.project.id=b4b3ecfc998f43e8897ed07279f5229f, user.id=869b8f20c7c64d8086429dbd4caeff60) {{(pid=80873) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:08:11.854435 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcbadcb-502e-45c8-86b2-e884aca3bbfd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:08:11.855874 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcbadcb-502e-45c8-86b2-e884aca3bbfd None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:08:11.862048 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 529/1059] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jun 16 17:08:11 2022] GET /identity/v3/role_assignments?user.id=869b8f20c7c64d8086429dbd4caeff60&scope.project.id=b4b3ecfc998f43e8897ed07279f5229f&role.id=dba744f8ab2a4c45b9d3212f8d203aba => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:08:11.863920 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e9bd54-f991-4120-a235-6d23b7e5bcd3 None None] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:08:11.864376 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e9bd54-f991-4120-a235-6d23b7e5bcd3 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:08:11.864514 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e9bd54-f991-4120-a235-6d23b7e5bcd3 None None] PATH_INFO: `/` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:08:11.869904 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 531/1060] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 17:08:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:08:11.872036 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de565074-406f-46bb-bdd4-ba4bb55a1811 None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:08:11.872325 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de565074-406f-46bb-bdd4-ba4bb55a1811 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:08:11.872607 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de565074-406f-46bb-bdd4-ba4bb55a1811 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:08:11.889190 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:08:11.900971 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-de565074-406f-46bb-bdd4-ba4bb55a1811 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:08:11.902276 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-de565074-406f-46bb-bdd4-ba4bb55a1811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:08:11.982257 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 530/1061] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 17:08:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 17:08:12.004293 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e9bd54-f991-4120-a235-6d23b7e5bcd3 None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:08:12.113985 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e9bd54-f991-4120-a235-6d23b7e5bcd3 None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:08:12.127165 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:08:12.148046 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77a4787-99c5-40a6-9998-2af8ecc2857a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:08:12.148688 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77a4787-99c5-40a6-9998-2af8ecc2857a None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:08:12.149862 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77a4787-99c5-40a6-9998-2af8ecc2857a None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:08:12.149862 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77a4787-99c5-40a6-9998-2af8ecc2857a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:08:12.225129 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77a4787-99c5-40a6-9998-2af8ecc2857a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:08:12.226595 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77a4787-99c5-40a6-9998-2af8ecc2857a None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:08:12.337229 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 532/1062] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 16 17:08:12 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 17:08:12.338732 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de565074-406f-46bb-bdd4-ba4bb55a1811 None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:08:12.454775 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de565074-406f-46bb-bdd4-ba4bb55a1811 None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:08:12.489379 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d105cc00-a192-4466-9406-8c824836e9a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:08:12.490202 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d105cc00-a192-4466-9406-8c824836e9a4 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:08:12.490486 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d105cc00-a192-4466-9406-8c824836e9a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:08:12.490760 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d105cc00-a192-4466-9406-8c824836e9a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:08:12.493502 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:08:12.502132 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d105cc00-a192-4466-9406-8c824836e9a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:08:12.503558 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d105cc00-a192-4466-9406-8c824836e9a4 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:08:12.521181 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application [None req-d105cc00-a192-4466-9406-8c824836e9a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:08:12.521181 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:08:12.521181 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:08:12.521181 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:08:12.521181 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:08:12.521181 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:08:12.521181 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:08:12.521181 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:08:12.521181 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:08:12.521181 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:08:12.521181 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:08:12.521181 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:08:12.521181 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 17:08:12.521181 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 17:08:12.521181 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 17:08:12.522168 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 17:08:12.522168 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:08:12.522168 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:08:12.522168 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:08:12.522168 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:08:12.522168 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:08:12.522168 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:08:12.522168 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:08:12.522168 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application with Lock( Jun 16 17:08:12.522168 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:08:12.522168 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:08:12.522168 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:08:12.522168 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:08:12.522168 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:08:12.522168 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:08:12.522168 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:08:12.522168 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:08:12.528428 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 17:08:12.528428 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 17:08:12.528428 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:08:12.528428 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Jun 16 17:08:12.528428 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 531/1063] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 17:08:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:08:12.528728 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77a4787-99c5-40a6-9998-2af8ecc2857a None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:08:12.542751 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:08:12.631205 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77a4787-99c5-40a6-9998-2af8ecc2857a None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:08:12.666353 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7f64f2-1e60-4c9b-a188-17e53f64e7c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:08:12.667025 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7f64f2-1e60-4c9b-a188-17e53f64e7c3 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:08:12.667308 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7f64f2-1e60-4c9b-a188-17e53f64e7c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:08:12.667581 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7f64f2-1e60-4c9b-a188-17e53f64e7c3 None admin] PATH_INFO: `/v3/domains` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:08:12.668299 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7f64f2-1e60-4c9b-a188-17e53f64e7c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:08:12.668608 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7f64f2-1e60-4c9b-a188-17e53f64e7c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:08:12.669987 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7f64f2-1e60-4c9b-a188-17e53f64e7c3 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:08:12.686383 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 533/1064] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 16 17:08:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:08:12.829930 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d1ea36-8f81-49fb-9ac3-67bc1eb1f5ce None None] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:08:12.830287 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d1ea36-8f81-49fb-9ac3-67bc1eb1f5ce None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:08:12.830502 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d1ea36-8f81-49fb-9ac3-67bc1eb1f5ce None None] PATH_INFO: `/` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:08:12.832069 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 532/1065] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 17:08:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:08:12.837719 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1300a3a3-8a08-42d8-aab1-dbe7f99dab08 None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:08:12.838058 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1300a3a3-8a08-42d8-aab1-dbe7f99dab08 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:08:12.838354 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1300a3a3-8a08-42d8-aab1-dbe7f99dab08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:08:12.856812 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-1300a3a3-8a08-42d8-aab1-dbe7f99dab08 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:08:12.858173 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-1300a3a3-8a08-42d8-aab1-dbe7f99dab08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:08:12.936690 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 534/1066] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 17:08:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 17:08:12.959180 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d1ea36-8f81-49fb-9ac3-67bc1eb1f5ce None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:08:13.066781 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d1ea36-8f81-49fb-9ac3-67bc1eb1f5ce None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:08:13.099925 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3168cb-6c2f-4076-b0dd-96b2dfe83fa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:08:13.100730 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3168cb-6c2f-4076-b0dd-96b2dfe83fa3 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:08:13.101017 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3168cb-6c2f-4076-b0dd-96b2dfe83fa3 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:08:13.101298 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3168cb-6c2f-4076-b0dd-96b2dfe83fa3 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:08:13.112765 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3168cb-6c2f-4076-b0dd-96b2dfe83fa3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 17:08:13.121525 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application [None req-8b3168cb-6c2f-4076-b0dd-96b2dfe83fa3 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 16 17:08:13.121525 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:08:13.121525 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:08:13.121525 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:08:13.121525 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:08:13.121525 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:08:13.121525 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:08:13.121525 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:08:13.121525 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:08:13.121525 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:08:13.121525 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:08:13.121525 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:08:13.121525 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 17:08:13.121525 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 17:08:13.121525 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 17:08:13.121525 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 17:08:13.122783 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 17:08:13.122783 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 17:08:13.122783 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 17:08:13.122783 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 17:08:13.122783 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:08:13.122783 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:08:13.122783 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:08:13.122783 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:08:13.122783 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:08:13.122783 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:08:13.122783 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:08:13.122783 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application with Lock( Jun 16 17:08:13.122783 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:08:13.122783 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:08:13.122783 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:08:13.122783 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:08:13.123693 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:08:13.123693 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:08:13.123693 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:08:13.123693 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:08:13.123693 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 17:08:13.123693 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 17:08:13.123693 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 17:08:13.123693 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 17:08:13.123693 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 17:08:13.123693 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 17:08:13.123693 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 16 17:08:13.123693 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Jun 16 17:08:13.123693 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 533/1067] 10.222.0.39 () {56 vars in 1120 bytes} [Thu Jun 16 17:08:12 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:08:13.128837 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1300a3a3-8a08-42d8-aab1-dbe7f99dab08 None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:08:13.131080 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:08:13.228127 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1300a3a3-8a08-42d8-aab1-dbe7f99dab08 None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:08:13.262141 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81c91a9-ed72-4628-93f1-e6fba809adbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:08:13.262798 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81c91a9-ed72-4628-93f1-e6fba809adbb None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:08:13.263085 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81c91a9-ed72-4628-93f1-e6fba809adbb None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:08:13.263364 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81c91a9-ed72-4628-93f1-e6fba809adbb None admin] PATH_INFO: `/v3/roles` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:08:13.264103 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81c91a9-ed72-4628-93f1-e6fba809adbb None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:08:13.264414 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81c91a9-ed72-4628-93f1-e6fba809adbb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:08:13.265788 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81c91a9-ed72-4628-93f1-e6fba809adbb None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:08:13.273483 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 535/1068] 10.222.0.39 () {56 vars in 1115 bytes} [Thu Jun 16 17:08:13 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 17:08:13.279520 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3168cb-6c2f-4076-b0dd-96b2dfe83fa3 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:08:13.326976 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:08:13.390398 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3168cb-6c2f-4076-b0dd-96b2dfe83fa3 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:08:13.423725 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506200c9-2244-497b-9ec5-46795ce690be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:08:13.424511 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506200c9-2244-497b-9ec5-46795ce690be None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:08:13.424795 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506200c9-2244-497b-9ec5-46795ce690be None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:08:13.425071 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506200c9-2244-497b-9ec5-46795ce690be None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:08:13.436186 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506200c9-2244-497b-9ec5-46795ce690be None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:08:13.437640 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506200c9-2244-497b-9ec5-46795ce690be None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:08:13.462462 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application [None req-506200c9-2244-497b-9ec5-46795ce690be None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:08:13.462462 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:08:13.462462 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:08:13.462462 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:08:13.462462 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:08:13.462462 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:08:13.462462 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:08:13.462462 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:08:13.462462 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:08:13.462462 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:08:13.462462 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:08:13.462462 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:08:13.462462 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 17:08:13.462462 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 17:08:13.462462 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 17:08:13.463637 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 17:08:13.463637 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:08:13.463637 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:08:13.463637 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:08:13.463637 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:08:13.463637 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:08:13.463637 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:08:13.463637 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:08:13.463637 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application with Lock( Jun 16 17:08:13.463637 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:08:13.463637 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:08:13.463637 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:08:13.463637 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:08:13.463637 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:08:13.463637 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:08:13.463637 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:08:13.463637 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:08:13.464560 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 17:08:13.464560 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 17:08:13.464560 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:08:13.464560 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Jun 16 17:08:13.464560 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 534/1069] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 17:08:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:08:13.469309 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81c91a9-ed72-4628-93f1-e6fba809adbb None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:08:13.531959 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:08:13.569697 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81c91a9-ed72-4628-93f1-e6fba809adbb None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:08:13.603449 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684678bb-943b-433a-8a9d-b05b0678c2e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:08:13.604103 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684678bb-943b-433a-8a9d-b05b0678c2e4 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:08:13.604386 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684678bb-943b-433a-8a9d-b05b0678c2e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:08:13.604662 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684678bb-943b-433a-8a9d-b05b0678c2e4 None admin] PATH_INFO: `/v3/domains` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:08:13.605381 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684678bb-943b-433a-8a9d-b05b0678c2e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:08:13.605690 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684678bb-943b-433a-8a9d-b05b0678c2e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:08:13.607071 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684678bb-943b-433a-8a9d-b05b0678c2e4 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:08:13.618607 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 536/1070] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 16 17:08:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:08:13.624131 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506200c9-2244-497b-9ec5-46795ce690be None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:08:13.719586 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:08:13.723694 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506200c9-2244-497b-9ec5-46795ce690be None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:08:13.755671 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06be64b-52c8-40d2-952d-cd24a7c1d003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:08:13.756455 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06be64b-52c8-40d2-952d-cd24a7c1d003 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:08:13.756735 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06be64b-52c8-40d2-952d-cd24a7c1d003 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:08:13.757009 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06be64b-52c8-40d2-952d-cd24a7c1d003 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:08:13.764968 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06be64b-52c8-40d2-952d-cd24a7c1d003 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:08:13.766418 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06be64b-52c8-40d2-952d-cd24a7c1d003 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:08:13.780033 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application [None req-a06be64b-52c8-40d2-952d-cd24a7c1d003 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 16 17:08:13.780033 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:08:13.780033 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:08:13.780033 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:08:13.780033 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:08:13.780033 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:08:13.780033 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:08:13.780033 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:08:13.780033 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:08:13.780033 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:08:13.780033 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:08:13.780033 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:08:13.780033 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 17:08:13.780033 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 17:08:13.780033 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 17:08:13.780033 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 17:08:13.781225 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:08:13.781225 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:08:13.781225 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 17:08:13.781225 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 17:08:13.781225 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 17:08:13.781225 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 17:08:13.781225 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:08:13.781225 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:08:13.781225 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:08:13.781225 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:08:13.781225 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:08:13.781225 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application with Lock( Jun 16 17:08:13.781225 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:08:13.781225 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:08:13.781225 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:08:13.781225 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:08:13.781225 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:08:13.781225 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:08:13.782890 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:08:13.782890 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:08:13.782890 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 17:08:13.782890 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 17:08:13.782890 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 17:08:13.782890 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 17:08:13.782890 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 17:08:13.782890 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 17:08:13.782890 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 16 17:08:13.782890 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Jun 16 17:08:13.785975 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 535/1071] 10.222.0.39 () {56 vars in 1093 bytes} [Thu Jun 16 17:08:13 2022] GET /identity/v3/users/nova => generated 82 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:08:13.787633 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684678bb-943b-433a-8a9d-b05b0678c2e4 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:08:13.892930 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684678bb-943b-433a-8a9d-b05b0678c2e4 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:08:13.917851 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:08:13.928398 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05367b4-c86f-47cd-bf8d-addde8cb76e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:08:13.929070 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05367b4-c86f-47cd-bf8d-addde8cb76e1 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:08:13.929372 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05367b4-c86f-47cd-bf8d-addde8cb76e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:08:13.929651 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05367b4-c86f-47cd-bf8d-addde8cb76e1 None admin] PATH_INFO: `/v3/users` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:08:13.930612 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05367b4-c86f-47cd-bf8d-addde8cb76e1 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:08:13.934320 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05367b4-c86f-47cd-bf8d-addde8cb76e1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:08:13.934320 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05367b4-c86f-47cd-bf8d-addde8cb76e1 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:08:13.950162 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 537/1072] 10.222.0.39 () {56 vars in 1133 bytes} [Thu Jun 16 17:08:13 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:08:13.954978 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06be64b-52c8-40d2-952d-cd24a7c1d003 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:08:14.041167 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741d3c5a-45c2-4410-9b8e-914e8a487540 None None] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:08:14.041374 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741d3c5a-45c2-4410-9b8e-914e8a487540 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:08:14.041646 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741d3c5a-45c2-4410-9b8e-914e8a487540 None None] PATH_INFO: `/` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:08:14.043059 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 538/1073] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 17:08:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 17:08:14.048346 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de578976-3e91-46f6-9378-c5a9b5424893 None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:08:14.048634 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de578976-3e91-46f6-9378-c5a9b5424893 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:08:14.048912 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de578976-3e91-46f6-9378-c5a9b5424893 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:08:14.062037 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06be64b-52c8-40d2-952d-cd24a7c1d003 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:08:14.064983 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-de578976-3e91-46f6-9378-c5a9b5424893 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:08:14.066191 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-de578976-3e91-46f6-9378-c5a9b5424893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:08:14.097589 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c65af4-5bd1-43bd-af27-5a53523c9413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:08:14.098405 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c65af4-5bd1-43bd-af27-5a53523c9413 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:08:14.098684 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c65af4-5bd1-43bd-af27-5a53523c9413 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:08:14.098960 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c65af4-5bd1-43bd-af27-5a53523c9413 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:08:14.110015 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c65af4-5bd1-43bd-af27-5a53523c9413 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:08:14.111458 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c65af4-5bd1-43bd-af27-5a53523c9413 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:08:14.128778 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application [None req-c4c65af4-5bd1-43bd-af27-5a53523c9413 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:08:14.128778 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:08:14.128778 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:08:14.128778 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:08:14.128778 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:08:14.128778 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:08:14.128778 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:08:14.128778 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:08:14.128778 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:08:14.128778 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:08:14.128778 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:08:14.128778 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:08:14.128778 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 17:08:14.128778 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 17:08:14.128778 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 17:08:14.129902 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 17:08:14.129902 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:08:14.129902 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:08:14.129902 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:08:14.129902 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:08:14.129902 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:08:14.129902 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:08:14.129902 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:08:14.129902 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application with Lock( Jun 16 17:08:14.129902 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:08:14.129902 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:08:14.129902 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:08:14.129902 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:08:14.129902 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:08:14.129902 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:08:14.129902 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:08:14.129902 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:08:14.130905 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 17:08:14.130905 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 17:08:14.130905 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:08:14.130905 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Jun 16 17:08:14.130905 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 536/1074] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 17:08:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:08:14.136304 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c65af4-5bd1-43bd-af27-5a53523c9413 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:08:14.137997 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 539/1075] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 17:08:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 17:08:14.148949 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:08:14.160407 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de578976-3e91-46f6-9378-c5a9b5424893 None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:08:14.237168 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c65af4-5bd1-43bd-af27-5a53523c9413 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:08:14.259921 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de578976-3e91-46f6-9378-c5a9b5424893 None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:08:14.270799 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a1cce0-c24c-4881-84f7-cfd35ab86266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:08:14.271454 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a1cce0-c24c-4881-84f7-cfd35ab86266 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:08:14.271738 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a1cce0-c24c-4881-84f7-cfd35ab86266 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:08:14.272010 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a1cce0-c24c-4881-84f7-cfd35ab86266 None admin] PATH_INFO: `/v3/domains` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:08:14.272726 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a1cce0-c24c-4881-84f7-cfd35ab86266 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80873) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:08:14.273033 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a1cce0-c24c-4881-84f7-cfd35ab86266 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:08:14.273201 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:08:14.274511 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a1cce0-c24c-4881-84f7-cfd35ab86266 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:08:14.286727 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 537/1076] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 16 17:08:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 17:08:14.293004 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a1cce0-c24c-4881-84f7-cfd35ab86266 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:08:14.294918 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e358a6f-8660-44c3-b4b8-7a8cf1780d58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:08:14.295716 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e358a6f-8660-44c3-b4b8-7a8cf1780d58 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:08:14.296005 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e358a6f-8660-44c3-b4b8-7a8cf1780d58 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:08:14.296290 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e358a6f-8660-44c3-b4b8-7a8cf1780d58 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:08:14.307058 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e358a6f-8660-44c3-b4b8-7a8cf1780d58 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 17:08:14.314683 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application [None req-3e358a6f-8660-44c3-b4b8-7a8cf1780d58 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 17:08:14.314683 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:08:14.314683 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:08:14.314683 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:08:14.314683 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:08:14.314683 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:08:14.314683 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:08:14.314683 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:08:14.314683 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:08:14.314683 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:08:14.314683 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:08:14.314683 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:08:14.314683 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 17:08:14.314683 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 17:08:14.314683 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 17:08:14.314683 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 17:08:14.315853 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 17:08:14.315853 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 17:08:14.315853 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 17:08:14.315853 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 17:08:14.315853 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:08:14.315853 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:08:14.315853 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:08:14.315853 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:08:14.315853 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:08:14.315853 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:08:14.315853 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:08:14.315853 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application with Lock( Jun 16 17:08:14.315853 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:08:14.315853 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:08:14.315853 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:08:14.315853 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:08:14.318764 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:08:14.318764 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:08:14.318764 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:08:14.318764 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:08:14.318764 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 17:08:14.318764 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 17:08:14.318764 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 17:08:14.318764 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 17:08:14.318764 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 17:08:14.318764 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 17:08:14.318764 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 17:08:14.318764 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Jun 16 17:08:14.318764 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 540/1077] 10.222.0.39 () {56 vars in 1096 bytes} [Thu Jun 16 17:08:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 17:08:14.322127 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e358a6f-8660-44c3-b4b8-7a8cf1780d58 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:08:14.365728 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:08:14.395749 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a1cce0-c24c-4881-84f7-cfd35ab86266 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:08:14.424510 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e358a6f-8660-44c3-b4b8-7a8cf1780d58 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:08:14.429918 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fe9956-9039-4247-9e65-2fb79b6a93d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:08:14.431306 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fe9956-9039-4247-9e65-2fb79b6a93d6 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:08:14.431599 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fe9956-9039-4247-9e65-2fb79b6a93d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:08:14.431881 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fe9956-9039-4247-9e65-2fb79b6a93d6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:08:14.438603 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fe9956-9039-4247-9e65-2fb79b6a93d6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:08:14.440040 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fe9956-9039-4247-9e65-2fb79b6a93d6 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:08:14.454219 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application [None req-57fe9956-9039-4247-9e65-2fb79b6a93d6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 17:08:14.454219 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:08:14.454219 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:08:14.454219 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:08:14.454219 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:08:14.454219 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:08:14.454219 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:08:14.454219 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:08:14.454219 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:08:14.454219 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:08:14.454219 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:08:14.454219 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:08:14.454219 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 17:08:14.454219 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 17:08:14.454219 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 17:08:14.455200 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 17:08:14.455200 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:08:14.455200 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:08:14.455200 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:08:14.455200 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:08:14.455200 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:08:14.455200 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:08:14.455200 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:08:14.455200 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application with Lock( Jun 16 17:08:14.455200 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:08:14.455200 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:08:14.455200 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:08:14.455200 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:08:14.455200 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:08:14.455200 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:08:14.455200 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:08:14.455200 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:08:14.456743 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 17:08:14.456743 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 17:08:14.456743 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 17:08:14.456743 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 17:08:14.456743 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 17:08:14.456743 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 17:08:14.456743 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 17:08:14.456743 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Jun 16 17:08:14.456743 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 538/1078] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 16 17:08:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 17:08:14.461016 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fe9956-9039-4247-9e65-2fb79b6a93d6 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:08:14.463260 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28ae73c-0982-4468-8e87-4c96706595dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:08:14.463936 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28ae73c-0982-4468-8e87-4c96706595dc None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:08:14.464227 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28ae73c-0982-4468-8e87-4c96706595dc None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:08:14.464512 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28ae73c-0982-4468-8e87-4c96706595dc None admin] PATH_INFO: `/v3/roles` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:08:14.465273 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28ae73c-0982-4468-8e87-4c96706595dc None admin] RBAC: Adding query filter params (name=admin) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:08:14.465591 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28ae73c-0982-4468-8e87-4c96706595dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:08:14.466994 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28ae73c-0982-4468-8e87-4c96706595dc None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:08:14.476262 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 541/1079] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 16 17:08:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 17:08:14.482747 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28ae73c-0982-4468-8e87-4c96706595dc None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:08:14.516816 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:08:14.585316 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fe9956-9039-4247-9e65-2fb79b6a93d6 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:08:14.594338 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28ae73c-0982-4468-8e87-4c96706595dc None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:08:14.610293 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:08:14.616474 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350f36dd-93d3-4267-81e8-cf9a7dd3fd00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:08:14.617217 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350f36dd-93d3-4267-81e8-cf9a7dd3fd00 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:08:14.617549 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350f36dd-93d3-4267-81e8-cf9a7dd3fd00 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:08:14.618656 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350f36dd-93d3-4267-81e8-cf9a7dd3fd00 None admin] PATH_INFO: `/v3/projects` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:08:14.638613 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350f36dd-93d3-4267-81e8-cf9a7dd3fd00 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80873) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:08:14.638613 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350f36dd-93d3-4267-81e8-cf9a7dd3fd00 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:08:14.638613 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350f36dd-93d3-4267-81e8-cf9a7dd3fd00 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:08:14.638613 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 539/1080] 10.222.0.39 () {56 vars in 1148 bytes} [Thu Jun 16 17:08:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 17:08:14.638939 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5088141c-e843-4da6-9bde-e3d46a99ac0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:08:14.638939 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5088141c-e843-4da6-9bde-e3d46a99ac0e None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:08:14.638939 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5088141c-e843-4da6-9bde-e3d46a99ac0e None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:08:14.638939 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5088141c-e843-4da6-9bde-e3d46a99ac0e None admin] PATH_INFO: `/v3/users/869b8f20c7c64d8086429dbd4caeff60` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:08:14.639246 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5088141c-e843-4da6-9bde-e3d46a99ac0e None admin] RBAC: Authorizing `identity:get_user(user_id=869b8f20c7c64d8086429dbd4caeff60)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:08:14.639246 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5088141c-e843-4da6-9bde-e3d46a99ac0e None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:08:14.639826 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350f36dd-93d3-4267-81e8-cf9a7dd3fd00 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:08:14.640504 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 542/1081] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jun 16 17:08:14 2022] GET /identity/v3/users/869b8f20c7c64d8086429dbd4caeff60 => generated 285 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 17:08:14.645730 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5088141c-e843-4da6-9bde-e3d46a99ac0e None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:08:14.739701 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350f36dd-93d3-4267-81e8-cf9a7dd3fd00 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:08:14.744502 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5088141c-e843-4da6-9bde-e3d46a99ac0e None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:08:14.746072 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:08:14.774996 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2adb2d-2011-4606-a637-d7bc5db6f7b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:08:14.775925 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2adb2d-2011-4606-a637-d7bc5db6f7b4 None admin] REQUEST_METHOD: `PUT` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:08:14.776211 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2adb2d-2011-4606-a637-d7bc5db6f7b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:08:14.776494 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2adb2d-2011-4606-a637-d7bc5db6f7b4 None admin] PATH_INFO: `/v3/projects/73015da4de1f48c29f57fff1040d2c10/users/3d381bb41dea4f1e90c3cf3815ac88dc/roles/db26ca9731b944aea5051916653e9ffd` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:08:14.778748 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2adb2d-2011-4606-a637-d7bc5db6f7b4 None admin] RBAC: Authorizing `identity:create_grant(project_id=73015da4de1f48c29f57fff1040d2c10, user_id=3d381bb41dea4f1e90c3cf3815ac88dc, role_id=db26ca9731b944aea5051916653e9ffd)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:08:14.779659 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4c06a1-e143-4c33-b93a-abeb77f630e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:08:14.780202 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2adb2d-2011-4606-a637-d7bc5db6f7b4 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:08:14.780776 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4c06a1-e143-4c33-b93a-abeb77f630e6 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:08:14.781229 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4c06a1-e143-4c33-b93a-abeb77f630e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:08:14.781898 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4c06a1-e143-4c33-b93a-abeb77f630e6 None admin] PATH_INFO: `/v3/projects/b4b3ecfc998f43e8897ed07279f5229f` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:08:14.783091 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4c06a1-e143-4c33-b93a-abeb77f630e6 None admin] RBAC: Authorizing `identity:get_project(project_id=b4b3ecfc998f43e8897ed07279f5229f)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:08:14.784520 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4c06a1-e143-4c33-b93a-abeb77f630e6 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:08:14.786278 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 543/1082] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 16 17:08:14 2022] GET /identity/v3/projects/b4b3ecfc998f43e8897ed07279f5229f => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 17:08:14.792637 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4c06a1-e143-4c33-b93a-abeb77f630e6 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:08:14.853698 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 540/1083] 10.222.0.39 () {58 vars in 1439 bytes} [Thu Jun 16 17:08:14 2022] PUT /identity/v3/projects/73015da4de1f48c29f57fff1040d2c10/users/3d381bb41dea4f1e90c3cf3815ac88dc/roles/db26ca9731b944aea5051916653e9ffd => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 17:08:14.894401 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4c06a1-e143-4c33-b93a-abeb77f630e6 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:08:14.932160 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af6cf05-113e-4467-a812-d4c73b4adc47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:08:14.933259 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af6cf05-113e-4467-a812-d4c73b4adc47 None admin] REQUEST_METHOD: `PUT` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:08:14.933547 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af6cf05-113e-4467-a812-d4c73b4adc47 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:08:14.933860 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af6cf05-113e-4467-a812-d4c73b4adc47 None admin] PATH_INFO: `/v3/projects/b4b3ecfc998f43e8897ed07279f5229f/users/869b8f20c7c64d8086429dbd4caeff60/roles/dba744f8ab2a4c45b9d3212f8d203aba` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:08:14.936440 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af6cf05-113e-4467-a812-d4c73b4adc47 None admin] RBAC: Authorizing `identity:create_grant(project_id=b4b3ecfc998f43e8897ed07279f5229f, user_id=869b8f20c7c64d8086429dbd4caeff60, role_id=dba744f8ab2a4c45b9d3212f8d203aba)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:08:14.937932 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af6cf05-113e-4467-a812-d4c73b4adc47 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:08:15.030547 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 544/1084] 10.222.0.39 () {58 vars in 1439 bytes} [Thu Jun 16 17:08:14 2022] PUT /identity/v3/projects/b4b3ecfc998f43e8897ed07279f5229f/users/869b8f20c7c64d8086429dbd4caeff60/roles/dba744f8ab2a4c45b9d3212f8d203aba => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 17:08:16.971245 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf6612a-2a6d-4e32-94d0-8e2398ae3e95 None None] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:08:16.972041 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf6612a-2a6d-4e32-94d0-8e2398ae3e95 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:08:16.972041 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf6612a-2a6d-4e32-94d0-8e2398ae3e95 None None] PATH_INFO: `/` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:08:16.973432 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 541/1085] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 17:08:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:08:16.979284 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9131c3-4413-41ea-94ef-60111aa17625 None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:08:16.979729 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9131c3-4413-41ea-94ef-60111aa17625 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:08:16.979837 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9131c3-4413-41ea-94ef-60111aa17625 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:08:16.996182 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-3f9131c3-4413-41ea-94ef-60111aa17625 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:08:16.997349 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-3f9131c3-4413-41ea-94ef-60111aa17625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:08:17.020409 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:08:17.065258 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 545/1086] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 17:08:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 17:08:17.089507 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf6612a-2a6d-4e32-94d0-8e2398ae3e95 None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:08:17.119461 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc11888-2622-4bcc-9ff3-a80ff9abca1c None None] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:08:17.119461 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc11888-2622-4bcc-9ff3-a80ff9abca1c None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:08:17.119461 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc11888-2622-4bcc-9ff3-a80ff9abca1c None None] PATH_INFO: `/` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:08:17.120527 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 546/1087] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 17:08:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 17:08:17.125614 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401a2372-543a-45d0-a0ac-6088e2b758ec None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:08:17.125933 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401a2372-543a-45d0-a0ac-6088e2b758ec None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:08:17.126219 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401a2372-543a-45d0-a0ac-6088e2b758ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:08:17.142645 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-401a2372-543a-45d0-a0ac-6088e2b758ec None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:08:17.143770 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-401a2372-543a-45d0-a0ac-6088e2b758ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:08:17.146311 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:08:17.197386 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf6612a-2a6d-4e32-94d0-8e2398ae3e95 None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:08:17.212591 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 547/1088] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 17:08:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 17:08:17.231313 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c6615a-1f73-4f3c-9ce4-106ac7f3f180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:08:17.232119 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c6615a-1f73-4f3c-9ce4-106ac7f3f180 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:08:17.232401 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c6615a-1f73-4f3c-9ce4-106ac7f3f180 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:08:17.232678 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c6615a-1f73-4f3c-9ce4-106ac7f3f180 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:08:17.236033 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401a2372-543a-45d0-a0ac-6088e2b758ec None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:08:17.244969 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c6615a-1f73-4f3c-9ce4-106ac7f3f180 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 17:08:17.253202 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application [None req-35c6615a-1f73-4f3c-9ce4-106ac7f3f180 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 16 17:08:17.253202 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:08:17.253202 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:08:17.253202 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:08:17.253202 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:08:17.253202 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:08:17.253202 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:08:17.253202 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:08:17.253202 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:08:17.253202 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:08:17.253202 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:08:17.253202 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:08:17.253202 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 17:08:17.253202 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 17:08:17.253202 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 17:08:17.253202 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 17:08:17.254247 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 17:08:17.254247 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 17:08:17.254247 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 17:08:17.254247 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 17:08:17.254247 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:08:17.254247 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:08:17.254247 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:08:17.254247 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:08:17.254247 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:08:17.254247 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:08:17.254247 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:08:17.254247 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application with Lock( Jun 16 17:08:17.254247 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:08:17.254247 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:08:17.254247 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:08:17.254247 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:08:17.255101 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:08:17.255101 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:08:17.255101 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:08:17.255101 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:08:17.255101 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 17:08:17.255101 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 17:08:17.255101 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 17:08:17.255101 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 17:08:17.255101 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 17:08:17.255101 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 17:08:17.255101 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 16 17:08:17.255101 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Jun 16 17:08:17.255101 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 542/1089] 10.222.0.39 () {56 vars in 1120 bytes} [Thu Jun 16 17:08:17 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:08:17.260735 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c6615a-1f73-4f3c-9ce4-106ac7f3f180 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:08:17.329936 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:08:17.339935 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401a2372-543a-45d0-a0ac-6088e2b758ec None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:08:17.363537 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c6615a-1f73-4f3c-9ce4-106ac7f3f180 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:08:17.374062 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa2ef2f-c792-4ac4-95c8-eb8a72f9b568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:08:17.374590 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:08:17.374860 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa2ef2f-c792-4ac4-95c8-eb8a72f9b568 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:08:17.375158 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa2ef2f-c792-4ac4-95c8-eb8a72f9b568 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:08:17.375446 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa2ef2f-c792-4ac4-95c8-eb8a72f9b568 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:08:17.386589 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa2ef2f-c792-4ac4-95c8-eb8a72f9b568 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 17:08:17.394531 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application [None req-efa2ef2f-c792-4ac4-95c8-eb8a72f9b568 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 17:08:17.394531 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:08:17.394531 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:08:17.394531 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:08:17.394531 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:08:17.394531 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:08:17.394531 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:08:17.394531 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:08:17.394531 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:08:17.394531 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:08:17.394531 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:08:17.394531 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:08:17.394531 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 17:08:17.394531 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 17:08:17.394531 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 17:08:17.394531 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 17:08:17.395556 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 17:08:17.395556 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 17:08:17.395556 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 17:08:17.395556 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 17:08:17.395556 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:08:17.395556 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:08:17.395556 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:08:17.395556 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:08:17.395556 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:08:17.395556 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:08:17.395556 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:08:17.395556 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application with Lock( Jun 16 17:08:17.395556 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:08:17.395556 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:08:17.395556 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:08:17.395556 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:08:17.396422 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:08:17.396422 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:08:17.396422 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:08:17.396422 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:08:17.396422 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 17:08:17.396422 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 17:08:17.396422 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 17:08:17.396422 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 17:08:17.396422 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 17:08:17.396422 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 17:08:17.396422 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 17:08:17.396422 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Jun 16 17:08:17.396422 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 548/1090] 10.222.0.39 () {56 vars in 1096 bytes} [Thu Jun 16 17:08:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 17:08:17.400970 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd808b47-ad60-46f4-a8c5-4ad70a479691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:08:17.402085 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd808b47-ad60-46f4-a8c5-4ad70a479691 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:08:17.402324 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa2ef2f-c792-4ac4-95c8-eb8a72f9b568 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:08:17.402762 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd808b47-ad60-46f4-a8c5-4ad70a479691 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:08:17.403251 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd808b47-ad60-46f4-a8c5-4ad70a479691 None admin] PATH_INFO: `/v3/roles` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:08:17.406082 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd808b47-ad60-46f4-a8c5-4ad70a479691 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80873) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:08:17.406409 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd808b47-ad60-46f4-a8c5-4ad70a479691 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:08:17.407786 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd808b47-ad60-46f4-a8c5-4ad70a479691 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:08:17.418293 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 543/1091] 10.222.0.39 () {56 vars in 1115 bytes} [Thu Jun 16 17:08:17 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 17:08:17.425267 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd808b47-ad60-46f4-a8c5-4ad70a479691 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:08:17.516913 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa2ef2f-c792-4ac4-95c8-eb8a72f9b568 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:08:17.530067 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd808b47-ad60-46f4-a8c5-4ad70a479691 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:08:17.550187 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba75d79-8832-4fe3-9ee1-6d794550aaf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:08:17.550855 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba75d79-8832-4fe3-9ee1-6d794550aaf7 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:08:17.551142 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba75d79-8832-4fe3-9ee1-6d794550aaf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:08:17.551420 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba75d79-8832-4fe3-9ee1-6d794550aaf7 None admin] PATH_INFO: `/v3/roles` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:08:17.552167 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba75d79-8832-4fe3-9ee1-6d794550aaf7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:08:17.552472 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba75d79-8832-4fe3-9ee1-6d794550aaf7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:08:17.553854 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba75d79-8832-4fe3-9ee1-6d794550aaf7 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:08:17.562465 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 549/1092] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 16 17:08:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 17:08:17.568213 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba75d79-8832-4fe3-9ee1-6d794550aaf7 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:08:17.569007 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1b0ca4-37a7-409b-bc5f-a96a506c138c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:08:17.569921 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1b0ca4-37a7-409b-bc5f-a96a506c138c None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:08:17.570281 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1b0ca4-37a7-409b-bc5f-a96a506c138c None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:08:17.570713 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1b0ca4-37a7-409b-bc5f-a96a506c138c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:08:17.581447 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1b0ca4-37a7-409b-bc5f-a96a506c138c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:08:17.582463 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:08:17.582924 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1b0ca4-37a7-409b-bc5f-a96a506c138c None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:08:17.600347 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application [None req-8e1b0ca4-37a7-409b-bc5f-a96a506c138c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:08:17.600347 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:08:17.600347 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:08:17.600347 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:08:17.600347 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:08:17.600347 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:08:17.600347 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:08:17.600347 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:08:17.600347 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:08:17.600347 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:08:17.600347 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:08:17.600347 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:08:17.600347 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 17:08:17.600347 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 17:08:17.600347 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 17:08:17.601303 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 17:08:17.601303 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:08:17.601303 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:08:17.601303 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:08:17.601303 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:08:17.601303 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:08:17.601303 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:08:17.601303 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:08:17.601303 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application with Lock( Jun 16 17:08:17.601303 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:08:17.601303 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:08:17.601303 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:08:17.601303 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:08:17.601303 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:08:17.601303 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:08:17.601303 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:08:17.601303 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:08:17.607474 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 17:08:17.607474 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 17:08:17.607474 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:08:17.607474 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Jun 16 17:08:17.607474 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 544/1093] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 17:08:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 17:08:17.607767 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1b0ca4-37a7-409b-bc5f-a96a506c138c None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:08:17.633535 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:08:17.667876 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba75d79-8832-4fe3-9ee1-6d794550aaf7 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:08:17.700930 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ceefff-08b6-43ca-b895-d743cf15eb1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:08:17.701847 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ceefff-08b6-43ca-b895-d743cf15eb1e None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:08:17.702143 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ceefff-08b6-43ca-b895-d743cf15eb1e None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:08:17.702425 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ceefff-08b6-43ca-b895-d743cf15eb1e None admin] PATH_INFO: `/v3/users/869b8f20c7c64d8086429dbd4caeff60` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:08:17.703629 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ceefff-08b6-43ca-b895-d743cf15eb1e None admin] RBAC: Authorizing `identity:get_user(user_id=869b8f20c7c64d8086429dbd4caeff60)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:08:17.705067 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ceefff-08b6-43ca-b895-d743cf15eb1e None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:08:17.706745 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 550/1094] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jun 16 17:08:17 2022] GET /identity/v3/users/869b8f20c7c64d8086429dbd4caeff60 => generated 285 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 17:08:17.707482 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1b0ca4-37a7-409b-bc5f-a96a506c138c None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:08:17.712879 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ceefff-08b6-43ca-b895-d743cf15eb1e None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:08:17.743435 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60035bb-3b00-4a44-bc73-02e7ff56b12c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:08:17.744101 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60035bb-3b00-4a44-bc73-02e7ff56b12c None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:08:17.744388 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60035bb-3b00-4a44-bc73-02e7ff56b12c None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:08:17.744679 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60035bb-3b00-4a44-bc73-02e7ff56b12c None admin] PATH_INFO: `/v3/domains` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:08:17.745396 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60035bb-3b00-4a44-bc73-02e7ff56b12c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80873) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:08:17.745705 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60035bb-3b00-4a44-bc73-02e7ff56b12c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:08:17.747100 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60035bb-3b00-4a44-bc73-02e7ff56b12c None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:08:17.759288 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 545/1095] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 16 17:08:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:08:17.764903 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60035bb-3b00-4a44-bc73-02e7ff56b12c None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:08:17.796926 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:08:17.815908 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ceefff-08b6-43ca-b895-d743cf15eb1e None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:08:17.848522 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:08:17.850496 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151fdeef-50cf-487e-8973-9c3fd600995f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:08:17.851144 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151fdeef-50cf-487e-8973-9c3fd600995f None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:08:17.851435 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151fdeef-50cf-487e-8973-9c3fd600995f None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:08:17.851817 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151fdeef-50cf-487e-8973-9c3fd600995f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:08:17.864785 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60035bb-3b00-4a44-bc73-02e7ff56b12c None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:08:17.902927 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f44a4d2-4574-4229-90b3-80c21a12719a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:08:17.903747 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f44a4d2-4574-4229-90b3-80c21a12719a None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:08:17.904031 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f44a4d2-4574-4229-90b3-80c21a12719a None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:08:17.904309 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f44a4d2-4574-4229-90b3-80c21a12719a None admin] PATH_INFO: `/v3/users/nova` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:08:17.911340 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f44a4d2-4574-4229-90b3-80c21a12719a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:08:17.912786 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f44a4d2-4574-4229-90b3-80c21a12719a None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:08:17.927475 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application [None req-1f44a4d2-4574-4229-90b3-80c21a12719a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 16 17:08:17.927475 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:08:17.927475 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:08:17.927475 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:08:17.927475 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:08:17.927475 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:08:17.927475 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:08:17.927475 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:08:17.927475 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:08:17.927475 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:08:17.927475 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:08:17.927475 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:08:17.927475 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 17:08:17.927475 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 17:08:17.927475 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 17:08:17.927475 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 17:08:17.928465 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:08:17.928465 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:08:17.928465 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 17:08:17.928465 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 17:08:17.928465 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 17:08:17.928465 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 17:08:17.928465 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:08:17.928465 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:08:17.928465 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:08:17.928465 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:08:17.928465 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:08:17.928465 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application with Lock( Jun 16 17:08:17.928465 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:08:17.928465 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:08:17.928465 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:08:17.928465 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:08:17.928465 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:08:17.928465 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:08:17.929453 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:08:17.929453 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:08:17.929453 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 17:08:17.929453 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 17:08:17.929453 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 17:08:17.929453 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 17:08:17.929453 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 17:08:17.929453 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 17:08:17.929453 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 16 17:08:17.929453 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Jun 16 17:08:17.929453 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 546/1096] 10.222.0.39 () {56 vars in 1093 bytes} [Thu Jun 16 17:08:17 2022] GET /identity/v3/users/nova => generated 82 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 17:08:17.930288 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151fdeef-50cf-487e-8973-9c3fd600995f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:08:17.930870 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151fdeef-50cf-487e-8973-9c3fd600995f None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:08:17.934671 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f44a4d2-4574-4229-90b3-80c21a12719a None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:08:18.014510 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:08:18.033018 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 551/1097] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 16 17:08:17 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 17:08:18.038820 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151fdeef-50cf-487e-8973-9c3fd600995f None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:08:18.039044 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f44a4d2-4574-4229-90b3-80c21a12719a None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:08:18.073309 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3568e827-de47-4c1a-bb09-56c5475e29fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:08:18.074010 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3568e827-de47-4c1a-bb09-56c5475e29fe None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:08:18.074298 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3568e827-de47-4c1a-bb09-56c5475e29fe None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:08:18.074578 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3568e827-de47-4c1a-bb09-56c5475e29fe None admin] PATH_INFO: `/v3/users` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:08:18.075414 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3568e827-de47-4c1a-bb09-56c5475e29fe None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80873) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:08:18.075727 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3568e827-de47-4c1a-bb09-56c5475e29fe None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:08:18.077143 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3568e827-de47-4c1a-bb09-56c5475e29fe None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:08:18.094668 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 547/1098] 10.222.0.39 () {56 vars in 1133 bytes} [Thu Jun 16 17:08:17 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:08:18.100826 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3568e827-de47-4c1a-bb09-56c5475e29fe None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:08:18.103621 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:08:18.137832 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151fdeef-50cf-487e-8973-9c3fd600995f None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:08:18.172250 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfb0b4f-4c71-4b7e-beae-11eccb168edd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:08:18.173104 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfb0b4f-4c71-4b7e-beae-11eccb168edd None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:08:18.173394 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfb0b4f-4c71-4b7e-beae-11eccb168edd None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:08:18.173677 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfb0b4f-4c71-4b7e-beae-11eccb168edd None admin] PATH_INFO: `/v3/projects/b4b3ecfc998f43e8897ed07279f5229f` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:08:18.174926 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfb0b4f-4c71-4b7e-beae-11eccb168edd None admin] RBAC: Authorizing `identity:get_project(project_id=b4b3ecfc998f43e8897ed07279f5229f)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:08:18.176361 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfb0b4f-4c71-4b7e-beae-11eccb168edd None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:08:18.178168 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 552/1099] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 16 17:08:18 2022] GET /identity/v3/projects/b4b3ecfc998f43e8897ed07279f5229f => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 17:08:18.184768 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfb0b4f-4c71-4b7e-beae-11eccb168edd None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:08:18.199343 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3568e827-de47-4c1a-bb09-56c5475e29fe None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:08:18.232929 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:08:18.233172 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b65100d-3e02-4f16-8f88-7d63d0ca1178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:08:18.233863 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b65100d-3e02-4f16-8f88-7d63d0ca1178 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:08:18.234508 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b65100d-3e02-4f16-8f88-7d63d0ca1178 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:08:18.234811 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b65100d-3e02-4f16-8f88-7d63d0ca1178 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:08:18.284145 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfb0b4f-4c71-4b7e-beae-11eccb168edd None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:08:18.304357 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b65100d-3e02-4f16-8f88-7d63d0ca1178 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:08:18.305885 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b65100d-3e02-4f16-8f88-7d63d0ca1178 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:08:18.307825 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:08:18.339998 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b316eab-cf19-4e7d-bb02-da0ae92fda64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:08:18.342590 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b316eab-cf19-4e7d-bb02-da0ae92fda64 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:08:18.348619 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b316eab-cf19-4e7d-bb02-da0ae92fda64 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:08:18.348619 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b316eab-cf19-4e7d-bb02-da0ae92fda64 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:08:18.348619 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b316eab-cf19-4e7d-bb02-da0ae92fda64 None admin] RBAC: Adding query filter params (role.id=dba744f8ab2a4c45b9d3212f8d203aba, scope.project.id=b4b3ecfc998f43e8897ed07279f5229f, user.id=869b8f20c7c64d8086429dbd4caeff60) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:08:18.348619 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b316eab-cf19-4e7d-bb02-da0ae92fda64 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:08:18.348619 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b316eab-cf19-4e7d-bb02-da0ae92fda64 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:08:18.356797 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 553/1100] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jun 16 17:08:18 2022] GET /identity/v3/role_assignments?user.id=869b8f20c7c64d8086429dbd4caeff60&scope.project.id=b4b3ecfc998f43e8897ed07279f5229f&role.id=dba744f8ab2a4c45b9d3212f8d203aba => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 17:08:18.415600 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 548/1101] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 16 17:08:18 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 17:08:18.421623 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b316eab-cf19-4e7d-bb02-da0ae92fda64 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:08:18.526831 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b316eab-cf19-4e7d-bb02-da0ae92fda64 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:08:18.541106 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:08:18.561645 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9fd15e-2269-4635-bc95-99673807f3cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:08:18.562465 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9fd15e-2269-4635-bc95-99673807f3cf None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:08:18.562758 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9fd15e-2269-4635-bc95-99673807f3cf None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:08:18.563035 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9fd15e-2269-4635-bc95-99673807f3cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:08:18.574021 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9fd15e-2269-4635-bc95-99673807f3cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:08:18.576055 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9fd15e-2269-4635-bc95-99673807f3cf None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:08:18.593963 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application [None req-8b9fd15e-2269-4635-bc95-99673807f3cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:08:18.593963 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:08:18.593963 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:08:18.593963 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:08:18.593963 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:08:18.593963 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:08:18.593963 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:08:18.593963 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:08:18.593963 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:08:18.593963 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:08:18.593963 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:08:18.593963 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:08:18.593963 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 17:08:18.593963 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 17:08:18.593963 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 17:08:18.595099 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 17:08:18.595099 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:08:18.595099 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:08:18.595099 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:08:18.595099 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:08:18.595099 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:08:18.595099 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:08:18.595099 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:08:18.595099 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application with Lock( Jun 16 17:08:18.595099 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:08:18.595099 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:08:18.595099 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:08:18.595099 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:08:18.595099 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:08:18.595099 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:08:18.595099 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:08:18.595099 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:08:18.596031 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 17:08:18.596031 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 17:08:18.596031 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:08:18.596031 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Jun 16 17:08:18.596031 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 554/1102] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 17:08:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:08:18.601060 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b65100d-3e02-4f16-8f88-7d63d0ca1178 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:08:18.701146 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b65100d-3e02-4f16-8f88-7d63d0ca1178 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:08:18.702709 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:08:18.736146 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c0253c-1a10-4ac4-b0a9-ba63322d8bf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:08:18.736809 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c0253c-1a10-4ac4-b0a9-ba63322d8bf5 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:08:18.737091 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c0253c-1a10-4ac4-b0a9-ba63322d8bf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:08:18.737365 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c0253c-1a10-4ac4-b0a9-ba63322d8bf5 None admin] PATH_INFO: `/v3/domains` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:08:18.738126 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c0253c-1a10-4ac4-b0a9-ba63322d8bf5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80873) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:08:18.738432 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c0253c-1a10-4ac4-b0a9-ba63322d8bf5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:08:18.739778 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c0253c-1a10-4ac4-b0a9-ba63322d8bf5 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:08:18.751784 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 549/1103] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 16 17:08:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:08:18.757352 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9fd15e-2269-4635-bc95-99673807f3cf None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:08:18.857741 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9fd15e-2269-4635-bc95-99673807f3cf None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:08:18.894682 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25510e1a-7450-4f07-9f97-4531e6530690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:08:18.895489 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25510e1a-7450-4f07-9f97-4531e6530690 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:08:18.895780 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25510e1a-7450-4f07-9f97-4531e6530690 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:08:18.896064 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25510e1a-7450-4f07-9f97-4531e6530690 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:08:18.903588 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25510e1a-7450-4f07-9f97-4531e6530690 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:08:18.905033 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25510e1a-7450-4f07-9f97-4531e6530690 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:08:18.918797 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application [None req-25510e1a-7450-4f07-9f97-4531e6530690 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 17:08:18.918797 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:08:18.918797 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:08:18.918797 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:08:18.918797 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:08:18.918797 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:08:18.918797 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:08:18.918797 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:08:18.918797 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:08:18.918797 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:08:18.918797 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:08:18.918797 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:08:18.918797 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 17:08:18.918797 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 17:08:18.918797 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 17:08:18.919699 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 17:08:18.919699 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:08:18.919699 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:08:18.919699 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:08:18.919699 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:08:18.919699 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:08:18.919699 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:08:18.919699 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:08:18.919699 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application with Lock( Jun 16 17:08:18.919699 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:08:18.919699 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:08:18.919699 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:08:18.919699 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:08:18.919699 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:08:18.919699 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:08:18.919699 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:08:18.919699 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:08:18.920625 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 17:08:18.920625 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 17:08:18.920625 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 17:08:18.920625 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 17:08:18.920625 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 17:08:18.920625 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 17:08:18.920625 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 17:08:18.920625 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Jun 16 17:08:18.920625 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 555/1104] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 16 17:08:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:08:18.925820 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c0253c-1a10-4ac4-b0a9-ba63322d8bf5 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:08:19.027599 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c0253c-1a10-4ac4-b0a9-ba63322d8bf5 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:08:19.061355 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c6e32b-c9e0-4e04-8d52-d6ad6ec47fe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:08:19.062053 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c6e32b-c9e0-4e04-8d52-d6ad6ec47fe0 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:08:19.062341 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c6e32b-c9e0-4e04-8d52-d6ad6ec47fe0 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:08:19.062618 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c6e32b-c9e0-4e04-8d52-d6ad6ec47fe0 None admin] PATH_INFO: `/v3/projects` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:08:19.063403 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c6e32b-c9e0-4e04-8d52-d6ad6ec47fe0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80873) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:08:19.063718 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c6e32b-c9e0-4e04-8d52-d6ad6ec47fe0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:08:19.065136 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c6e32b-c9e0-4e04-8d52-d6ad6ec47fe0 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:08:19.077138 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 550/1105] 10.222.0.39 () {56 vars in 1148 bytes} [Thu Jun 16 17:08:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:08:19.083289 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25510e1a-7450-4f07-9f97-4531e6530690 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:08:19.109599 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:08:19.185109 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25510e1a-7450-4f07-9f97-4531e6530690 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:08:19.218592 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7984edb3-39e9-401b-858b-804320613dfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:08:19.219240 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7984edb3-39e9-401b-858b-804320613dfb None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:08:19.219526 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7984edb3-39e9-401b-858b-804320613dfb None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:08:19.219804 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7984edb3-39e9-401b-858b-804320613dfb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:08:19.220628 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7984edb3-39e9-401b-858b-804320613dfb None admin] RBAC: Adding query filter params (role.id=db26ca9731b944aea5051916653e9ffd, scope.project.id=73015da4de1f48c29f57fff1040d2c10, user.id=3d381bb41dea4f1e90c3cf3815ac88dc) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:08:19.220942 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7984edb3-39e9-401b-858b-804320613dfb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:08:19.222711 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7984edb3-39e9-401b-858b-804320613dfb None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:08:19.229086 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 556/1106] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jun 16 17:08:19 2022] GET /identity/v3/role_assignments?user.id=3d381bb41dea4f1e90c3cf3815ac88dc&scope.project.id=73015da4de1f48c29f57fff1040d2c10&role.id=db26ca9731b944aea5051916653e9ffd => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 17:08:20.572216 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f129b5-e9c9-4519-92dc-efa37a11dc45 None None] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:08:20.572781 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f129b5-e9c9-4519-92dc-efa37a11dc45 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:08:20.572781 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f129b5-e9c9-4519-92dc-efa37a11dc45 None None] PATH_INFO: `/` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:08:20.574206 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 551/1107] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 17:08:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:08:20.579275 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e291c6-a07f-4545-bb71-5c8a8dbb224d None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:08:20.579665 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e291c6-a07f-4545-bb71-5c8a8dbb224d None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:08:20.579848 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e291c6-a07f-4545-bb71-5c8a8dbb224d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:08:20.597364 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-02e291c6-a07f-4545-bb71-5c8a8dbb224d None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:08:20.598585 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-02e291c6-a07f-4545-bb71-5c8a8dbb224d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:08:20.662804 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 557/1108] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 17:08:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 17:08:20.687644 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f129b5-e9c9-4519-92dc-efa37a11dc45 None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:08:20.711871 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:08:20.786461 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f129b5-e9c9-4519-92dc-efa37a11dc45 None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:08:20.819466 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff32c98-b73a-4c9c-a550-8683a94fae91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:08:20.820796 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff32c98-b73a-4c9c-a550-8683a94fae91 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:08:20.821083 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff32c98-b73a-4c9c-a550-8683a94fae91 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:08:20.821361 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff32c98-b73a-4c9c-a550-8683a94fae91 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:08:20.822617 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff32c98-b73a-4c9c-a550-8683a94fae91 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:08:20.823994 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff32c98-b73a-4c9c-a550-8683a94fae91 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:08:20.825597 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 552/1109] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 17:08:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:08:20.831287 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e291c6-a07f-4545-bb71-5c8a8dbb224d None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:08:20.849334 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:08:20.930068 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e291c6-a07f-4545-bb71-5c8a8dbb224d None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:08:20.963578 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad78306-dff0-42b6-84b2-2c62fd09f6c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:08:20.964240 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad78306-dff0-42b6-84b2-2c62fd09f6c9 None admin] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:08:20.964531 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad78306-dff0-42b6-84b2-2c62fd09f6c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:08:20.964812 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad78306-dff0-42b6-84b2-2c62fd09f6c9 None admin] PATH_INFO: `/v3/users` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:08:20.965547 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad78306-dff0-42b6-84b2-2c62fd09f6c9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:08:20.967013 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad78306-dff0-42b6-84b2-2c62fd09f6c9 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:08:21.063883 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 558/1110] 10.222.0.39 () {60 vars in 1132 bytes} [Thu Jun 16 17:08:20 2022] POST /identity/v3/users => generated 286 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:08:23.197438 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e4963f-b827-4f20-b9af-185e11a018b8 None None] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:08:23.198010 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e4963f-b827-4f20-b9af-185e11a018b8 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:08:23.198010 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e4963f-b827-4f20-b9af-185e11a018b8 None None] PATH_INFO: `/` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:08:23.199308 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 553/1111] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 17:08:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:08:23.204396 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983354ea-b9d5-41b7-bc22-d22e7a6527b8 None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:08:23.204811 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983354ea-b9d5-41b7-bc22-d22e7a6527b8 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:08:23.204959 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983354ea-b9d5-41b7-bc22-d22e7a6527b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:08:23.222959 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-983354ea-b9d5-41b7-bc22-d22e7a6527b8 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:08:23.224144 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-983354ea-b9d5-41b7-bc22-d22e7a6527b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:08:23.289295 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 559/1112] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 17:08:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 17:08:23.312695 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e4963f-b827-4f20-b9af-185e11a018b8 None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:08:23.400027 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:08:23.409950 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e4963f-b827-4f20-b9af-185e11a018b8 None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:08:23.443592 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b241a42d-0418-4239-bdfc-3af13efbbf36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:08:23.444425 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b241a42d-0418-4239-bdfc-3af13efbbf36 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:08:23.444711 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b241a42d-0418-4239-bdfc-3af13efbbf36 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:08:23.445058 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b241a42d-0418-4239-bdfc-3af13efbbf36 None admin] PATH_INFO: `/v3/roles/9331b396c9894ab88267e7b82ef6f224` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:08:23.446564 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b241a42d-0418-4239-bdfc-3af13efbbf36 None admin] RBAC: Authorizing `identity:get_role(role_id=9331b396c9894ab88267e7b82ef6f224)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:08:23.452729 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b241a42d-0418-4239-bdfc-3af13efbbf36 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:08:23.452729 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 554/1113] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jun 16 17:08:23 2022] GET /identity/v3/roles/9331b396c9894ab88267e7b82ef6f224 => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:08:23.455037 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983354ea-b9d5-41b7-bc22-d22e7a6527b8 None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:08:23.458262 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:08:23.562051 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983354ea-b9d5-41b7-bc22-d22e7a6527b8 None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:08:23.594648 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720c3515-696a-47cf-bad7-c68989cd7597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:08:23.595515 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720c3515-696a-47cf-bad7-c68989cd7597 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:08:23.595798 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720c3515-696a-47cf-bad7-c68989cd7597 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:08:23.596115 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720c3515-696a-47cf-bad7-c68989cd7597 None admin] PATH_INFO: `/v3/users/5626d9718846484cb42c1d2fe53c2581` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:08:23.610308 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720c3515-696a-47cf-bad7-c68989cd7597 None admin] RBAC: Authorizing `identity:get_user(user_id=5626d9718846484cb42c1d2fe53c2581)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:08:23.611786 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720c3515-696a-47cf-bad7-c68989cd7597 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:08:23.613470 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 560/1114] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jun 16 17:08:23 2022] GET /identity/v3/users/5626d9718846484cb42c1d2fe53c2581 => generated 286 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:08:23.619954 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b241a42d-0418-4239-bdfc-3af13efbbf36 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:08:23.717850 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b241a42d-0418-4239-bdfc-3af13efbbf36 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:08:23.750930 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d445e151-4b85-44a7-9d31-1d2f35145826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:08:23.751568 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d445e151-4b85-44a7-9d31-1d2f35145826 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:08:23.751856 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d445e151-4b85-44a7-9d31-1d2f35145826 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:08:23.752139 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d445e151-4b85-44a7-9d31-1d2f35145826 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:08:23.778808 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:08:23.817976 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d445e151-4b85-44a7-9d31-1d2f35145826 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:08:23.819396 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d445e151-4b85-44a7-9d31-1d2f35145826 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:08:23.915869 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 555/1115] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 16 17:08:23 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 17:08:23.921707 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720c3515-696a-47cf-bad7-c68989cd7597 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:08:23.980824 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:08:24.017569 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720c3515-696a-47cf-bad7-c68989cd7597 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:08:24.049979 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474b3eb9-d4a8-4ea0-af4a-c4883b1107ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:08:24.050824 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474b3eb9-d4a8-4ea0-af4a-c4883b1107ac None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:08:24.051103 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474b3eb9-d4a8-4ea0-af4a-c4883b1107ac None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:08:24.051377 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474b3eb9-d4a8-4ea0-af4a-c4883b1107ac None admin] PATH_INFO: `/v3/projects/b4b3ecfc998f43e8897ed07279f5229f` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:08:24.052540 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474b3eb9-d4a8-4ea0-af4a-c4883b1107ac None admin] RBAC: Authorizing `identity:get_project(project_id=b4b3ecfc998f43e8897ed07279f5229f)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:08:24.053981 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474b3eb9-d4a8-4ea0-af4a-c4883b1107ac None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:08:24.055751 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 561/1116] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 16 17:08:23 2022] GET /identity/v3/projects/b4b3ecfc998f43e8897ed07279f5229f => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:08:24.061927 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d445e151-4b85-44a7-9d31-1d2f35145826 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:08:24.119030 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:08:24.159052 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d445e151-4b85-44a7-9d31-1d2f35145826 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:08:24.191108 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805f00e4-fc14-4c92-bd04-830563f6e9c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:08:24.191752 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805f00e4-fc14-4c92-bd04-830563f6e9c2 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:08:24.192036 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805f00e4-fc14-4c92-bd04-830563f6e9c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:08:24.192314 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805f00e4-fc14-4c92-bd04-830563f6e9c2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:08:24.193137 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805f00e4-fc14-4c92-bd04-830563f6e9c2 None admin] RBAC: Adding query filter params (role.id=9331b396c9894ab88267e7b82ef6f224, scope.project.id=b4b3ecfc998f43e8897ed07279f5229f, user.id=5626d9718846484cb42c1d2fe53c2581) {{(pid=80873) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:08:24.193453 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805f00e4-fc14-4c92-bd04-830563f6e9c2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:08:24.195480 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805f00e4-fc14-4c92-bd04-830563f6e9c2 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:08:24.200848 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 556/1117] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jun 16 17:08:24 2022] GET /identity/v3/role_assignments?user.id=5626d9718846484cb42c1d2fe53c2581&scope.project.id=b4b3ecfc998f43e8897ed07279f5229f&role.id=9331b396c9894ab88267e7b82ef6f224 => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:08:26.300524 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2129f00a-9c98-4450-b3e3-0775b898b76f None None] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:08:26.301031 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2129f00a-9c98-4450-b3e3-0775b898b76f None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:08:26.301031 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2129f00a-9c98-4450-b3e3-0775b898b76f None None] PATH_INFO: `/` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:08:26.302387 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 562/1118] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 17:08:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:08:26.307487 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5aa28f-f638-40ae-9180-98fe22ec57d4 None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:08:26.307897 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5aa28f-f638-40ae-9180-98fe22ec57d4 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:08:26.308050 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5aa28f-f638-40ae-9180-98fe22ec57d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:08:26.324941 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-3e5aa28f-f638-40ae-9180-98fe22ec57d4 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:08:26.326166 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-3e5aa28f-f638-40ae-9180-98fe22ec57d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:08:26.397044 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 557/1119] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 17:08:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 17:08:26.420085 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2129f00a-9c98-4450-b3e3-0775b898b76f None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:08:26.520824 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2129f00a-9c98-4450-b3e3-0775b898b76f None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:08:26.548735 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:08:26.554747 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c79b51f-5f89-432b-bcff-ee14f1ac2d5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:08:26.555530 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c79b51f-5f89-432b-bcff-ee14f1ac2d5a None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:08:26.555823 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c79b51f-5f89-432b-bcff-ee14f1ac2d5a None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:08:26.556102 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c79b51f-5f89-432b-bcff-ee14f1ac2d5a None admin] PATH_INFO: `/v3/roles/9331b396c9894ab88267e7b82ef6f224` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:08:26.557590 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c79b51f-5f89-432b-bcff-ee14f1ac2d5a None admin] RBAC: Authorizing `identity:get_role(role_id=9331b396c9894ab88267e7b82ef6f224)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:08:26.558983 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c79b51f-5f89-432b-bcff-ee14f1ac2d5a None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:08:26.560363 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 563/1120] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jun 16 17:08:26 2022] GET /identity/v3/roles/9331b396c9894ab88267e7b82ef6f224 => generated 223 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:08:26.566413 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5aa28f-f638-40ae-9180-98fe22ec57d4 None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:08:26.618450 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:08:26.664307 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5aa28f-f638-40ae-9180-98fe22ec57d4 None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:08:26.697904 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524b6482-8987-420a-88d5-4cc00a836190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:08:26.698760 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524b6482-8987-420a-88d5-4cc00a836190 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:08:26.699049 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524b6482-8987-420a-88d5-4cc00a836190 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:08:26.699332 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524b6482-8987-420a-88d5-4cc00a836190 None admin] PATH_INFO: `/v3/users/5626d9718846484cb42c1d2fe53c2581` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:08:26.700511 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524b6482-8987-420a-88d5-4cc00a836190 None admin] RBAC: Authorizing `identity:get_user(user_id=5626d9718846484cb42c1d2fe53c2581)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:08:26.701971 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524b6482-8987-420a-88d5-4cc00a836190 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:08:26.703613 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 558/1121] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jun 16 17:08:26 2022] GET /identity/v3/users/5626d9718846484cb42c1d2fe53c2581 => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:08:26.709315 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c79b51f-5f89-432b-bcff-ee14f1ac2d5a None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:08:26.808613 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c79b51f-5f89-432b-bcff-ee14f1ac2d5a None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:08:26.842078 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e57065-e043-4162-9dd4-2bbb0a71b91f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:08:26.842932 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e57065-e043-4162-9dd4-2bbb0a71b91f None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:08:26.843218 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e57065-e043-4162-9dd4-2bbb0a71b91f None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:08:26.843498 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e57065-e043-4162-9dd4-2bbb0a71b91f None admin] PATH_INFO: `/v3/projects/b4b3ecfc998f43e8897ed07279f5229f` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:08:26.844670 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e57065-e043-4162-9dd4-2bbb0a71b91f None admin] RBAC: Authorizing `identity:get_project(project_id=b4b3ecfc998f43e8897ed07279f5229f)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:08:26.846371 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e57065-e043-4162-9dd4-2bbb0a71b91f None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:08:26.848066 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 564/1122] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 16 17:08:26 2022] GET /identity/v3/projects/b4b3ecfc998f43e8897ed07279f5229f => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:08:26.854699 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524b6482-8987-420a-88d5-4cc00a836190 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:08:26.952610 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524b6482-8987-420a-88d5-4cc00a836190 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:08:26.972672 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:08:26.986860 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb31afbf-5e2d-4b66-a6fc-77b8d0342784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:08:26.987751 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb31afbf-5e2d-4b66-a6fc-77b8d0342784 None admin] REQUEST_METHOD: `PUT` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:08:26.988038 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb31afbf-5e2d-4b66-a6fc-77b8d0342784 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:08:26.988322 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb31afbf-5e2d-4b66-a6fc-77b8d0342784 None admin] PATH_INFO: `/v3/projects/b4b3ecfc998f43e8897ed07279f5229f/users/5626d9718846484cb42c1d2fe53c2581/roles/9331b396c9894ab88267e7b82ef6f224` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:08:26.990548 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb31afbf-5e2d-4b66-a6fc-77b8d0342784 None admin] RBAC: Authorizing `identity:create_grant(project_id=b4b3ecfc998f43e8897ed07279f5229f, user_id=5626d9718846484cb42c1d2fe53c2581, role_id=9331b396c9894ab88267e7b82ef6f224)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:08:26.992060 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb31afbf-5e2d-4b66-a6fc-77b8d0342784 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:08:27.064588 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 559/1123] 10.222.0.39 () {58 vars in 1439 bytes} [Thu Jun 16 17:08:26 2022] PUT /identity/v3/projects/b4b3ecfc998f43e8897ed07279f5229f/users/5626d9718846484cb42c1d2fe53c2581/roles/9331b396c9894ab88267e7b82ef6f224 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:08:29.200688 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d12f9a-04bd-480e-aeb2-e51ffd4cc82b None None] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:08:29.201197 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d12f9a-04bd-480e-aeb2-e51ffd4cc82b None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:08:29.201197 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d12f9a-04bd-480e-aeb2-e51ffd4cc82b None None] PATH_INFO: `/` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:08:29.202580 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 565/1124] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 17:08:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:08:29.207798 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bed308-4416-4de9-95bd-5d25f15f2e7b None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:08:29.208205 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bed308-4416-4de9-95bd-5d25f15f2e7b None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:08:29.208368 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bed308-4416-4de9-95bd-5d25f15f2e7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:08:29.225663 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-74bed308-4416-4de9-95bd-5d25f15f2e7b None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:08:29.227452 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-74bed308-4416-4de9-95bd-5d25f15f2e7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:08:29.292306 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 560/1125] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 17:08:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 17:08:29.315527 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d12f9a-04bd-480e-aeb2-e51ffd4cc82b None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:08:29.387520 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:08:29.431530 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d12f9a-04bd-480e-aeb2-e51ffd4cc82b None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:08:29.466643 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656c8880-1fd9-4a69-b618-4c4e9718bb95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:08:29.467433 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656c8880-1fd9-4a69-b618-4c4e9718bb95 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:08:29.467721 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656c8880-1fd9-4a69-b618-4c4e9718bb95 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:08:29.468004 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656c8880-1fd9-4a69-b618-4c4e9718bb95 None admin] PATH_INFO: `/v3/roles/9331b396c9894ab88267e7b82ef6f224` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:08:29.469483 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656c8880-1fd9-4a69-b618-4c4e9718bb95 None admin] RBAC: Authorizing `identity:get_role(role_id=9331b396c9894ab88267e7b82ef6f224)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:08:29.470892 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656c8880-1fd9-4a69-b618-4c4e9718bb95 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:08:29.472517 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 566/1126] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jun 16 17:08:29 2022] GET /identity/v3/roles/9331b396c9894ab88267e7b82ef6f224 => generated 223 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:08:29.478322 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bed308-4416-4de9-95bd-5d25f15f2e7b None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:08:29.586984 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bed308-4416-4de9-95bd-5d25f15f2e7b None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:08:29.597530 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:08:29.620877 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffcdd86-9866-4893-b297-e6df8b0d6c4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:08:29.621733 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffcdd86-9866-4893-b297-e6df8b0d6c4e None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:08:29.622053 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffcdd86-9866-4893-b297-e6df8b0d6c4e None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:08:29.622336 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffcdd86-9866-4893-b297-e6df8b0d6c4e None admin] PATH_INFO: `/v3/users/5626d9718846484cb42c1d2fe53c2581` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:08:29.623525 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffcdd86-9866-4893-b297-e6df8b0d6c4e None admin] RBAC: Authorizing `identity:get_user(user_id=5626d9718846484cb42c1d2fe53c2581)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:08:29.625059 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffcdd86-9866-4893-b297-e6df8b0d6c4e None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:08:29.626727 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 561/1127] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jun 16 17:08:29 2022] GET /identity/v3/users/5626d9718846484cb42c1d2fe53c2581 => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:08:29.632701 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656c8880-1fd9-4a69-b618-4c4e9718bb95 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:08:29.730896 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656c8880-1fd9-4a69-b618-4c4e9718bb95 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:08:29.764121 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f469e2ed-ef65-47d7-a4bd-7227e56fb7ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:08:29.764758 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f469e2ed-ef65-47d7-a4bd-7227e56fb7ce None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:08:29.765049 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f469e2ed-ef65-47d7-a4bd-7227e56fb7ce None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:08:29.765330 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f469e2ed-ef65-47d7-a4bd-7227e56fb7ce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:08:29.767948 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:08:29.830944 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f469e2ed-ef65-47d7-a4bd-7227e56fb7ce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:08:29.832389 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f469e2ed-ef65-47d7-a4bd-7227e56fb7ce None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:08:29.930899 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 567/1128] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 16 17:08:29 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 17:08:29.936707 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffcdd86-9866-4893-b297-e6df8b0d6c4e None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:08:30.032744 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffcdd86-9866-4893-b297-e6df8b0d6c4e None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:08:30.065654 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0e3dc7-c458-468e-9c4c-2480e6a7f371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:08:30.066518 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0e3dc7-c458-468e-9c4c-2480e6a7f371 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:08:30.066801 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0e3dc7-c458-468e-9c4c-2480e6a7f371 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:08:30.067074 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0e3dc7-c458-468e-9c4c-2480e6a7f371 None admin] PATH_INFO: `/v3/projects/b4b3ecfc998f43e8897ed07279f5229f` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:08:30.068237 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0e3dc7-c458-468e-9c4c-2480e6a7f371 None admin] RBAC: Authorizing `identity:get_project(project_id=b4b3ecfc998f43e8897ed07279f5229f)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:08:30.069716 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0e3dc7-c458-468e-9c4c-2480e6a7f371 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:08:30.071415 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 562/1129] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 16 17:08:29 2022] GET /identity/v3/projects/b4b3ecfc998f43e8897ed07279f5229f => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:08:30.077430 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f469e2ed-ef65-47d7-a4bd-7227e56fb7ce None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:08:30.110036 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:08:30.176118 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f469e2ed-ef65-47d7-a4bd-7227e56fb7ce None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:08:30.210198 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7542575-366e-40e2-800f-23f513d3f440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:08:30.211345 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7542575-366e-40e2-800f-23f513d3f440 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:08:30.211635 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7542575-366e-40e2-800f-23f513d3f440 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:08:30.211918 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7542575-366e-40e2-800f-23f513d3f440 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:08:30.212753 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7542575-366e-40e2-800f-23f513d3f440 None admin] RBAC: Adding query filter params (role.id=9331b396c9894ab88267e7b82ef6f224, scope.project.id=b4b3ecfc998f43e8897ed07279f5229f, user.id=5626d9718846484cb42c1d2fe53c2581) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:08:30.213074 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7542575-366e-40e2-800f-23f513d3f440 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:08:30.214523 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7542575-366e-40e2-800f-23f513d3f440 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:08:30.220274 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 568/1130] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jun 16 17:08:30 2022] GET /identity/v3/role_assignments?user.id=5626d9718846484cb42c1d2fe53c2581&scope.project.id=b4b3ecfc998f43e8897ed07279f5229f&role.id=9331b396c9894ab88267e7b82ef6f224 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:08:32.355312 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42a4471-37c6-46e7-8794-1628e95bb2a7 None None] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:08:32.355815 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42a4471-37c6-46e7-8794-1628e95bb2a7 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:08:32.355815 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42a4471-37c6-46e7-8794-1628e95bb2a7 None None] PATH_INFO: `/` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:08:32.357163 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 563/1131] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 17:08:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:08:32.362236 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38796b94-344f-4f25-9eec-262dd0f7d4fe None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:08:32.362656 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38796b94-344f-4f25-9eec-262dd0f7d4fe None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:08:32.362813 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38796b94-344f-4f25-9eec-262dd0f7d4fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:08:32.379338 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-38796b94-344f-4f25-9eec-262dd0f7d4fe None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:08:32.380524 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-38796b94-344f-4f25-9eec-262dd0f7d4fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:08:32.446294 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 569/1132] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 17:08:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 17:08:32.470083 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42a4471-37c6-46e7-8794-1628e95bb2a7 None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:08:32.516801 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:08:32.568513 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42a4471-37c6-46e7-8794-1628e95bb2a7 None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:08:32.601893 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e69eb90-5298-45d6-9c08-6cb12d4c4ff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:08:32.602670 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e69eb90-5298-45d6-9c08-6cb12d4c4ff1 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:08:32.602954 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e69eb90-5298-45d6-9c08-6cb12d4c4ff1 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:08:32.603231 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e69eb90-5298-45d6-9c08-6cb12d4c4ff1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:08:32.604390 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e69eb90-5298-45d6-9c08-6cb12d4c4ff1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:08:32.605875 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e69eb90-5298-45d6-9c08-6cb12d4c4ff1 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:08:32.607420 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 564/1133] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 17:08:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:08:32.613210 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38796b94-344f-4f25-9eec-262dd0f7d4fe None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:08:32.643228 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:08:32.715815 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38796b94-344f-4f25-9eec-262dd0f7d4fe None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:08:32.750067 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73155ec8-30d9-4f79-bb9c-35002a058f0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:08:32.750736 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73155ec8-30d9-4f79-bb9c-35002a058f0b None admin] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:08:32.751026 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73155ec8-30d9-4f79-bb9c-35002a058f0b None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:08:32.751306 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73155ec8-30d9-4f79-bb9c-35002a058f0b None admin] PATH_INFO: `/v3/projects` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:08:32.752031 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73155ec8-30d9-4f79-bb9c-35002a058f0b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:08:32.753466 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73155ec8-30d9-4f79-bb9c-35002a058f0b None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:08:32.854028 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 570/1134] 10.222.0.39 () {60 vars in 1141 bytes} [Thu Jun 16 17:08:32 2022] POST /identity/v3/projects => generated 311 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:08:34.987094 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547eef59-2e0f-4797-a6a9-88cff52b3693 None None] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:08:34.987609 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547eef59-2e0f-4797-a6a9-88cff52b3693 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:08:34.987725 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547eef59-2e0f-4797-a6a9-88cff52b3693 None None] PATH_INFO: `/` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:08:34.989023 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 565/1135] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 17:08:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:08:34.994099 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb3d1ee-9929-4aaa-aaf2-4b4c07a4e5be None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:08:34.994493 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb3d1ee-9929-4aaa-aaf2-4b4c07a4e5be None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:08:34.994666 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb3d1ee-9929-4aaa-aaf2-4b4c07a4e5be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:08:35.011883 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-4eb3d1ee-9929-4aaa-aaf2-4b4c07a4e5be None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:08:35.013059 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-4eb3d1ee-9929-4aaa-aaf2-4b4c07a4e5be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:08:35.076682 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 571/1136] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 17:08:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 17:08:35.102204 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547eef59-2e0f-4797-a6a9-88cff52b3693 None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:08:35.202511 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547eef59-2e0f-4797-a6a9-88cff52b3693 None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:08:35.216209 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:08:35.235497 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd766825-e0e8-458a-9d11-c6c34561d002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:08:35.236277 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd766825-e0e8-458a-9d11-c6c34561d002 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:08:35.236565 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd766825-e0e8-458a-9d11-c6c34561d002 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:08:35.236845 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd766825-e0e8-458a-9d11-c6c34561d002 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:08:35.238047 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd766825-e0e8-458a-9d11-c6c34561d002 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:08:35.239511 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd766825-e0e8-458a-9d11-c6c34561d002 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:08:35.241900 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 566/1137] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 17:08:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:08:35.247744 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb3d1ee-9929-4aaa-aaf2-4b4c07a4e5be None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:08:35.259880 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:08:35.344885 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb3d1ee-9929-4aaa-aaf2-4b4c07a4e5be None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:08:35.378740 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5999ae6d-24b4-4631-a93c-5afe65086118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:08:35.379404 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5999ae6d-24b4-4631-a93c-5afe65086118 None admin] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:08:35.379695 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5999ae6d-24b4-4631-a93c-5afe65086118 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:08:35.379977 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5999ae6d-24b4-4631-a93c-5afe65086118 None admin] PATH_INFO: `/v3/users` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:08:35.380693 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5999ae6d-24b4-4631-a93c-5afe65086118 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:08:35.382198 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5999ae6d-24b4-4631-a93c-5afe65086118 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:08:35.494658 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 572/1138] 10.222.0.39 () {60 vars in 1132 bytes} [Thu Jun 16 17:08:35 2022] POST /identity/v3/users => generated 286 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:08:37.673028 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d34e44-bcb6-4a38-9ecf-c563c670e9e9 None None] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:08:37.673669 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d34e44-bcb6-4a38-9ecf-c563c670e9e9 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:08:37.673669 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d34e44-bcb6-4a38-9ecf-c563c670e9e9 None None] PATH_INFO: `/` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:08:37.675014 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 567/1139] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 17:08:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:08:37.680236 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6ebf5c-83a6-4ed0-9777-d01e7fa0c5e4 None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:08:37.680615 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6ebf5c-83a6-4ed0-9777-d01e7fa0c5e4 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:08:37.680802 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6ebf5c-83a6-4ed0-9777-d01e7fa0c5e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:08:37.697748 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-aa6ebf5c-83a6-4ed0-9777-d01e7fa0c5e4 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:08:37.698965 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-aa6ebf5c-83a6-4ed0-9777-d01e7fa0c5e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:08:37.757693 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:08:37.765091 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 573/1140] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 17:08:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 17:08:37.789300 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d34e44-bcb6-4a38-9ecf-c563c670e9e9 None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:08:37.892590 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d34e44-bcb6-4a38-9ecf-c563c670e9e9 None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:08:37.925992 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af25cc69-029e-4459-a7f1-32918f0664cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:08:37.926716 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af25cc69-029e-4459-a7f1-32918f0664cb None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:08:37.927005 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af25cc69-029e-4459-a7f1-32918f0664cb None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:08:37.927288 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af25cc69-029e-4459-a7f1-32918f0664cb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:08:37.937817 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af25cc69-029e-4459-a7f1-32918f0664cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 17:08:37.945968 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application [None req-af25cc69-029e-4459-a7f1-32918f0664cb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 17:08:37.945968 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:08:37.945968 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:08:37.945968 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:08:37.945968 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:08:37.945968 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:08:37.945968 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:08:37.945968 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:08:37.945968 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:08:37.945968 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:08:37.945968 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:08:37.945968 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:08:37.945968 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 17:08:37.945968 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 17:08:37.945968 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 17:08:37.945968 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 17:08:37.947121 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 17:08:37.947121 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 17:08:37.947121 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 17:08:37.947121 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 17:08:37.947121 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:08:37.947121 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:08:37.947121 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:08:37.947121 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:08:37.947121 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:08:37.947121 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:08:37.947121 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:08:37.947121 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application with Lock( Jun 16 17:08:37.947121 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:08:37.947121 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:08:37.947121 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:08:37.947121 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:08:37.948166 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:08:37.948166 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:08:37.948166 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:08:37.948166 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:08:37.948166 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 17:08:37.948166 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 17:08:37.948166 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 17:08:37.948166 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 17:08:37.948166 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 17:08:37.948166 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 17:08:37.948166 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 17:08:37.948166 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Jun 16 17:08:37.948166 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 568/1141] 10.222.0.39 () {56 vars in 1096 bytes} [Thu Jun 16 17:08:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:08:37.953174 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6ebf5c-83a6-4ed0-9777-d01e7fa0c5e4 None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:08:38.050948 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6ebf5c-83a6-4ed0-9777-d01e7fa0c5e4 None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:08:38.083407 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746a2485-5672-41bf-82b6-2d54aa1ba2f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:08:38.084057 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746a2485-5672-41bf-82b6-2d54aa1ba2f6 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:08:38.084340 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746a2485-5672-41bf-82b6-2d54aa1ba2f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:08:38.085149 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746a2485-5672-41bf-82b6-2d54aa1ba2f6 None admin] PATH_INFO: `/v3/roles` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:08:38.085919 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746a2485-5672-41bf-82b6-2d54aa1ba2f6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:08:38.086233 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746a2485-5672-41bf-82b6-2d54aa1ba2f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:08:38.087727 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746a2485-5672-41bf-82b6-2d54aa1ba2f6 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:08:38.095735 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 574/1142] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 16 17:08:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 17:08:38.102290 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af25cc69-029e-4459-a7f1-32918f0664cb None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:08:38.144055 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:08:38.201525 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af25cc69-029e-4459-a7f1-32918f0664cb None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:08:38.233873 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70061b6f-0c61-4202-8402-be7a2604a762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:08:38.234729 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70061b6f-0c61-4202-8402-be7a2604a762 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:08:38.235016 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70061b6f-0c61-4202-8402-be7a2604a762 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:08:38.235297 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70061b6f-0c61-4202-8402-be7a2604a762 None admin] PATH_INFO: `/v3/users/5cbc1d57153c4ad4bd6583d69240dbee` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:08:38.249727 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70061b6f-0c61-4202-8402-be7a2604a762 None admin] RBAC: Authorizing `identity:get_user(user_id=5cbc1d57153c4ad4bd6583d69240dbee)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:08:38.251276 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70061b6f-0c61-4202-8402-be7a2604a762 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:08:38.252945 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 569/1143] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jun 16 17:08:38 2022] GET /identity/v3/users/5cbc1d57153c4ad4bd6583d69240dbee => generated 286 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:08:38.259452 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746a2485-5672-41bf-82b6-2d54aa1ba2f6 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:08:38.317392 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:08:38.359259 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746a2485-5672-41bf-82b6-2d54aa1ba2f6 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:08:38.392188 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd3e126-7071-4d52-863d-569353032009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:08:38.392870 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd3e126-7071-4d52-863d-569353032009 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:08:38.393170 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd3e126-7071-4d52-863d-569353032009 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:08:38.393452 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd3e126-7071-4d52-863d-569353032009 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:08:38.459277 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd3e126-7071-4d52-863d-569353032009 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:08:38.460692 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd3e126-7071-4d52-863d-569353032009 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:08:38.516680 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:08:38.559270 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 575/1144] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 16 17:08:38 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 17:08:38.565272 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70061b6f-0c61-4202-8402-be7a2604a762 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:08:38.660599 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:08:38.663615 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70061b6f-0c61-4202-8402-be7a2604a762 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:08:38.697271 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1ccd3c-4437-4e02-abf6-198a6af5dc1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:08:38.698280 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1ccd3c-4437-4e02-abf6-198a6af5dc1d None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:08:38.698562 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1ccd3c-4437-4e02-abf6-198a6af5dc1d None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:08:38.698839 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1ccd3c-4437-4e02-abf6-198a6af5dc1d None admin] PATH_INFO: `/v3/projects/f0fb4ae7cd914ed6907cb46d8c41b474` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:08:38.700003 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1ccd3c-4437-4e02-abf6-198a6af5dc1d None admin] RBAC: Authorizing `identity:get_project(project_id=f0fb4ae7cd914ed6907cb46d8c41b474)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:08:38.701423 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1ccd3c-4437-4e02-abf6-198a6af5dc1d None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:08:38.703213 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 570/1145] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 16 17:08:38 2022] GET /identity/v3/projects/f0fb4ae7cd914ed6907cb46d8c41b474 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:08:38.709448 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd3e126-7071-4d52-863d-569353032009 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:08:38.804991 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd3e126-7071-4d52-863d-569353032009 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:08:38.838164 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66457ab8-00aa-428b-8363-cfc6e9bf1efb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:08:38.838809 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66457ab8-00aa-428b-8363-cfc6e9bf1efb None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:08:38.839092 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66457ab8-00aa-428b-8363-cfc6e9bf1efb None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:08:38.839367 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66457ab8-00aa-428b-8363-cfc6e9bf1efb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:08:38.840188 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66457ab8-00aa-428b-8363-cfc6e9bf1efb None admin] RBAC: Adding query filter params (role.id=dba744f8ab2a4c45b9d3212f8d203aba, scope.project.id=f0fb4ae7cd914ed6907cb46d8c41b474, user.id=5cbc1d57153c4ad4bd6583d69240dbee) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:08:38.840502 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66457ab8-00aa-428b-8363-cfc6e9bf1efb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:08:38.841938 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66457ab8-00aa-428b-8363-cfc6e9bf1efb None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:08:38.847548 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 576/1146] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jun 16 17:08:38 2022] GET /identity/v3/role_assignments?user.id=5cbc1d57153c4ad4bd6583d69240dbee&scope.project.id=f0fb4ae7cd914ed6907cb46d8c41b474&role.id=dba744f8ab2a4c45b9d3212f8d203aba => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:08:40.960021 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb60bae-a346-4404-a315-e88ffcc20540 None None] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:08:40.960541 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb60bae-a346-4404-a315-e88ffcc20540 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:08:40.960630 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb60bae-a346-4404-a315-e88ffcc20540 None None] PATH_INFO: `/` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:08:40.961966 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 571/1147] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 17:08:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:08:40.967050 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bd9954-88d1-4b7c-8bf6-efb84431c762 None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:08:40.967436 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bd9954-88d1-4b7c-8bf6-efb84431c762 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:08:40.967623 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bd9954-88d1-4b7c-8bf6-efb84431c762 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:08:40.985004 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-25bd9954-88d1-4b7c-8bf6-efb84431c762 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:08:40.986238 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-25bd9954-88d1-4b7c-8bf6-efb84431c762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:08:41.002317 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:08:41.052477 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 577/1148] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 17:08:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 17:08:41.075493 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb60bae-a346-4404-a315-e88ffcc20540 None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:08:41.195539 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb60bae-a346-4404-a315-e88ffcc20540 None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:08:41.229337 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909db05f-ea68-40cc-8720-8db3ae833032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:08:41.230156 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909db05f-ea68-40cc-8720-8db3ae833032 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:08:41.230445 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909db05f-ea68-40cc-8720-8db3ae833032 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:08:41.230726 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909db05f-ea68-40cc-8720-8db3ae833032 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:08:41.241139 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909db05f-ea68-40cc-8720-8db3ae833032 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 17:08:41.248722 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application [None req-909db05f-ea68-40cc-8720-8db3ae833032 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 17:08:41.248722 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:08:41.248722 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:08:41.248722 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:08:41.248722 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:08:41.248722 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:08:41.248722 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:08:41.248722 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:08:41.248722 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:08:41.248722 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:08:41.248722 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:08:41.248722 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:08:41.248722 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 17:08:41.248722 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 17:08:41.248722 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 17:08:41.248722 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 17:08:41.249851 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 17:08:41.249851 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 17:08:41.249851 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 17:08:41.249851 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 17:08:41.249851 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:08:41.249851 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:08:41.249851 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:08:41.249851 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:08:41.249851 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:08:41.249851 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:08:41.249851 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:08:41.249851 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application with Lock( Jun 16 17:08:41.249851 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:08:41.249851 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:08:41.249851 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:08:41.249851 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:08:41.250934 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:08:41.250934 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:08:41.250934 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:08:41.250934 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:08:41.250934 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 17:08:41.250934 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 17:08:41.250934 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 17:08:41.250934 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 17:08:41.250934 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 17:08:41.250934 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 17:08:41.250934 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 17:08:41.250934 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Jun 16 17:08:41.250934 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 572/1149] 10.222.0.39 () {56 vars in 1096 bytes} [Thu Jun 16 17:08:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:08:41.256298 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bd9954-88d1-4b7c-8bf6-efb84431c762 None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:08:41.354024 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bd9954-88d1-4b7c-8bf6-efb84431c762 None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:08:41.387965 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cc1e32-a517-4906-93cd-de3ad8b4cb4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:08:41.388634 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cc1e32-a517-4906-93cd-de3ad8b4cb4e None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:08:41.388925 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cc1e32-a517-4906-93cd-de3ad8b4cb4e None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:08:41.389211 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cc1e32-a517-4906-93cd-de3ad8b4cb4e None admin] PATH_INFO: `/v3/roles` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:08:41.389997 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cc1e32-a517-4906-93cd-de3ad8b4cb4e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:08:41.390314 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cc1e32-a517-4906-93cd-de3ad8b4cb4e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:08:41.391685 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cc1e32-a517-4906-93cd-de3ad8b4cb4e None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:08:41.399575 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 578/1150] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 16 17:08:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:08:41.405398 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909db05f-ea68-40cc-8720-8db3ae833032 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:08:41.434837 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:08:41.516359 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909db05f-ea68-40cc-8720-8db3ae833032 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:08:41.550891 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5e1bed-3865-4f45-936e-0b622ecbccd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:08:41.551767 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5e1bed-3865-4f45-936e-0b622ecbccd1 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:08:41.552049 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5e1bed-3865-4f45-936e-0b622ecbccd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:08:41.552325 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5e1bed-3865-4f45-936e-0b622ecbccd1 None admin] PATH_INFO: `/v3/users/5cbc1d57153c4ad4bd6583d69240dbee` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:08:41.554305 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5e1bed-3865-4f45-936e-0b622ecbccd1 None admin] RBAC: Authorizing `identity:get_user(user_id=5cbc1d57153c4ad4bd6583d69240dbee)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:08:41.555721 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5e1bed-3865-4f45-936e-0b622ecbccd1 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:08:41.557353 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 573/1151] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jun 16 17:08:41 2022] GET /identity/v3/users/5cbc1d57153c4ad4bd6583d69240dbee => generated 286 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:08:41.563169 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cc1e32-a517-4906-93cd-de3ad8b4cb4e None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:08:41.579054 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:08:41.674444 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cc1e32-a517-4906-93cd-de3ad8b4cb4e None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:08:41.706642 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268d03a9-5bc7-4a45-8b3f-276b5e4f49c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:08:41.707503 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268d03a9-5bc7-4a45-8b3f-276b5e4f49c6 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:08:41.707789 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268d03a9-5bc7-4a45-8b3f-276b5e4f49c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:08:41.708069 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268d03a9-5bc7-4a45-8b3f-276b5e4f49c6 None admin] PATH_INFO: `/v3/projects/f0fb4ae7cd914ed6907cb46d8c41b474` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:08:41.709752 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268d03a9-5bc7-4a45-8b3f-276b5e4f49c6 None admin] RBAC: Authorizing `identity:get_project(project_id=f0fb4ae7cd914ed6907cb46d8c41b474)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:08:41.711212 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268d03a9-5bc7-4a45-8b3f-276b5e4f49c6 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:08:41.712909 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 579/1152] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 16 17:08:41 2022] GET /identity/v3/projects/f0fb4ae7cd914ed6907cb46d8c41b474 => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:08:41.718886 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5e1bed-3865-4f45-936e-0b622ecbccd1 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:08:41.811463 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:08:41.817235 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5e1bed-3865-4f45-936e-0b622ecbccd1 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:08:41.852978 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb71da3d-d253-47a9-aad8-1133311bf552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:08:41.853884 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb71da3d-d253-47a9-aad8-1133311bf552 None admin] REQUEST_METHOD: `PUT` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:08:41.854175 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb71da3d-d253-47a9-aad8-1133311bf552 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:08:41.854457 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb71da3d-d253-47a9-aad8-1133311bf552 None admin] PATH_INFO: `/v3/projects/f0fb4ae7cd914ed6907cb46d8c41b474/users/5cbc1d57153c4ad4bd6583d69240dbee/roles/dba744f8ab2a4c45b9d3212f8d203aba` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:08:41.856413 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb71da3d-d253-47a9-aad8-1133311bf552 None admin] RBAC: Authorizing `identity:create_grant(project_id=f0fb4ae7cd914ed6907cb46d8c41b474, user_id=5cbc1d57153c4ad4bd6583d69240dbee, role_id=dba744f8ab2a4c45b9d3212f8d203aba)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:08:41.857864 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb71da3d-d253-47a9-aad8-1133311bf552 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:08:41.956634 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 574/1153] 10.222.0.39 () {58 vars in 1439 bytes} [Thu Jun 16 17:08:41 2022] PUT /identity/v3/projects/f0fb4ae7cd914ed6907cb46d8c41b474/users/5cbc1d57153c4ad4bd6583d69240dbee/roles/dba744f8ab2a4c45b9d3212f8d203aba => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:08:44.075233 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead1c13b-8476-4f6b-9dcb-c72820a2e17f None None] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:08:44.075794 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead1c13b-8476-4f6b-9dcb-c72820a2e17f None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:08:44.075794 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead1c13b-8476-4f6b-9dcb-c72820a2e17f None None] PATH_INFO: `/` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:08:44.077302 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 580/1154] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 17:08:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:08:44.082659 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c56dd4-0571-4f7a-bfb0-d6d6a7e62a48 None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:08:44.083081 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c56dd4-0571-4f7a-bfb0-d6d6a7e62a48 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:08:44.083218 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c56dd4-0571-4f7a-bfb0-d6d6a7e62a48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:08:44.101218 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-68c56dd4-0571-4f7a-bfb0-d6d6a7e62a48 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:08:44.102417 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-68c56dd4-0571-4f7a-bfb0-d6d6a7e62a48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:08:44.166741 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 575/1155] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 17:08:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 17:08:44.190017 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead1c13b-8476-4f6b-9dcb-c72820a2e17f None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:08:44.272360 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:08:44.290467 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead1c13b-8476-4f6b-9dcb-c72820a2e17f None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:08:44.325112 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611823f9-a551-41fc-a286-f5517c27bea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:08:44.325926 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611823f9-a551-41fc-a286-f5517c27bea1 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:08:44.326219 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611823f9-a551-41fc-a286-f5517c27bea1 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:08:44.326503 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611823f9-a551-41fc-a286-f5517c27bea1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:08:44.337043 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611823f9-a551-41fc-a286-f5517c27bea1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 17:08:44.344654 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application [None req-611823f9-a551-41fc-a286-f5517c27bea1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 17:08:44.344654 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:08:44.344654 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:08:44.344654 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:08:44.344654 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:08:44.344654 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:08:44.344654 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:08:44.344654 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:08:44.344654 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:08:44.344654 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:08:44.344654 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:08:44.344654 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:08:44.344654 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 17:08:44.344654 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 17:08:44.344654 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 17:08:44.344654 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 17:08:44.347180 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 17:08:44.347180 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 17:08:44.347180 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 17:08:44.347180 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 17:08:44.347180 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:08:44.347180 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:08:44.347180 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:08:44.347180 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:08:44.347180 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:08:44.347180 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:08:44.347180 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:08:44.347180 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application with Lock( Jun 16 17:08:44.347180 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:08:44.347180 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:08:44.347180 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:08:44.347180 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:08:44.348309 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:08:44.348309 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:08:44.348309 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:08:44.348309 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:08:44.348309 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 17:08:44.348309 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 17:08:44.348309 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 17:08:44.348309 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 17:08:44.348309 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 17:08:44.348309 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 17:08:44.348309 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 17:08:44.348309 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Jun 16 17:08:44.348309 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 581/1156] 10.222.0.39 () {56 vars in 1096 bytes} [Thu Jun 16 17:08:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:08:44.352802 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c56dd4-0571-4f7a-bfb0-d6d6a7e62a48 None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:08:44.435589 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:08:44.450202 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c56dd4-0571-4f7a-bfb0-d6d6a7e62a48 None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:08:44.484110 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befcb7a1-4225-46b4-a911-e43f20d266d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:08:44.484774 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befcb7a1-4225-46b4-a911-e43f20d266d1 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:08:44.485061 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befcb7a1-4225-46b4-a911-e43f20d266d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:08:44.485342 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befcb7a1-4225-46b4-a911-e43f20d266d1 None admin] PATH_INFO: `/v3/roles` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:08:44.486117 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befcb7a1-4225-46b4-a911-e43f20d266d1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80873) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:08:44.486457 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befcb7a1-4225-46b4-a911-e43f20d266d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:08:44.487814 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befcb7a1-4225-46b4-a911-e43f20d266d1 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:08:44.497297 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 576/1157] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 16 17:08:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:08:44.504568 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611823f9-a551-41fc-a286-f5517c27bea1 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:08:44.607912 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611823f9-a551-41fc-a286-f5517c27bea1 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:08:44.640985 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2201f5-19ad-481b-a097-045c7bd2a5e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:08:44.641865 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2201f5-19ad-481b-a097-045c7bd2a5e8 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:08:44.642148 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2201f5-19ad-481b-a097-045c7bd2a5e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:08:44.642420 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2201f5-19ad-481b-a097-045c7bd2a5e8 None admin] PATH_INFO: `/v3/users/5cbc1d57153c4ad4bd6583d69240dbee` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:08:44.643590 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2201f5-19ad-481b-a097-045c7bd2a5e8 None admin] RBAC: Authorizing `identity:get_user(user_id=5cbc1d57153c4ad4bd6583d69240dbee)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:08:44.645004 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2201f5-19ad-481b-a097-045c7bd2a5e8 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:08:44.647400 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 582/1158] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jun 16 17:08:44 2022] GET /identity/v3/users/5cbc1d57153c4ad4bd6583d69240dbee => generated 286 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:08:44.653159 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befcb7a1-4225-46b4-a911-e43f20d266d1 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:08:44.751511 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befcb7a1-4225-46b4-a911-e43f20d266d1 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:08:44.784262 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba537d8-45e4-4a6c-88a5-69e2737678a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:08:44.784906 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba537d8-45e4-4a6c-88a5-69e2737678a0 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:08:44.785196 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba537d8-45e4-4a6c-88a5-69e2737678a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:08:44.785477 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba537d8-45e4-4a6c-88a5-69e2737678a0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:08:44.802573 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:08:44.861409 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba537d8-45e4-4a6c-88a5-69e2737678a0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:08:44.862878 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba537d8-45e4-4a6c-88a5-69e2737678a0 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:08:44.960529 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 577/1159] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 16 17:08:44 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 17:08:44.966417 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2201f5-19ad-481b-a097-045c7bd2a5e8 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:08:44.979761 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:08:45.066335 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2201f5-19ad-481b-a097-045c7bd2a5e8 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:08:45.100351 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094b3dec-3ea3-4b2d-9fa2-dd2a9503ba43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:08:45.101206 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094b3dec-3ea3-4b2d-9fa2-dd2a9503ba43 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:08:45.101495 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094b3dec-3ea3-4b2d-9fa2-dd2a9503ba43 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:08:45.101799 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094b3dec-3ea3-4b2d-9fa2-dd2a9503ba43 None admin] PATH_INFO: `/v3/projects/f0fb4ae7cd914ed6907cb46d8c41b474` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:08:45.102987 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094b3dec-3ea3-4b2d-9fa2-dd2a9503ba43 None admin] RBAC: Authorizing `identity:get_project(project_id=f0fb4ae7cd914ed6907cb46d8c41b474)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:08:45.104413 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094b3dec-3ea3-4b2d-9fa2-dd2a9503ba43 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:08:45.106147 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 583/1160] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 16 17:08:44 2022] GET /identity/v3/projects/f0fb4ae7cd914ed6907cb46d8c41b474 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:08:45.112204 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba537d8-45e4-4a6c-88a5-69e2737678a0 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:08:45.159618 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:08:45.207741 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba537d8-45e4-4a6c-88a5-69e2737678a0 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:08:45.241633 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29510a41-b190-4044-8e54-71008953dbf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:08:45.242308 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29510a41-b190-4044-8e54-71008953dbf2 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:08:45.242596 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29510a41-b190-4044-8e54-71008953dbf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:08:45.242876 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29510a41-b190-4044-8e54-71008953dbf2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:08:45.243700 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29510a41-b190-4044-8e54-71008953dbf2 None admin] RBAC: Adding query filter params (role.id=dba744f8ab2a4c45b9d3212f8d203aba, scope.project.id=f0fb4ae7cd914ed6907cb46d8c41b474, user.id=5cbc1d57153c4ad4bd6583d69240dbee) {{(pid=80873) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:08:45.244015 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29510a41-b190-4044-8e54-71008953dbf2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:08:45.245438 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29510a41-b190-4044-8e54-71008953dbf2 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:08:45.251272 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 578/1161] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jun 16 17:08:45 2022] GET /identity/v3/role_assignments?user.id=5cbc1d57153c4ad4bd6583d69240dbee&scope.project.id=f0fb4ae7cd914ed6907cb46d8c41b474&role.id=dba744f8ab2a4c45b9d3212f8d203aba => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:08:47.393014 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233e87a3-1754-4a85-a325-49df9ff4bca9 None None] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:08:47.393560 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233e87a3-1754-4a85-a325-49df9ff4bca9 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:08:47.393666 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233e87a3-1754-4a85-a325-49df9ff4bca9 None None] PATH_INFO: `/` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:08:47.395002 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 584/1162] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 17:08:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:08:47.400666 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ec6202-92db-4b65-b3a4-751130a29962 None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:08:47.401112 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ec6202-92db-4b65-b3a4-751130a29962 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:08:47.401218 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ec6202-92db-4b65-b3a4-751130a29962 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:08:47.417993 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-b4ec6202-92db-4b65-b3a4-751130a29962 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:08:47.419161 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-b4ec6202-92db-4b65-b3a4-751130a29962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:08:47.486947 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 579/1163] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 17:08:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 17:08:47.510256 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233e87a3-1754-4a85-a325-49df9ff4bca9 None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:08:47.587684 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:08:47.610936 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233e87a3-1754-4a85-a325-49df9ff4bca9 None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:08:47.652132 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8d9432-d9f6-46e0-9ff2-64bf6b428e49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:08:47.652697 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8d9432-d9f6-46e0-9ff2-64bf6b428e49 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:08:47.652980 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8d9432-d9f6-46e0-9ff2-64bf6b428e49 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:08:47.653256 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8d9432-d9f6-46e0-9ff2-64bf6b428e49 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:08:47.724435 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8d9432-d9f6-46e0-9ff2-64bf6b428e49 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:08:47.727835 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8d9432-d9f6-46e0-9ff2-64bf6b428e49 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:08:47.806595 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:08:47.828160 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 585/1164] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 16 17:08:47 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 17:08:47.834255 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ec6202-92db-4b65-b3a4-751130a29962 None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:08:47.875851 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:08:47.931243 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ec6202-92db-4b65-b3a4-751130a29962 None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:08:47.964840 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619c29c8-4f9d-4d08-bfaa-3ce97a8f079e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:08:47.965631 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619c29c8-4f9d-4d08-bfaa-3ce97a8f079e None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:08:47.965947 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619c29c8-4f9d-4d08-bfaa-3ce97a8f079e None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:08:47.966233 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619c29c8-4f9d-4d08-bfaa-3ce97a8f079e None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:08:47.972964 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619c29c8-4f9d-4d08-bfaa-3ce97a8f079e None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:08:47.974589 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619c29c8-4f9d-4d08-bfaa-3ce97a8f079e None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:08:47.988369 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application [None req-619c29c8-4f9d-4d08-bfaa-3ce97a8f079e None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 16 17:08:47.988369 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:08:47.988369 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jun 16 17:08:47.988369 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jun 16 17:08:47.988369 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 17:08:47.988369 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 17:08:47.988369 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 17:08:47.988369 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 17:08:47.988369 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jun 16 17:08:47.988369 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Jun 16 17:08:47.988369 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 17:08:47.988369 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Jun 16 17:08:47.988369 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:08:47.988369 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:08:47.988369 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:08:47.988369 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:08:47.988369 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:08:47.989667 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:08:47.989667 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:08:47.989667 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:08:47.989667 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:08:47.989667 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:08:47.989667 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:08:47.989667 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 17:08:47.989667 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 17:08:47.989667 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 17:08:47.989667 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 17:08:47.989667 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:08:47.989667 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:08:47.989667 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:08:47.989667 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:08:47.989667 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:08:47.989667 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:08:47.991394 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:08:47.991394 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application with Lock( Jun 16 17:08:47.991394 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:08:47.991394 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:08:47.991394 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:08:47.991394 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:08:47.991394 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:08:47.991394 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:08:47.991394 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:08:47.991394 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:08:47.991394 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jun 16 17:08:47.991394 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 17:08:47.991394 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 16 17:08:47.991394 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Jun 16 17:08:47.991394 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 580/1165] 10.222.0.39 () {56 vars in 1117 bytes} [Thu Jun 16 17:08:47 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:08:47.996206 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8d9432-d9f6-46e0-9ff2-64bf6b428e49 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:08:48.092219 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8d9432-d9f6-46e0-9ff2-64bf6b428e49 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:08:48.125828 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15c79f8-39a3-4bbc-847b-c8ec8f474765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:08:48.126481 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15c79f8-39a3-4bbc-847b-c8ec8f474765 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:08:48.126767 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15c79f8-39a3-4bbc-847b-c8ec8f474765 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:08:48.127045 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15c79f8-39a3-4bbc-847b-c8ec8f474765 None admin] PATH_INFO: `/v3/domains` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:08:48.127758 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15c79f8-39a3-4bbc-847b-c8ec8f474765 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:08:48.128067 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15c79f8-39a3-4bbc-847b-c8ec8f474765 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:08:48.129420 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15c79f8-39a3-4bbc-847b-c8ec8f474765 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:08:48.136453 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 586/1166] 10.222.0.39 () {56 vars in 1115 bytes} [Thu Jun 16 17:08:47 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:08:50.237054 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f33683-fe19-4abc-b586-2f085939b847 None None] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:08:50.237581 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f33683-fe19-4abc-b586-2f085939b847 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:08:50.237581 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f33683-fe19-4abc-b586-2f085939b847 None None] PATH_INFO: `/` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:08:50.238923 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 581/1167] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 17:08:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:08:50.244296 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526a6abb-bc18-4ca5-b215-418d681ad17d None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:08:50.244725 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526a6abb-bc18-4ca5-b215-418d681ad17d None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:08:50.244857 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526a6abb-bc18-4ca5-b215-418d681ad17d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:08:50.262211 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-526a6abb-bc18-4ca5-b215-418d681ad17d None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:08:50.263405 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-526a6abb-bc18-4ca5-b215-418d681ad17d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:08:50.298036 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:08:50.328983 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 587/1168] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 17:08:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 17:08:50.353723 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f33683-fe19-4abc-b586-2f085939b847 None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:08:50.453291 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f33683-fe19-4abc-b586-2f085939b847 None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:08:50.454841 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:08:50.487920 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16faa0c-6fdf-47a7-87c4-5800d14ed272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:08:50.488515 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16faa0c-6fdf-47a7-87c4-5800d14ed272 None admin] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:08:50.488803 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16faa0c-6fdf-47a7-87c4-5800d14ed272 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:08:50.489086 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16faa0c-6fdf-47a7-87c4-5800d14ed272 None admin] PATH_INFO: `/v3/domains` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:08:50.490454 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16faa0c-6fdf-47a7-87c4-5800d14ed272 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:08:50.491882 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16faa0c-6fdf-47a7-87c4-5800d14ed272 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:08:50.557778 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 582/1169] 10.222.0.39 () {60 vars in 1138 bytes} [Thu Jun 16 17:08:50 2022] POST /identity/v3/domains => generated 267 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:08:52.686833 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add3e33a-f1c1-41ee-bddf-c2711d427393 None None] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:08:52.687399 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add3e33a-f1c1-41ee-bddf-c2711d427393 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:08:52.687399 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add3e33a-f1c1-41ee-bddf-c2711d427393 None None] PATH_INFO: `/` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:08:52.688773 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 588/1170] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 17:08:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:08:52.694641 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c75e62-ee64-4426-8139-660fd4dc3bc1 None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:08:52.695061 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c75e62-ee64-4426-8139-660fd4dc3bc1 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:08:52.695179 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c75e62-ee64-4426-8139-660fd4dc3bc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:08:52.711947 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-65c75e62-ee64-4426-8139-660fd4dc3bc1 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:08:52.713114 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-65c75e62-ee64-4426-8139-660fd4dc3bc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:08:52.777630 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 583/1171] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 17:08:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 17:08:52.801427 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add3e33a-f1c1-41ee-bddf-c2711d427393 None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:08:52.908272 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add3e33a-f1c1-41ee-bddf-c2711d427393 None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:08:52.942600 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289097ed-3be1-450b-b89d-ffc1704adfcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:08:52.943466 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289097ed-3be1-450b-b89d-ffc1704adfcf None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:08:52.943754 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289097ed-3be1-450b-b89d-ffc1704adfcf None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:08:52.944036 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289097ed-3be1-450b-b89d-ffc1704adfcf None admin] PATH_INFO: `/v3/domains/4cd47e8218fb47a2824eb619cc5bb979` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:08:52.954193 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289097ed-3be1-450b-b89d-ffc1704adfcf None admin] RBAC: Authorizing `identity:get_domain(domain_id=4cd47e8218fb47a2824eb619cc5bb979)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:08:52.955628 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289097ed-3be1-450b-b89d-ffc1704adfcf None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:08:52.957257 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 589/1172] 10.222.0.39 () {56 vars in 1183 bytes} [Thu Jun 16 17:08:52 2022] GET /identity/v3/domains/4cd47e8218fb47a2824eb619cc5bb979 => generated 267 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:08:52.963929 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c75e62-ee64-4426-8139-660fd4dc3bc1 None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:08:53.052006 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:08:53.060774 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c75e62-ee64-4426-8139-660fd4dc3bc1 None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:08:53.093719 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3b6bda-40c9-42f0-9e70-1ed12719ea89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:08:53.094394 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3b6bda-40c9-42f0-9e70-1ed12719ea89 None admin] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:08:53.100607 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3b6bda-40c9-42f0-9e70-1ed12719ea89 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:08:53.100607 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3b6bda-40c9-42f0-9e70-1ed12719ea89 None admin] PATH_INFO: `/v3/projects` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:08:53.100607 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3b6bda-40c9-42f0-9e70-1ed12719ea89 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:08:53.100607 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3b6bda-40c9-42f0-9e70-1ed12719ea89 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:08:53.183819 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 584/1173] 10.222.0.39 () {60 vars in 1141 bytes} [Thu Jun 16 17:08:52 2022] POST /identity/v3/projects => generated 361 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 17:08:55.342457 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d706b8-359d-4430-8553-73b745d1e088 None None] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:08:55.342967 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d706b8-359d-4430-8553-73b745d1e088 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:08:55.342967 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d706b8-359d-4430-8553-73b745d1e088 None None] PATH_INFO: `/` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:08:55.344298 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 590/1174] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 17:08:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:08:55.350169 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10df9627-d473-45d0-bbca-124f9688b160 None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:08:55.350621 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10df9627-d473-45d0-bbca-124f9688b160 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:08:55.350741 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10df9627-d473-45d0-bbca-124f9688b160 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:08:55.367769 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-10df9627-d473-45d0-bbca-124f9688b160 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:08:55.368957 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-10df9627-d473-45d0-bbca-124f9688b160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:08:55.435577 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 585/1175] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 17:08:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 17:08:55.461530 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d706b8-359d-4430-8553-73b745d1e088 None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:08:55.493137 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:08:55.564699 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d706b8-359d-4430-8553-73b745d1e088 None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:08:55.599546 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9693a3ca-d821-4d86-b3d0-229383a560f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:08:55.599987 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9693a3ca-d821-4d86-b3d0-229383a560f5 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:08:55.600279 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9693a3ca-d821-4d86-b3d0-229383a560f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:08:55.600560 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9693a3ca-d821-4d86-b3d0-229383a560f5 None admin] PATH_INFO: `/v3/domains/4cd47e8218fb47a2824eb619cc5bb979` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:08:55.601742 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9693a3ca-d821-4d86-b3d0-229383a560f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=4cd47e8218fb47a2824eb619cc5bb979)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:08:55.603201 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9693a3ca-d821-4d86-b3d0-229383a560f5 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:08:55.604831 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 591/1176] 10.222.0.39 () {56 vars in 1183 bytes} [Thu Jun 16 17:08:55 2022] GET /identity/v3/domains/4cd47e8218fb47a2824eb619cc5bb979 => generated 267 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:08:55.610620 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10df9627-d473-45d0-bbca-124f9688b160 None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:08:55.684775 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:08:55.709470 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10df9627-d473-45d0-bbca-124f9688b160 None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:08:55.743149 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d53792d-b0ea-492b-819c-a079010ed6a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:08:55.743819 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d53792d-b0ea-492b-819c-a079010ed6a8 None admin] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:08:55.744112 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d53792d-b0ea-492b-819c-a079010ed6a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:08:55.744399 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d53792d-b0ea-492b-819c-a079010ed6a8 None admin] PATH_INFO: `/v3/users` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:08:55.745108 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d53792d-b0ea-492b-819c-a079010ed6a8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:08:55.746568 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d53792d-b0ea-492b-819c-a079010ed6a8 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:08:55.837315 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 586/1177] 10.222.0.39 () {60 vars in 1132 bytes} [Thu Jun 16 17:08:55 2022] POST /identity/v3/users => generated 311 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:08:58.003618 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136aff72-b4ed-4d66-b4c2-bb30b2daf44e None None] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:08:58.004145 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136aff72-b4ed-4d66-b4c2-bb30b2daf44e None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:08:58.004240 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136aff72-b4ed-4d66-b4c2-bb30b2daf44e None None] PATH_INFO: `/` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:08:58.006086 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 592/1178] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 17:08:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:08:58.011288 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2e1aef-d43d-4a7e-a31f-9cac6e9e8089 None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:08:58.011721 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2e1aef-d43d-4a7e-a31f-9cac6e9e8089 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:08:58.011854 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2e1aef-d43d-4a7e-a31f-9cac6e9e8089 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:08:58.029514 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-ec2e1aef-d43d-4a7e-a31f-9cac6e9e8089 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:08:58.030745 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-ec2e1aef-d43d-4a7e-a31f-9cac6e9e8089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:08:58.096651 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 587/1179] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 17:08:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 17:08:58.120142 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136aff72-b4ed-4d66-b4c2-bb30b2daf44e None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:08:58.217294 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:08:58.221322 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136aff72-b4ed-4d66-b4c2-bb30b2daf44e None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:08:58.254288 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004d4df0-053b-4a49-8211-443eee3ebbd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:08:58.255102 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004d4df0-053b-4a49-8211-443eee3ebbd2 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:08:58.255383 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004d4df0-053b-4a49-8211-443eee3ebbd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:08:58.255666 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004d4df0-053b-4a49-8211-443eee3ebbd2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:08:58.266224 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004d4df0-053b-4a49-8211-443eee3ebbd2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 17:08:58.274334 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application [None req-004d4df0-053b-4a49-8211-443eee3ebbd2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 17:08:58.274334 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:08:58.274334 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:08:58.274334 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:08:58.274334 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:08:58.274334 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:08:58.274334 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:08:58.274334 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:08:58.274334 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:08:58.274334 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:08:58.274334 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:08:58.274334 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:08:58.274334 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 17:08:58.274334 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 17:08:58.274334 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 17:08:58.274334 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 17:08:58.275484 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 17:08:58.275484 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 17:08:58.275484 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 17:08:58.275484 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 17:08:58.275484 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:08:58.275484 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:08:58.275484 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:08:58.275484 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:08:58.275484 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:08:58.275484 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:08:58.275484 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:08:58.275484 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application with Lock( Jun 16 17:08:58.275484 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:08:58.275484 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:08:58.275484 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:08:58.275484 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:08:58.276722 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:08:58.276722 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:08:58.276722 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:08:58.276722 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:08:58.276722 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 17:08:58.276722 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 17:08:58.276722 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 17:08:58.276722 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 17:08:58.276722 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 17:08:58.276722 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 17:08:58.276722 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 17:08:58.276722 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Jun 16 17:08:58.276722 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 593/1180] 10.222.0.39 () {56 vars in 1096 bytes} [Thu Jun 16 17:08:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:08:58.281439 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2e1aef-d43d-4a7e-a31f-9cac6e9e8089 None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:08:58.339635 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:08:58.379176 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2e1aef-d43d-4a7e-a31f-9cac6e9e8089 None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:08:58.412983 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880773b6-1ed0-4be8-aed4-6831aa1c104b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:08:58.413637 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880773b6-1ed0-4be8-aed4-6831aa1c104b None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:08:58.413949 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880773b6-1ed0-4be8-aed4-6831aa1c104b None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:08:58.414228 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880773b6-1ed0-4be8-aed4-6831aa1c104b None admin] PATH_INFO: `/v3/roles` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:08:58.414961 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880773b6-1ed0-4be8-aed4-6831aa1c104b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80873) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:08:58.415269 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880773b6-1ed0-4be8-aed4-6831aa1c104b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:08:58.416622 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880773b6-1ed0-4be8-aed4-6831aa1c104b None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:08:58.424359 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 588/1181] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 16 17:08:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:08:58.430754 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004d4df0-053b-4a49-8211-443eee3ebbd2 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:08:58.527961 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004d4df0-053b-4a49-8211-443eee3ebbd2 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:08:58.561466 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f38299-36b9-4550-b351-56849815c96f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:08:58.562373 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f38299-36b9-4550-b351-56849815c96f None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:08:58.562663 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f38299-36b9-4550-b351-56849815c96f None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:08:58.562943 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f38299-36b9-4550-b351-56849815c96f None admin] PATH_INFO: `/v3/users/09863286aea04b42b276222d4bb705fb` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:08:58.575874 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f38299-36b9-4550-b351-56849815c96f None admin] RBAC: Authorizing `identity:get_user(user_id=09863286aea04b42b276222d4bb705fb)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:08:58.577306 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f38299-36b9-4550-b351-56849815c96f None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:08:58.579012 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 594/1182] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jun 16 17:08:58 2022] GET /identity/v3/users/09863286aea04b42b276222d4bb705fb => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:08:58.584781 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880773b6-1ed0-4be8-aed4-6831aa1c104b None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:08:58.689972 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880773b6-1ed0-4be8-aed4-6831aa1c104b None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:08:58.711861 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:08:58.722987 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7296a8-fd6c-438b-81f0-c09b74cefe73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:08:58.727006 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7296a8-fd6c-438b-81f0-c09b74cefe73 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:08:58.727006 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7296a8-fd6c-438b-81f0-c09b74cefe73 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:08:58.727006 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7296a8-fd6c-438b-81f0-c09b74cefe73 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:08:58.791516 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7296a8-fd6c-438b-81f0-c09b74cefe73 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:08:58.792887 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7296a8-fd6c-438b-81f0-c09b74cefe73 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:08:58.890376 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 589/1183] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 16 17:08:58 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 17:08:58.896082 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f38299-36b9-4550-b351-56849815c96f None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:08:58.914703 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:08:58.997290 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f38299-36b9-4550-b351-56849815c96f None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:08:59.030684 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c55172-ba9a-4d63-b175-a05f0318a179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:08:59.031539 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c55172-ba9a-4d63-b175-a05f0318a179 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:08:59.031824 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c55172-ba9a-4d63-b175-a05f0318a179 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:08:59.032102 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c55172-ba9a-4d63-b175-a05f0318a179 None admin] PATH_INFO: `/v3/projects/25f5f2e8a3414579986bd6bfc7b378cd` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:08:59.033269 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c55172-ba9a-4d63-b175-a05f0318a179 None admin] RBAC: Authorizing `identity:get_project(project_id=25f5f2e8a3414579986bd6bfc7b378cd)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:08:59.034727 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c55172-ba9a-4d63-b175-a05f0318a179 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:08:59.037046 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 595/1184] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 16 17:08:58 2022] GET /identity/v3/projects/25f5f2e8a3414579986bd6bfc7b378cd => generated 361 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:08:59.043371 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7296a8-fd6c-438b-81f0-c09b74cefe73 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:08:59.066333 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:08:59.140718 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7296a8-fd6c-438b-81f0-c09b74cefe73 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:08:59.174642 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbf844b-a51f-4161-8695-63a627b462ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:08:59.175286 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbf844b-a51f-4161-8695-63a627b462ce None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:08:59.175573 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbf844b-a51f-4161-8695-63a627b462ce None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:08:59.175852 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbf844b-a51f-4161-8695-63a627b462ce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:08:59.176688 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbf844b-a51f-4161-8695-63a627b462ce None admin] RBAC: Adding query filter params (role.id=dba744f8ab2a4c45b9d3212f8d203aba, scope.project.id=25f5f2e8a3414579986bd6bfc7b378cd, user.id=09863286aea04b42b276222d4bb705fb) {{(pid=80873) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:08:59.177017 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbf844b-a51f-4161-8695-63a627b462ce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:08:59.178452 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbf844b-a51f-4161-8695-63a627b462ce None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:08:59.183856 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 590/1185] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jun 16 17:08:59 2022] GET /identity/v3/role_assignments?user.id=09863286aea04b42b276222d4bb705fb&scope.project.id=25f5f2e8a3414579986bd6bfc7b378cd&role.id=dba744f8ab2a4c45b9d3212f8d203aba => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:09:01.277174 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ca3dd1-cefc-411e-a0a0-e5702b19d980 None None] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:09:01.277691 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ca3dd1-cefc-411e-a0a0-e5702b19d980 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:09:01.277691 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ca3dd1-cefc-411e-a0a0-e5702b19d980 None None] PATH_INFO: `/` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:09:01.279058 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 596/1186] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 17:09:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:09:01.284172 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6548648a-fa83-42f1-8eb9-7a7a83c2dc2d None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:09:01.284595 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6548648a-fa83-42f1-8eb9-7a7a83c2dc2d None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:09:01.284739 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6548648a-fa83-42f1-8eb9-7a7a83c2dc2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:09:01.301293 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-6548648a-fa83-42f1-8eb9-7a7a83c2dc2d None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:09:01.303221 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-6548648a-fa83-42f1-8eb9-7a7a83c2dc2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:09:01.368578 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 591/1187] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 17:09:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 17:09:01.391544 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ca3dd1-cefc-411e-a0a0-e5702b19d980 None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:09:01.474799 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:09:01.489920 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ca3dd1-cefc-411e-a0a0-e5702b19d980 None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:09:01.522180 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18c90a0-adbe-47f7-9ee3-089df3765a5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:09:01.522958 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18c90a0-adbe-47f7-9ee3-089df3765a5f None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:09:01.523239 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18c90a0-adbe-47f7-9ee3-089df3765a5f None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:09:01.523543 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18c90a0-adbe-47f7-9ee3-089df3765a5f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:09:01.533354 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18c90a0-adbe-47f7-9ee3-089df3765a5f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 17:09:01.541275 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application [None req-d18c90a0-adbe-47f7-9ee3-089df3765a5f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 17:09:01.541275 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:09:01.541275 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:09:01.541275 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:09:01.541275 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:09:01.541275 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:09:01.541275 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:09:01.541275 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:09:01.541275 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:09:01.541275 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:09:01.541275 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:09:01.541275 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:09:01.541275 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 17:09:01.541275 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 17:09:01.541275 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 17:09:01.541275 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 17:09:01.542433 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 17:09:01.542433 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 17:09:01.542433 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 17:09:01.542433 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 17:09:01.542433 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:09:01.542433 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:09:01.542433 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:09:01.542433 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:09:01.542433 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:09:01.542433 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:09:01.542433 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:09:01.542433 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application with Lock( Jun 16 17:09:01.542433 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:09:01.542433 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:09:01.542433 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:09:01.542433 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:09:01.543445 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:09:01.543445 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:09:01.543445 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:09:01.543445 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:09:01.543445 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 17:09:01.543445 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 17:09:01.543445 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 17:09:01.543445 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 17:09:01.543445 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 17:09:01.543445 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 17:09:01.543445 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 17:09:01.543445 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Jun 16 17:09:01.543445 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 597/1188] 10.222.0.39 () {56 vars in 1096 bytes} [Thu Jun 16 17:09:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:09:01.548615 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6548648a-fa83-42f1-8eb9-7a7a83c2dc2d None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:09:01.566582 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:09:01.646541 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6548648a-fa83-42f1-8eb9-7a7a83c2dc2d None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:09:01.680795 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef4ce53-e323-436f-8166-c3c372dda62e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:09:01.681448 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef4ce53-e323-436f-8166-c3c372dda62e None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:09:01.681732 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef4ce53-e323-436f-8166-c3c372dda62e None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:09:01.682043 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef4ce53-e323-436f-8166-c3c372dda62e None admin] PATH_INFO: `/v3/roles` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:09:01.682778 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef4ce53-e323-436f-8166-c3c372dda62e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80873) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:09:01.683085 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef4ce53-e323-436f-8166-c3c372dda62e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:09:01.684431 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef4ce53-e323-436f-8166-c3c372dda62e None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:09:01.692304 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 592/1189] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 16 17:09:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:09:01.698193 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18c90a0-adbe-47f7-9ee3-089df3765a5f None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:09:01.797121 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18c90a0-adbe-47f7-9ee3-089df3765a5f None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:09:01.829554 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55ffd89-d5b5-4daf-a5df-65e8795bcd10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:09:01.830457 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55ffd89-d5b5-4daf-a5df-65e8795bcd10 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:09:01.830744 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55ffd89-d5b5-4daf-a5df-65e8795bcd10 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:09:01.831024 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55ffd89-d5b5-4daf-a5df-65e8795bcd10 None admin] PATH_INFO: `/v3/users/09863286aea04b42b276222d4bb705fb` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:09:01.832214 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55ffd89-d5b5-4daf-a5df-65e8795bcd10 None admin] RBAC: Authorizing `identity:get_user(user_id=09863286aea04b42b276222d4bb705fb)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:09:01.834030 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55ffd89-d5b5-4daf-a5df-65e8795bcd10 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:09:01.836309 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 598/1190] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jun 16 17:09:01 2022] GET /identity/v3/users/09863286aea04b42b276222d4bb705fb => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:09:01.842096 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef4ce53-e323-436f-8166-c3c372dda62e None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:09:01.929987 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:09:01.950834 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef4ce53-e323-436f-8166-c3c372dda62e None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:09:01.983475 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414a9d05-4ca2-41e2-84d6-f139144d492c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:09:01.984328 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414a9d05-4ca2-41e2-84d6-f139144d492c None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:09:01.984618 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414a9d05-4ca2-41e2-84d6-f139144d492c None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:09:01.984898 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414a9d05-4ca2-41e2-84d6-f139144d492c None admin] PATH_INFO: `/v3/projects/25f5f2e8a3414579986bd6bfc7b378cd` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:09:01.986131 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414a9d05-4ca2-41e2-84d6-f139144d492c None admin] RBAC: Authorizing `identity:get_project(project_id=25f5f2e8a3414579986bd6bfc7b378cd)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:09:01.987590 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414a9d05-4ca2-41e2-84d6-f139144d492c None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:09:01.989859 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 593/1191] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 16 17:09:01 2022] GET /identity/v3/projects/25f5f2e8a3414579986bd6bfc7b378cd => generated 361 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:09:01.995876 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55ffd89-d5b5-4daf-a5df-65e8795bcd10 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:09:02.012356 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:09:02.094363 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55ffd89-d5b5-4daf-a5df-65e8795bcd10 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:09:02.126896 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d102cb-7b48-4187-8196-681c6bb659de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:09:02.127771 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d102cb-7b48-4187-8196-681c6bb659de None admin] REQUEST_METHOD: `PUT` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:09:02.128059 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d102cb-7b48-4187-8196-681c6bb659de None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:09:02.128340 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d102cb-7b48-4187-8196-681c6bb659de None admin] PATH_INFO: `/v3/projects/25f5f2e8a3414579986bd6bfc7b378cd/users/09863286aea04b42b276222d4bb705fb/roles/dba744f8ab2a4c45b9d3212f8d203aba` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:09:02.130868 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d102cb-7b48-4187-8196-681c6bb659de None admin] RBAC: Authorizing `identity:create_grant(project_id=25f5f2e8a3414579986bd6bfc7b378cd, user_id=09863286aea04b42b276222d4bb705fb, role_id=dba744f8ab2a4c45b9d3212f8d203aba)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:09:02.132288 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d102cb-7b48-4187-8196-681c6bb659de None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:09:02.200252 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 599/1192] 10.222.0.39 () {58 vars in 1439 bytes} [Thu Jun 16 17:09:01 2022] PUT /identity/v3/projects/25f5f2e8a3414579986bd6bfc7b378cd/users/09863286aea04b42b276222d4bb705fb/roles/dba744f8ab2a4c45b9d3212f8d203aba => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 17:09:04.291206 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0f8fe6-4f96-492d-850a-f57db6a2f94a None None] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:09:04.291725 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0f8fe6-4f96-492d-850a-f57db6a2f94a None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:09:04.291725 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0f8fe6-4f96-492d-850a-f57db6a2f94a None None] PATH_INFO: `/` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:09:04.293083 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 594/1193] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 17:09:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:09:04.298239 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761bb9f1-9178-4a91-8272-ec0a92b7928f None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:09:04.298654 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761bb9f1-9178-4a91-8272-ec0a92b7928f None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:09:04.298815 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761bb9f1-9178-4a91-8272-ec0a92b7928f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:09:04.316040 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-761bb9f1-9178-4a91-8272-ec0a92b7928f None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:09:04.317916 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-761bb9f1-9178-4a91-8272-ec0a92b7928f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:09:04.389423 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 600/1194] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 17:09:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 17:09:04.413985 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0f8fe6-4f96-492d-850a-f57db6a2f94a None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:09:04.514039 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0f8fe6-4f96-492d-850a-f57db6a2f94a None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:09:04.546607 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebee8fe-ec0f-4109-8488-e1c86bb3be82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:09:04.547320 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebee8fe-ec0f-4109-8488-e1c86bb3be82 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:09:04.547608 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebee8fe-ec0f-4109-8488-e1c86bb3be82 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:09:04.547888 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebee8fe-ec0f-4109-8488-e1c86bb3be82 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:09:04.558833 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebee8fe-ec0f-4109-8488-e1c86bb3be82 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 17:09:04.566384 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application [None req-7ebee8fe-ec0f-4109-8488-e1c86bb3be82 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 17:09:04.566384 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:09:04.566384 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:09:04.566384 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:09:04.566384 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:09:04.566384 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:09:04.566384 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:09:04.566384 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:09:04.566384 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:09:04.566384 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:09:04.566384 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:09:04.566384 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:09:04.566384 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 17:09:04.566384 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 17:09:04.566384 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 17:09:04.566384 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 17:09:04.567445 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 17:09:04.567445 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 17:09:04.567445 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 17:09:04.567445 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 17:09:04.567445 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:09:04.567445 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:09:04.567445 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:09:04.567445 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:09:04.567445 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:09:04.567445 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:09:04.567445 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:09:04.567445 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application with Lock( Jun 16 17:09:04.567445 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:09:04.567445 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:09:04.567445 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:09:04.567445 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:09:04.568552 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:09:04.568552 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:09:04.568552 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:09:04.568552 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:09:04.568552 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 17:09:04.568552 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 17:09:04.568552 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 17:09:04.568552 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 17:09:04.568552 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 17:09:04.568552 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 17:09:04.568552 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 17:09:04.568552 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Jun 16 17:09:04.568552 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 595/1195] 10.222.0.39 () {56 vars in 1096 bytes} [Thu Jun 16 17:09:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:09:04.573793 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761bb9f1-9178-4a91-8272-ec0a92b7928f None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:09:04.576924 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:09:04.673096 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761bb9f1-9178-4a91-8272-ec0a92b7928f None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:09:04.712724 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1be7e39-1ab6-4d95-b673-49d6d25b411f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:09:04.713392 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1be7e39-1ab6-4d95-b673-49d6d25b411f None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:09:04.713682 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1be7e39-1ab6-4d95-b673-49d6d25b411f None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:09:04.713995 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1be7e39-1ab6-4d95-b673-49d6d25b411f None admin] PATH_INFO: `/v3/roles` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:09:04.714752 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1be7e39-1ab6-4d95-b673-49d6d25b411f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:09:04.715067 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1be7e39-1ab6-4d95-b673-49d6d25b411f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:09:04.716441 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1be7e39-1ab6-4d95-b673-49d6d25b411f None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:09:04.725495 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 601/1196] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 16 17:09:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:09:04.731519 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebee8fe-ec0f-4109-8488-e1c86bb3be82 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:09:04.740941 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:09:04.828692 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebee8fe-ec0f-4109-8488-e1c86bb3be82 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:09:04.861495 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300efa8a-3543-4bc8-8089-82b616c0ea35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:09:04.862376 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300efa8a-3543-4bc8-8089-82b616c0ea35 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:09:04.862665 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300efa8a-3543-4bc8-8089-82b616c0ea35 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:09:04.862941 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300efa8a-3543-4bc8-8089-82b616c0ea35 None admin] PATH_INFO: `/v3/users/09863286aea04b42b276222d4bb705fb` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:09:04.864687 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300efa8a-3543-4bc8-8089-82b616c0ea35 None admin] RBAC: Authorizing `identity:get_user(user_id=09863286aea04b42b276222d4bb705fb)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:09:04.866139 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300efa8a-3543-4bc8-8089-82b616c0ea35 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:09:04.867765 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 596/1197] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jun 16 17:09:04 2022] GET /identity/v3/users/09863286aea04b42b276222d4bb705fb => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:09:04.873867 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1be7e39-1ab6-4d95-b673-49d6d25b411f None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:09:04.938277 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:09:04.972158 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1be7e39-1ab6-4d95-b673-49d6d25b411f None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:09:05.005214 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f839bc-9077-4c1e-89a4-5d01df542ed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:09:05.005874 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f839bc-9077-4c1e-89a4-5d01df542ed9 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:09:05.006161 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f839bc-9077-4c1e-89a4-5d01df542ed9 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:09:05.006439 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f839bc-9077-4c1e-89a4-5d01df542ed9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:09:05.074097 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f839bc-9077-4c1e-89a4-5d01df542ed9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:09:05.075531 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f839bc-9077-4c1e-89a4-5d01df542ed9 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:09:05.136405 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:09:05.170900 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 602/1198] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 16 17:09:04 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 17:09:05.176811 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300efa8a-3543-4bc8-8089-82b616c0ea35 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:09:05.249361 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:09:05.274353 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300efa8a-3543-4bc8-8089-82b616c0ea35 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:09:05.307168 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5bd1de-c208-4a1c-964d-3ecfd1582f0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:09:05.308016 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5bd1de-c208-4a1c-964d-3ecfd1582f0b None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:09:05.308295 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5bd1de-c208-4a1c-964d-3ecfd1582f0b None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:09:05.308567 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5bd1de-c208-4a1c-964d-3ecfd1582f0b None admin] PATH_INFO: `/v3/projects/25f5f2e8a3414579986bd6bfc7b378cd` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:09:05.309724 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5bd1de-c208-4a1c-964d-3ecfd1582f0b None admin] RBAC: Authorizing `identity:get_project(project_id=25f5f2e8a3414579986bd6bfc7b378cd)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:09:05.311158 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5bd1de-c208-4a1c-964d-3ecfd1582f0b None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:09:05.312891 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 597/1199] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 16 17:09:05 2022] GET /identity/v3/projects/25f5f2e8a3414579986bd6bfc7b378cd => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:09:05.322855 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f839bc-9077-4c1e-89a4-5d01df542ed9 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:09:05.426350 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f839bc-9077-4c1e-89a4-5d01df542ed9 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:09:05.459271 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a4bed8-1d41-4bfd-8569-65e8cd2d139a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:09:05.459919 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a4bed8-1d41-4bfd-8569-65e8cd2d139a None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:09:05.460209 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a4bed8-1d41-4bfd-8569-65e8cd2d139a None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:09:05.460489 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a4bed8-1d41-4bfd-8569-65e8cd2d139a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:09:05.461324 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a4bed8-1d41-4bfd-8569-65e8cd2d139a None admin] RBAC: Adding query filter params (role.id=dba744f8ab2a4c45b9d3212f8d203aba, scope.project.id=25f5f2e8a3414579986bd6bfc7b378cd, user.id=09863286aea04b42b276222d4bb705fb) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:09:05.461641 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a4bed8-1d41-4bfd-8569-65e8cd2d139a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:09:05.463105 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a4bed8-1d41-4bfd-8569-65e8cd2d139a None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:09:05.469197 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 603/1200] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jun 16 17:09:05 2022] GET /identity/v3/role_assignments?user.id=09863286aea04b42b276222d4bb705fb&scope.project.id=25f5f2e8a3414579986bd6bfc7b378cd&role.id=dba744f8ab2a4c45b9d3212f8d203aba => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:09:15.303071 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=29 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:09:15.466227 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=85 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:10:18.987154 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796226ae-7660-48b9-a50d-eb648afd11fe None None] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:10:18.987761 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796226ae-7660-48b9-a50d-eb648afd11fe None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:10:18.987761 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796226ae-7660-48b9-a50d-eb648afd11fe None None] PATH_INFO: `/` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:10:18.989122 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 598/1201] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 17:10:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:10:18.994415 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e88f20-90c2-4de4-8428-33b43e6438c0 None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:10:18.994849 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e88f20-90c2-4de4-8428-33b43e6438c0 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:10:18.994977 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e88f20-90c2-4de4-8428-33b43e6438c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:10:19.012695 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-81e88f20-90c2-4de4-8428-33b43e6438c0 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:10:19.013912 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-81e88f20-90c2-4de4-8428-33b43e6438c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:10:19.081172 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 604/1202] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 17:10:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 17:10:19.106322 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796226ae-7660-48b9-a50d-eb648afd11fe None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:10:19.208347 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796226ae-7660-48b9-a50d-eb648afd11fe None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:10:19.243030 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd5fff3-c473-480d-bc7b-39981bf9efef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:10:19.243826 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd5fff3-c473-480d-bc7b-39981bf9efef None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:10:19.244117 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd5fff3-c473-480d-bc7b-39981bf9efef None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:10:19.244401 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd5fff3-c473-480d-bc7b-39981bf9efef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:10:19.255524 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd5fff3-c473-480d-bc7b-39981bf9efef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:10:19.256962 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd5fff3-c473-480d-bc7b-39981bf9efef None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:10:19.274545 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application [None req-afd5fff3-c473-480d-bc7b-39981bf9efef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:10:19.274545 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:10:19.274545 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:10:19.274545 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:10:19.274545 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:10:19.274545 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:10:19.274545 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:10:19.274545 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:10:19.274545 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:10:19.274545 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:10:19.274545 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:10:19.274545 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:10:19.274545 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 17:10:19.274545 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 17:10:19.274545 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 17:10:19.276305 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 17:10:19.276305 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:10:19.276305 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:10:19.276305 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:10:19.276305 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:10:19.276305 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:10:19.276305 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:10:19.276305 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:10:19.276305 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application with Lock( Jun 16 17:10:19.276305 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:10:19.276305 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:10:19.276305 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:10:19.276305 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:10:19.276305 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:10:19.276305 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:10:19.276305 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:10:19.276305 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:10:19.277678 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 17:10:19.277678 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 17:10:19.277678 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:10:19.277678 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Jun 16 17:10:19.277678 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 599/1203] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 17:10:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 17:10:19.282134 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e88f20-90c2-4de4-8428-33b43e6438c0 None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:10:19.380742 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e88f20-90c2-4de4-8428-33b43e6438c0 None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:10:19.409771 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:10:19.415403 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4729e129-bcda-4e51-b195-c6d27d27e407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:10:19.420399 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4729e129-bcda-4e51-b195-c6d27d27e407 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:10:19.420399 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4729e129-bcda-4e51-b195-c6d27d27e407 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:10:19.420399 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4729e129-bcda-4e51-b195-c6d27d27e407 None admin] PATH_INFO: `/v3/domains` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:10:19.420399 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4729e129-bcda-4e51-b195-c6d27d27e407 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:10:19.420399 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4729e129-bcda-4e51-b195-c6d27d27e407 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:10:19.420399 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4729e129-bcda-4e51-b195-c6d27d27e407 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:10:19.430957 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 605/1204] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 16 17:10:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:10:19.437024 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd5fff3-c473-480d-bc7b-39981bf9efef None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:10:19.497656 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:10:19.543561 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd5fff3-c473-480d-bc7b-39981bf9efef None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:10:19.577470 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae06d1c-bc17-463b-88f2-b17cf531ed0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:10:19.578230 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae06d1c-bc17-463b-88f2-b17cf531ed0b None admin] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:10:19.578519 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae06d1c-bc17-463b-88f2-b17cf531ed0b None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:10:19.578799 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae06d1c-bc17-463b-88f2-b17cf531ed0b None admin] PATH_INFO: `/v3/users` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:10:19.579529 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae06d1c-bc17-463b-88f2-b17cf531ed0b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:10:19.580983 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae06d1c-bc17-463b-88f2-b17cf531ed0b None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:10:19.659572 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 600/1205] 10.222.0.39 () {60 vars in 1132 bytes} [Thu Jun 16 17:10:19 2022] POST /identity/v3/users => generated 251 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:10:21.813104 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4fc4d6-1ee4-4457-833e-f94a0f7d2f8e None None] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:10:21.813663 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4fc4d6-1ee4-4457-833e-f94a0f7d2f8e None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:10:21.813815 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4fc4d6-1ee4-4457-833e-f94a0f7d2f8e None None] PATH_INFO: `/` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:10:21.815895 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 606/1206] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 17:10:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:10:21.821067 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f72e18d-3a41-4c37-8f29-5760de1f63eb None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:10:21.821485 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f72e18d-3a41-4c37-8f29-5760de1f63eb None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:10:21.821718 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f72e18d-3a41-4c37-8f29-5760de1f63eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:10:21.839227 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-0f72e18d-3a41-4c37-8f29-5760de1f63eb None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:10:21.841217 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-0f72e18d-3a41-4c37-8f29-5760de1f63eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:10:21.908686 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 601/1207] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 17:10:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 17:10:21.931686 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4fc4d6-1ee4-4457-833e-f94a0f7d2f8e None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:10:22.033462 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4fc4d6-1ee4-4457-833e-f94a0f7d2f8e None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:10:22.067726 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fe4f2b-1a5b-4606-800a-e4555da8deba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:10:22.068456 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fe4f2b-1a5b-4606-800a-e4555da8deba None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:10:22.068744 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fe4f2b-1a5b-4606-800a-e4555da8deba None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:10:22.069025 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fe4f2b-1a5b-4606-800a-e4555da8deba None admin] PATH_INFO: `/v3/roles/service` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:10:22.080108 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fe4f2b-1a5b-4606-800a-e4555da8deba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 17:10:22.088152 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application [None req-32fe4f2b-1a5b-4606-800a-e4555da8deba None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 17:10:22.088152 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:10:22.088152 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:10:22.088152 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:10:22.088152 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:10:22.088152 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:10:22.088152 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:10:22.088152 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:10:22.088152 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:10:22.088152 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:10:22.088152 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:10:22.088152 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:10:22.088152 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 17:10:22.088152 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 17:10:22.088152 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 17:10:22.088152 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 17:10:22.089208 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 17:10:22.089208 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 17:10:22.089208 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 17:10:22.089208 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 17:10:22.089208 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:10:22.089208 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:10:22.089208 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:10:22.089208 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:10:22.089208 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:10:22.089208 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:10:22.089208 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:10:22.089208 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application with Lock( Jun 16 17:10:22.089208 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:10:22.089208 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:10:22.089208 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:10:22.089208 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:10:22.090386 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:10:22.090386 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:10:22.090386 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:10:22.090386 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:10:22.090386 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 17:10:22.090386 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 17:10:22.090386 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 17:10:22.090386 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 17:10:22.090386 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 17:10:22.090386 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 17:10:22.090386 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 17:10:22.090386 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Jun 16 17:10:22.090386 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 607/1208] 10.222.0.39 () {56 vars in 1102 bytes} [Thu Jun 16 17:10:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:10:22.095862 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f72e18d-3a41-4c37-8f29-5760de1f63eb None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:10:22.138341 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:10:22.196569 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f72e18d-3a41-4c37-8f29-5760de1f63eb None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:10:22.229449 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fde312c-03ab-47c5-b633-d2e0276ee397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:10:22.231203 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fde312c-03ab-47c5-b633-d2e0276ee397 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:10:22.231505 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fde312c-03ab-47c5-b633-d2e0276ee397 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:10:22.231798 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fde312c-03ab-47c5-b633-d2e0276ee397 None admin] PATH_INFO: `/v3/roles` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:10:22.232603 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fde312c-03ab-47c5-b633-d2e0276ee397 None admin] RBAC: Adding query filter params (name=service) {{(pid=80873) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:10:22.232926 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fde312c-03ab-47c5-b633-d2e0276ee397 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:10:22.234331 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fde312c-03ab-47c5-b633-d2e0276ee397 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:10:22.243578 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 602/1209] 10.222.0.39 () {56 vars in 1103 bytes} [Thu Jun 16 17:10:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 17:10:22.249239 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fe4f2b-1a5b-4606-800a-e4555da8deba None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:10:22.298639 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:10:22.348649 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fe4f2b-1a5b-4606-800a-e4555da8deba None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:10:22.382489 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf36fa6-ff8e-46c8-9064-cf463cc7a0e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:10:22.383380 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf36fa6-ff8e-46c8-9064-cf463cc7a0e1 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:10:22.383678 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf36fa6-ff8e-46c8-9064-cf463cc7a0e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:10:22.383957 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf36fa6-ff8e-46c8-9064-cf463cc7a0e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:10:22.394642 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf36fa6-ff8e-46c8-9064-cf463cc7a0e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:10:22.396110 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf36fa6-ff8e-46c8-9064-cf463cc7a0e1 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:10:22.414228 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application [None req-8cf36fa6-ff8e-46c8-9064-cf463cc7a0e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:10:22.414228 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:10:22.414228 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:10:22.414228 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:10:22.414228 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:10:22.414228 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:10:22.414228 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:10:22.414228 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:10:22.414228 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:10:22.414228 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:10:22.414228 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:10:22.414228 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:10:22.414228 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 17:10:22.414228 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 17:10:22.414228 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 17:10:22.416223 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 17:10:22.416223 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:10:22.416223 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:10:22.416223 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:10:22.416223 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:10:22.416223 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:10:22.416223 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:10:22.416223 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:10:22.416223 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application with Lock( Jun 16 17:10:22.416223 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:10:22.416223 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:10:22.416223 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:10:22.416223 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:10:22.416223 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:10:22.416223 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:10:22.416223 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:10:22.416223 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:10:22.417413 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 17:10:22.417413 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 17:10:22.417413 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:10:22.417413 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Jun 16 17:10:22.417413 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 608/1210] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 17:10:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:10:22.421395 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fde312c-03ab-47c5-b633-d2e0276ee397 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:10:22.526672 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:10:22.529598 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fde312c-03ab-47c5-b633-d2e0276ee397 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:10:22.562621 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051f2652-1225-45fc-81f4-aa8d002e4dfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:10:22.563276 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051f2652-1225-45fc-81f4-aa8d002e4dfa None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:10:22.564192 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051f2652-1225-45fc-81f4-aa8d002e4dfa None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:10:22.564192 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051f2652-1225-45fc-81f4-aa8d002e4dfa None admin] PATH_INFO: `/v3/domains` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:10:22.564535 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051f2652-1225-45fc-81f4-aa8d002e4dfa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80873) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:10:22.564848 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051f2652-1225-45fc-81f4-aa8d002e4dfa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:10:22.566237 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051f2652-1225-45fc-81f4-aa8d002e4dfa None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:10:22.577870 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 603/1211] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 16 17:10:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:10:22.583633 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf36fa6-ff8e-46c8-9064-cf463cc7a0e1 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:10:22.686543 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf36fa6-ff8e-46c8-9064-cf463cc7a0e1 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:10:22.688082 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:10:22.730461 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ff8845-c1bb-4c2f-90f8-c0439187ed0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:10:22.731273 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ff8845-c1bb-4c2f-90f8-c0439187ed0a None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:10:22.731559 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ff8845-c1bb-4c2f-90f8-c0439187ed0a None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:10:22.731844 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ff8845-c1bb-4c2f-90f8-c0439187ed0a None admin] PATH_INFO: `/v3/users/placement` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:10:22.739733 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ff8845-c1bb-4c2f-90f8-c0439187ed0a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:10:22.741175 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ff8845-c1bb-4c2f-90f8-c0439187ed0a None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:10:22.755997 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application [None req-e4ff8845-c1bb-4c2f-90f8-c0439187ed0a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 16 17:10:22.755997 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:10:22.755997 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:10:22.755997 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:10:22.755997 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:10:22.755997 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:10:22.755997 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:10:22.755997 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:10:22.755997 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:10:22.755997 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:10:22.755997 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:10:22.755997 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:10:22.755997 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 17:10:22.755997 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 17:10:22.755997 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 17:10:22.755997 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 17:10:22.757032 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:10:22.757032 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:10:22.757032 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 17:10:22.757032 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 17:10:22.757032 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 17:10:22.757032 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 17:10:22.757032 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:10:22.757032 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:10:22.757032 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:10:22.757032 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:10:22.757032 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:10:22.757032 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application with Lock( Jun 16 17:10:22.757032 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:10:22.757032 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:10:22.757032 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:10:22.757032 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:10:22.757032 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:10:22.757032 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:10:22.758038 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:10:22.758038 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:10:22.758038 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 17:10:22.758038 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 17:10:22.758038 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 17:10:22.758038 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 17:10:22.758038 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 17:10:22.758038 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 17:10:22.758038 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 16 17:10:22.758038 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Jun 16 17:10:22.758038 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 609/1212] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 17:10:22 2022] GET /identity/v3/users/placement => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:10:22.763489 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051f2652-1225-45fc-81f4-aa8d002e4dfa None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:10:22.865727 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051f2652-1225-45fc-81f4-aa8d002e4dfa None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:10:22.900399 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8117d445-f3a3-40fc-897a-5be3fe1bf161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:10:22.905724 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8117d445-f3a3-40fc-897a-5be3fe1bf161 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:10:22.905724 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8117d445-f3a3-40fc-897a-5be3fe1bf161 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:10:22.905724 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8117d445-f3a3-40fc-897a-5be3fe1bf161 None admin] PATH_INFO: `/v3/users` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:10:22.905724 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8117d445-f3a3-40fc-897a-5be3fe1bf161 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80873) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:10:22.905724 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8117d445-f3a3-40fc-897a-5be3fe1bf161 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:10:22.905724 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8117d445-f3a3-40fc-897a-5be3fe1bf161 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:10:22.922868 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 604/1213] 10.222.0.39 () {56 vars in 1143 bytes} [Thu Jun 16 17:10:22 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:10:22.928720 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ff8845-c1bb-4c2f-90f8-c0439187ed0a None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:10:23.027708 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ff8845-c1bb-4c2f-90f8-c0439187ed0a None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:10:23.061038 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d54ca9-ec0e-4a05-94d6-dead4004ecad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:10:23.061677 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d54ca9-ec0e-4a05-94d6-dead4004ecad None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:10:23.061994 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d54ca9-ec0e-4a05-94d6-dead4004ecad None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:10:23.062275 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d54ca9-ec0e-4a05-94d6-dead4004ecad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:10:23.092020 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:10:23.129433 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d54ca9-ec0e-4a05-94d6-dead4004ecad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:10:23.130911 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d54ca9-ec0e-4a05-94d6-dead4004ecad None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:10:23.228044 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 610/1214] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 16 17:10:22 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 16 17:10:23.234014 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8117d445-f3a3-40fc-897a-5be3fe1bf161 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:10:23.252775 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:10:23.330064 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8117d445-f3a3-40fc-897a-5be3fe1bf161 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:10:23.364800 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d541e911-5be2-4c58-af21-c82ca89ecc83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:10:23.365586 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d541e911-5be2-4c58-af21-c82ca89ecc83 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:10:23.365909 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d541e911-5be2-4c58-af21-c82ca89ecc83 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:10:23.366198 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d541e911-5be2-4c58-af21-c82ca89ecc83 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:10:23.376079 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d541e911-5be2-4c58-af21-c82ca89ecc83 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:10:23.378046 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d541e911-5be2-4c58-af21-c82ca89ecc83 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:10:23.396035 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application [None req-d541e911-5be2-4c58-af21-c82ca89ecc83 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:10:23.396035 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:10:23.396035 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:10:23.396035 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:10:23.396035 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:10:23.396035 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:10:23.396035 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:10:23.396035 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:10:23.396035 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:10:23.396035 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:10:23.396035 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:10:23.396035 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:10:23.396035 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 17:10:23.396035 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 17:10:23.396035 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 17:10:23.397155 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 17:10:23.397155 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:10:23.397155 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:10:23.397155 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:10:23.397155 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:10:23.397155 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:10:23.397155 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:10:23.397155 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:10:23.397155 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application with Lock( Jun 16 17:10:23.397155 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:10:23.397155 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:10:23.397155 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:10:23.397155 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:10:23.397155 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:10:23.397155 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:10:23.397155 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:10:23.397155 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:10:23.398418 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 17:10:23.398418 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 17:10:23.398418 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:10:23.398418 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Jun 16 17:10:23.398418 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 605/1215] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 17:10:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:10:23.402971 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d54ca9-ec0e-4a05-94d6-dead4004ecad None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:10:23.464743 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:10:23.501584 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d54ca9-ec0e-4a05-94d6-dead4004ecad None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:10:23.536506 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6524892c-00ec-4c89-b6ee-d545c22a2804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:10:23.537161 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6524892c-00ec-4c89-b6ee-d545c22a2804 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:10:23.537452 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6524892c-00ec-4c89-b6ee-d545c22a2804 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:10:23.537733 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6524892c-00ec-4c89-b6ee-d545c22a2804 None admin] PATH_INFO: `/v3/domains` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:10:23.538486 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6524892c-00ec-4c89-b6ee-d545c22a2804 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:10:23.538798 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6524892c-00ec-4c89-b6ee-d545c22a2804 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:10:23.540156 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6524892c-00ec-4c89-b6ee-d545c22a2804 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:10:23.551882 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 611/1216] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 16 17:10:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:10:23.557655 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d541e911-5be2-4c58-af21-c82ca89ecc83 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:10:23.629413 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:10:23.660694 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d541e911-5be2-4c58-af21-c82ca89ecc83 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:10:23.694632 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84de9c2-0aac-4975-ab0f-1c7d07c1ca06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:10:23.695424 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84de9c2-0aac-4975-ab0f-1c7d07c1ca06 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:10:23.695754 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84de9c2-0aac-4975-ab0f-1c7d07c1ca06 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:10:23.696036 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84de9c2-0aac-4975-ab0f-1c7d07c1ca06 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:10:23.702613 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84de9c2-0aac-4975-ab0f-1c7d07c1ca06 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:10:23.704135 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84de9c2-0aac-4975-ab0f-1c7d07c1ca06 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:10:23.718100 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application [None req-b84de9c2-0aac-4975-ab0f-1c7d07c1ca06 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 17:10:23.718100 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:10:23.718100 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:10:23.718100 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:10:23.718100 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:10:23.718100 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:10:23.718100 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:10:23.718100 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:10:23.718100 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:10:23.718100 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:10:23.718100 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:10:23.718100 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:10:23.718100 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 17:10:23.718100 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 17:10:23.718100 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 17:10:23.719302 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 17:10:23.719302 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:10:23.719302 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:10:23.719302 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:10:23.719302 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:10:23.719302 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:10:23.719302 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:10:23.719302 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:10:23.719302 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application with Lock( Jun 16 17:10:23.719302 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:10:23.719302 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:10:23.719302 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:10:23.719302 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:10:23.719302 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:10:23.719302 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:10:23.719302 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:10:23.719302 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:10:23.725208 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 17:10:23.725208 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 17:10:23.725208 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 17:10:23.725208 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 17:10:23.725208 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 17:10:23.725208 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 17:10:23.725208 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 17:10:23.725208 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Jun 16 17:10:23.725208 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 606/1217] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 16 17:10:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:10:23.725899 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6524892c-00ec-4c89-b6ee-d545c22a2804 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:10:23.831568 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6524892c-00ec-4c89-b6ee-d545c22a2804 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:10:23.853576 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:10:23.865170 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16710be9-a995-43f0-9caa-dd6985ba467d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:10:23.865855 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16710be9-a995-43f0-9caa-dd6985ba467d None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:10:23.866149 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16710be9-a995-43f0-9caa-dd6985ba467d None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:10:23.866428 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16710be9-a995-43f0-9caa-dd6985ba467d None admin] PATH_INFO: `/v3/projects` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:10:23.867208 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16710be9-a995-43f0-9caa-dd6985ba467d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:10:23.867520 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16710be9-a995-43f0-9caa-dd6985ba467d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:10:23.868978 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16710be9-a995-43f0-9caa-dd6985ba467d None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:10:23.881376 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 612/1218] 10.222.0.39 () {56 vars in 1148 bytes} [Thu Jun 16 17:10:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:10:23.887629 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84de9c2-0aac-4975-ab0f-1c7d07c1ca06 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:10:23.990469 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84de9c2-0aac-4975-ab0f-1c7d07c1ca06 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:10:24.018038 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:10:24.023888 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faac0274-95f1-41da-9837-c2347ca3fa89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:10:24.024546 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faac0274-95f1-41da-9837-c2347ca3fa89 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:10:24.024834 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faac0274-95f1-41da-9837-c2347ca3fa89 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:10:24.025114 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faac0274-95f1-41da-9837-c2347ca3fa89 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:10:24.025978 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faac0274-95f1-41da-9837-c2347ca3fa89 None admin] RBAC: Adding query filter params (role.id=a12797d48dac420cb2eaadbe537f60ef, scope.project.id=73015da4de1f48c29f57fff1040d2c10, user.id=2882f26811094d8e88c03701c94296fc) {{(pid=80873) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:10:24.026300 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faac0274-95f1-41da-9837-c2347ca3fa89 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:10:24.027721 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faac0274-95f1-41da-9837-c2347ca3fa89 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:10:24.033085 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 607/1219] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jun 16 17:10:23 2022] GET /identity/v3/role_assignments?user.id=2882f26811094d8e88c03701c94296fc&scope.project.id=73015da4de1f48c29f57fff1040d2c10&role.id=a12797d48dac420cb2eaadbe537f60ef => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:10:26.128482 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08f82b9-1946-47f6-b202-322be2f1a588 None None] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:10:26.129041 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08f82b9-1946-47f6-b202-322be2f1a588 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:10:26.129041 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08f82b9-1946-47f6-b202-322be2f1a588 None None] PATH_INFO: `/` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:10:26.130435 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 613/1220] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 17:10:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 17:10:26.135712 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629f3f4e-9935-441a-acd1-c219684249df None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:10:26.136176 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629f3f4e-9935-441a-acd1-c219684249df None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:10:26.136271 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629f3f4e-9935-441a-acd1-c219684249df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:10:26.153256 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-629f3f4e-9935-441a-acd1-c219684249df None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:10:26.154413 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-629f3f4e-9935-441a-acd1-c219684249df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:10:26.222958 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 608/1221] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 17:10:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 17:10:26.245390 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08f82b9-1946-47f6-b202-322be2f1a588 None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:10:26.350058 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08f82b9-1946-47f6-b202-322be2f1a588 None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:10:26.383728 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6474ffb5-2b3f-49eb-985d-d88de2d64e4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:10:26.384520 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6474ffb5-2b3f-49eb-985d-d88de2d64e4e None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:10:26.384810 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6474ffb5-2b3f-49eb-985d-d88de2d64e4e None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:10:26.385092 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6474ffb5-2b3f-49eb-985d-d88de2d64e4e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:10:26.396203 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6474ffb5-2b3f-49eb-985d-d88de2d64e4e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 17:10:26.404135 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application [None req-6474ffb5-2b3f-49eb-985d-d88de2d64e4e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 17:10:26.404135 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:10:26.404135 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:10:26.404135 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:10:26.404135 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:10:26.404135 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:10:26.404135 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:10:26.404135 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:10:26.404135 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:10:26.404135 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:10:26.404135 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:10:26.404135 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:10:26.404135 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 17:10:26.404135 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 17:10:26.404135 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 17:10:26.404135 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 17:10:26.405354 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 17:10:26.405354 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 17:10:26.405354 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 17:10:26.405354 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 17:10:26.405354 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:10:26.405354 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:10:26.405354 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:10:26.405354 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:10:26.405354 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:10:26.405354 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:10:26.405354 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:10:26.405354 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application with Lock( Jun 16 17:10:26.405354 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:10:26.405354 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:10:26.405354 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:10:26.405354 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:10:26.406418 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:10:26.406418 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:10:26.406418 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:10:26.406418 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:10:26.406418 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 17:10:26.406418 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 17:10:26.406418 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 17:10:26.406418 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 17:10:26.406418 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 17:10:26.406418 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 17:10:26.406418 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 17:10:26.406418 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Jun 16 17:10:26.406418 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 614/1222] 10.222.0.39 () {56 vars in 1102 bytes} [Thu Jun 16 17:10:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:10:26.411640 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629f3f4e-9935-441a-acd1-c219684249df None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:10:26.510705 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629f3f4e-9935-441a-acd1-c219684249df None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:10:26.533574 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:10:26.543632 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54517e5e-1600-4237-90f5-96426ca73ae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:10:26.544294 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54517e5e-1600-4237-90f5-96426ca73ae3 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:10:26.544575 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54517e5e-1600-4237-90f5-96426ca73ae3 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:10:26.544853 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54517e5e-1600-4237-90f5-96426ca73ae3 None admin] PATH_INFO: `/v3/roles` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:10:26.545590 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54517e5e-1600-4237-90f5-96426ca73ae3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80873) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:10:26.545928 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54517e5e-1600-4237-90f5-96426ca73ae3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:10:26.547278 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54517e5e-1600-4237-90f5-96426ca73ae3 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:10:26.555961 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 609/1223] 10.222.0.39 () {56 vars in 1103 bytes} [Thu Jun 16 17:10:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:10:26.561796 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6474ffb5-2b3f-49eb-985d-d88de2d64e4e None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:10:26.606326 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:10:26.663266 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6474ffb5-2b3f-49eb-985d-d88de2d64e4e None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:10:26.696741 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fff09b-bf54-4b7f-9dbe-a1645c36ab08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:10:26.697572 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fff09b-bf54-4b7f-9dbe-a1645c36ab08 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:10:26.697887 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fff09b-bf54-4b7f-9dbe-a1645c36ab08 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:10:26.698168 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fff09b-bf54-4b7f-9dbe-a1645c36ab08 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:10:26.709873 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fff09b-bf54-4b7f-9dbe-a1645c36ab08 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:10:26.716534 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fff09b-bf54-4b7f-9dbe-a1645c36ab08 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:10:26.729465 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application [None req-d3fff09b-bf54-4b7f-9dbe-a1645c36ab08 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:10:26.729465 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:10:26.729465 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:10:26.729465 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:10:26.729465 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:10:26.729465 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:10:26.729465 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:10:26.729465 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:10:26.729465 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:10:26.729465 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:10:26.729465 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:10:26.729465 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:10:26.729465 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 17:10:26.729465 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 17:10:26.729465 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 17:10:26.730615 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 17:10:26.730615 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:10:26.730615 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:10:26.730615 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:10:26.730615 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:10:26.730615 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:10:26.730615 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:10:26.730615 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:10:26.730615 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application with Lock( Jun 16 17:10:26.730615 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:10:26.730615 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:10:26.730615 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:10:26.730615 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:10:26.730615 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:10:26.730615 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:10:26.730615 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:10:26.730615 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:10:26.732005 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 17:10:26.732005 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 17:10:26.732005 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:10:26.732005 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Jun 16 17:10:26.732005 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 615/1224] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 17:10:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:10:26.736986 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54517e5e-1600-4237-90f5-96426ca73ae3 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:10:26.836500 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54517e5e-1600-4237-90f5-96426ca73ae3 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:10:26.869843 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dadcd19-aaea-469a-93d2-28f820d8482b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:10:26.870481 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dadcd19-aaea-469a-93d2-28f820d8482b None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:10:26.870770 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dadcd19-aaea-469a-93d2-28f820d8482b None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:10:26.871049 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dadcd19-aaea-469a-93d2-28f820d8482b None admin] PATH_INFO: `/v3/domains` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:10:26.871770 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dadcd19-aaea-469a-93d2-28f820d8482b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80873) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:10:26.872081 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dadcd19-aaea-469a-93d2-28f820d8482b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:10:26.873437 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dadcd19-aaea-469a-93d2-28f820d8482b None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:10:26.886021 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 610/1225] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 16 17:10:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:10:26.891560 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fff09b-bf54-4b7f-9dbe-a1645c36ab08 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:10:26.985904 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:10:26.993171 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fff09b-bf54-4b7f-9dbe-a1645c36ab08 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:10:27.026972 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367e369b-9884-487c-973a-f156c702815e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:10:27.027770 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367e369b-9884-487c-973a-f156c702815e None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:10:27.028058 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367e369b-9884-487c-973a-f156c702815e None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:10:27.028339 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367e369b-9884-487c-973a-f156c702815e None admin] PATH_INFO: `/v3/users/placement` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:10:27.035918 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367e369b-9884-487c-973a-f156c702815e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:10:27.037347 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367e369b-9884-487c-973a-f156c702815e None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:10:27.052620 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application [None req-367e369b-9884-487c-973a-f156c702815e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 16 17:10:27.052620 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:10:27.052620 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:10:27.052620 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:10:27.052620 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:10:27.052620 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:10:27.052620 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:10:27.052620 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:10:27.052620 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:10:27.052620 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:10:27.052620 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:10:27.052620 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:10:27.052620 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 17:10:27.052620 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 17:10:27.052620 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 17:10:27.052620 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 17:10:27.057702 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:10:27.057702 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:10:27.057702 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 17:10:27.057702 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 17:10:27.057702 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 17:10:27.057702 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 17:10:27.057702 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:10:27.057702 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:10:27.057702 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:10:27.057702 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:10:27.057702 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:10:27.057702 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application with Lock( Jun 16 17:10:27.057702 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:10:27.057702 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:10:27.057702 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:10:27.057702 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:10:27.057702 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:10:27.057702 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:10:27.058966 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:10:27.058966 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:10:27.058966 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 17:10:27.058966 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 17:10:27.058966 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 17:10:27.058966 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 17:10:27.058966 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 17:10:27.058966 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 17:10:27.058966 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 16 17:10:27.058966 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Jun 16 17:10:27.058966 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 616/1226] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 17:10:26 2022] GET /identity/v3/users/placement => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:10:27.059767 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dadcd19-aaea-469a-93d2-28f820d8482b None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:10:27.108183 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:10:27.160130 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dadcd19-aaea-469a-93d2-28f820d8482b None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:10:27.195438 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578d1bde-38e4-49ac-a831-5f7e89839bcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:10:27.196117 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578d1bde-38e4-49ac-a831-5f7e89839bcb None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:10:27.196407 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578d1bde-38e4-49ac-a831-5f7e89839bcb None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:10:27.196693 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578d1bde-38e4-49ac-a831-5f7e89839bcb None admin] PATH_INFO: `/v3/users` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:10:27.197537 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578d1bde-38e4-49ac-a831-5f7e89839bcb None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80873) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:10:27.197883 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578d1bde-38e4-49ac-a831-5f7e89839bcb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:10:27.199398 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578d1bde-38e4-49ac-a831-5f7e89839bcb None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:10:27.218370 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 611/1227] 10.222.0.39 () {56 vars in 1143 bytes} [Thu Jun 16 17:10:27 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:10:27.224838 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367e369b-9884-487c-973a-f156c702815e None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:10:27.323285 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367e369b-9884-487c-973a-f156c702815e None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:10:27.358198 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93596b96-dd61-4fad-9422-75113af413c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:10:27.359000 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93596b96-dd61-4fad-9422-75113af413c3 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:10:27.359296 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93596b96-dd61-4fad-9422-75113af413c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:10:27.359566 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93596b96-dd61-4fad-9422-75113af413c3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:10:27.369874 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93596b96-dd61-4fad-9422-75113af413c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:10:27.371389 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93596b96-dd61-4fad-9422-75113af413c3 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:10:27.388690 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application [None req-93596b96-dd61-4fad-9422-75113af413c3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:10:27.388690 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:10:27.388690 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:10:27.388690 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:10:27.388690 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:10:27.388690 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:10:27.388690 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:10:27.388690 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:10:27.388690 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:10:27.388690 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:10:27.388690 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:10:27.388690 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:10:27.388690 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 17:10:27.388690 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 17:10:27.388690 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 17:10:27.389845 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 17:10:27.389845 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:10:27.389845 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:10:27.389845 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:10:27.389845 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:10:27.389845 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:10:27.389845 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:10:27.389845 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:10:27.389845 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application with Lock( Jun 16 17:10:27.389845 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:10:27.389845 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:10:27.389845 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:10:27.389845 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:10:27.389845 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:10:27.389845 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:10:27.389845 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:10:27.389845 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:10:27.390791 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 17:10:27.390791 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 17:10:27.390791 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:10:27.390791 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Jun 16 17:10:27.390791 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 617/1228] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 17:10:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:10:27.396197 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578d1bde-38e4-49ac-a831-5f7e89839bcb None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:10:27.505451 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578d1bde-38e4-49ac-a831-5f7e89839bcb None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:10:27.507866 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:10:27.540352 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6733b2-c7f5-43e3-b90e-4a82c0c391a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:10:27.541045 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6733b2-c7f5-43e3-b90e-4a82c0c391a8 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:10:27.541337 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6733b2-c7f5-43e3-b90e-4a82c0c391a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:10:27.541620 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6733b2-c7f5-43e3-b90e-4a82c0c391a8 None admin] PATH_INFO: `/v3/domains` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:10:27.542391 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6733b2-c7f5-43e3-b90e-4a82c0c391a8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80873) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:10:27.542707 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6733b2-c7f5-43e3-b90e-4a82c0c391a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:10:27.544063 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6733b2-c7f5-43e3-b90e-4a82c0c391a8 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:10:27.555163 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 612/1229] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 16 17:10:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:10:27.560844 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93596b96-dd61-4fad-9422-75113af413c3 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:10:27.569659 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:10:27.660589 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93596b96-dd61-4fad-9422-75113af413c3 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:10:27.694836 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3dc197-ab62-4581-98fb-3a022d2382bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:10:27.695625 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3dc197-ab62-4581-98fb-3a022d2382bd None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:10:27.695909 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3dc197-ab62-4581-98fb-3a022d2382bd None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:10:27.696189 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3dc197-ab62-4581-98fb-3a022d2382bd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:10:27.702734 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3dc197-ab62-4581-98fb-3a022d2382bd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:10:27.704171 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3dc197-ab62-4581-98fb-3a022d2382bd None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:10:27.719489 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application [None req-bc3dc197-ab62-4581-98fb-3a022d2382bd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 17:10:27.719489 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:10:27.719489 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:10:27.719489 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:10:27.719489 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:10:27.719489 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:10:27.719489 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:10:27.719489 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:10:27.719489 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:10:27.719489 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:10:27.719489 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:10:27.719489 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:10:27.719489 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 17:10:27.719489 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 17:10:27.719489 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 17:10:27.720672 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 17:10:27.720672 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:10:27.720672 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:10:27.720672 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:10:27.720672 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:10:27.720672 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:10:27.720672 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:10:27.720672 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:10:27.720672 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application with Lock( Jun 16 17:10:27.720672 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:10:27.720672 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:10:27.720672 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:10:27.720672 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:10:27.720672 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:10:27.720672 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:10:27.720672 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:10:27.720672 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:10:27.721612 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 17:10:27.721612 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 17:10:27.721612 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 17:10:27.721612 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 17:10:27.721612 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 17:10:27.721612 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 17:10:27.721612 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 17:10:27.721612 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Jun 16 17:10:27.721612 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 618/1230] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 16 17:10:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 17:10:27.726593 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6733b2-c7f5-43e3-b90e-4a82c0c391a8 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:10:27.829672 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6733b2-c7f5-43e3-b90e-4a82c0c391a8 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:10:27.863248 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b58a367-ec8e-48a1-81e4-7f8bb1b76311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:10:27.863926 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b58a367-ec8e-48a1-81e4-7f8bb1b76311 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:10:27.864214 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b58a367-ec8e-48a1-81e4-7f8bb1b76311 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:10:27.864493 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b58a367-ec8e-48a1-81e4-7f8bb1b76311 None admin] PATH_INFO: `/v3/projects` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:10:27.865282 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b58a367-ec8e-48a1-81e4-7f8bb1b76311 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80873) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:10:27.865596 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b58a367-ec8e-48a1-81e4-7f8bb1b76311 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:10:27.867079 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b58a367-ec8e-48a1-81e4-7f8bb1b76311 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:10:27.880316 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 613/1231] 10.222.0.39 () {56 vars in 1148 bytes} [Thu Jun 16 17:10:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:10:27.887189 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3dc197-ab62-4581-98fb-3a022d2382bd None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:10:27.953985 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:10:27.988934 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3dc197-ab62-4581-98fb-3a022d2382bd None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:10:28.024124 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe492f8-5ee4-4040-935b-423af7a97aed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:10:28.025013 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe492f8-5ee4-4040-935b-423af7a97aed None admin] REQUEST_METHOD: `PUT` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:10:28.025303 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe492f8-5ee4-4040-935b-423af7a97aed None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:10:28.025586 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe492f8-5ee4-4040-935b-423af7a97aed None admin] PATH_INFO: `/v3/projects/73015da4de1f48c29f57fff1040d2c10/users/2882f26811094d8e88c03701c94296fc/roles/a12797d48dac420cb2eaadbe537f60ef` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:10:28.040176 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe492f8-5ee4-4040-935b-423af7a97aed None admin] RBAC: Authorizing `identity:create_grant(project_id=73015da4de1f48c29f57fff1040d2c10, user_id=2882f26811094d8e88c03701c94296fc, role_id=a12797d48dac420cb2eaadbe537f60ef)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:10:28.041632 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe492f8-5ee4-4040-935b-423af7a97aed None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:10:28.115844 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 619/1232] 10.222.0.39 () {58 vars in 1439 bytes} [Thu Jun 16 17:10:27 2022] PUT /identity/v3/projects/73015da4de1f48c29f57fff1040d2c10/users/2882f26811094d8e88c03701c94296fc/roles/a12797d48dac420cb2eaadbe537f60ef => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:10:30.285870 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548bb05f-707a-4e75-80ff-3f1ec929fb86 None None] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:10:30.286429 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548bb05f-707a-4e75-80ff-3f1ec929fb86 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:10:30.286429 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548bb05f-707a-4e75-80ff-3f1ec929fb86 None None] PATH_INFO: `/` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:10:30.287744 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 614/1233] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 17:10:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:10:30.293013 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7681a617-8fd7-48a6-aa6d-79f69d03ce8d None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:10:30.293447 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7681a617-8fd7-48a6-aa6d-79f69d03ce8d None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:10:30.293589 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7681a617-8fd7-48a6-aa6d-79f69d03ce8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:10:30.311040 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-7681a617-8fd7-48a6-aa6d-79f69d03ce8d None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:10:30.312237 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-7681a617-8fd7-48a6-aa6d-79f69d03ce8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:10:30.380467 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 620/1234] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 17:10:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 17:10:30.404974 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548bb05f-707a-4e75-80ff-3f1ec929fb86 None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:10:30.432812 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:10:30.520849 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548bb05f-707a-4e75-80ff-3f1ec929fb86 None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:10:30.562748 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ae193d-72a2-451e-9913-eeb931c5b9f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:10:30.563466 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ae193d-72a2-451e-9913-eeb931c5b9f3 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:10:30.563751 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ae193d-72a2-451e-9913-eeb931c5b9f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:10:30.564026 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ae193d-72a2-451e-9913-eeb931c5b9f3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:10:30.575380 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ae193d-72a2-451e-9913-eeb931c5b9f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 17:10:30.583628 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application [None req-68ae193d-72a2-451e-9913-eeb931c5b9f3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 17:10:30.583628 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:10:30.583628 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:10:30.583628 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:10:30.583628 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:10:30.583628 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:10:30.583628 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:10:30.583628 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:10:30.583628 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:10:30.583628 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:10:30.583628 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:10:30.583628 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:10:30.583628 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 17:10:30.583628 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 17:10:30.583628 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 17:10:30.583628 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 17:10:30.584824 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 17:10:30.584824 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 17:10:30.584824 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 17:10:30.584824 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 17:10:30.584824 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:10:30.584824 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:10:30.584824 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:10:30.584824 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:10:30.584824 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:10:30.584824 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:10:30.584824 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:10:30.584824 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application with Lock( Jun 16 17:10:30.584824 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:10:30.584824 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:10:30.584824 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:10:30.584824 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:10:30.585949 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:10:30.585949 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:10:30.585949 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:10:30.585949 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:10:30.585949 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 17:10:30.585949 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 17:10:30.585949 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 17:10:30.585949 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 17:10:30.585949 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 17:10:30.585949 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 17:10:30.585949 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 17:10:30.585949 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Jun 16 17:10:30.585949 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 615/1235] 10.222.0.39 () {56 vars in 1102 bytes} [Thu Jun 16 17:10:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:10:30.591425 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7681a617-8fd7-48a6-aa6d-79f69d03ce8d None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:10:30.652637 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:10:30.724173 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7681a617-8fd7-48a6-aa6d-79f69d03ce8d None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:10:30.774440 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f235c8-fe61-4faa-b4a3-7ed6f245a60c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:10:30.775109 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f235c8-fe61-4faa-b4a3-7ed6f245a60c None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:10:30.775392 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f235c8-fe61-4faa-b4a3-7ed6f245a60c None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:10:30.775665 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f235c8-fe61-4faa-b4a3-7ed6f245a60c None admin] PATH_INFO: `/v3/roles` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:10:30.776418 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f235c8-fe61-4faa-b4a3-7ed6f245a60c None admin] RBAC: Adding query filter params (name=service) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:10:30.776725 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f235c8-fe61-4faa-b4a3-7ed6f245a60c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:10:30.778111 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f235c8-fe61-4faa-b4a3-7ed6f245a60c None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:10:30.787599 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 621/1236] 10.222.0.39 () {56 vars in 1103 bytes} [Thu Jun 16 17:10:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:10:30.793660 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ae193d-72a2-451e-9913-eeb931c5b9f3 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:10:30.885446 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:10:30.903586 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ae193d-72a2-451e-9913-eeb931c5b9f3 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:10:30.937348 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46f1bc0-fd47-4b6a-81a3-22f2e4c5d806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:10:30.938174 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46f1bc0-fd47-4b6a-81a3-22f2e4c5d806 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:10:30.938461 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46f1bc0-fd47-4b6a-81a3-22f2e4c5d806 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:10:30.938741 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46f1bc0-fd47-4b6a-81a3-22f2e4c5d806 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:10:30.949680 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46f1bc0-fd47-4b6a-81a3-22f2e4c5d806 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:10:30.951161 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46f1bc0-fd47-4b6a-81a3-22f2e4c5d806 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:10:30.969188 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application [None req-b46f1bc0-fd47-4b6a-81a3-22f2e4c5d806 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:10:30.969188 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:10:30.969188 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:10:30.969188 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:10:30.969188 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:10:30.969188 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:10:30.969188 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:10:30.969188 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:10:30.969188 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:10:30.969188 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:10:30.969188 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:10:30.969188 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:10:30.969188 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 17:10:30.969188 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 17:10:30.969188 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 17:10:30.970384 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 17:10:30.970384 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:10:30.970384 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:10:30.970384 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:10:30.970384 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:10:30.970384 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:10:30.970384 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:10:30.970384 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:10:30.970384 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application with Lock( Jun 16 17:10:30.970384 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:10:30.970384 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:10:30.970384 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:10:30.970384 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:10:30.970384 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:10:30.970384 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:10:30.970384 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:10:30.970384 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:10:30.971782 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 17:10:30.971782 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 17:10:30.971782 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:10:30.971782 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Jun 16 17:10:30.971782 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 616/1237] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 17:10:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:10:30.976220 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f235c8-fe61-4faa-b4a3-7ed6f245a60c None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:10:31.076202 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f235c8-fe61-4faa-b4a3-7ed6f245a60c None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:10:31.085180 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:10:31.109563 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6461e62-e5f0-4b81-925e-a19fd0a6418a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:10:31.110258 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6461e62-e5f0-4b81-925e-a19fd0a6418a None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:10:31.110544 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6461e62-e5f0-4b81-925e-a19fd0a6418a None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:10:31.110819 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6461e62-e5f0-4b81-925e-a19fd0a6418a None admin] PATH_INFO: `/v3/domains` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:10:31.112063 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6461e62-e5f0-4b81-925e-a19fd0a6418a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:10:31.112374 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6461e62-e5f0-4b81-925e-a19fd0a6418a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:10:31.113733 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6461e62-e5f0-4b81-925e-a19fd0a6418a None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:10:31.124735 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 622/1238] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 16 17:10:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:10:31.130978 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46f1bc0-fd47-4b6a-81a3-22f2e4c5d806 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:10:31.233265 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46f1bc0-fd47-4b6a-81a3-22f2e4c5d806 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:10:31.270599 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cd899e-db42-42a5-b216-0c4bd20b9b62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:10:31.271546 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cd899e-db42-42a5-b216-0c4bd20b9b62 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:10:31.271875 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cd899e-db42-42a5-b216-0c4bd20b9b62 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:10:31.272210 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cd899e-db42-42a5-b216-0c4bd20b9b62 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:10:31.274983 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:10:31.280144 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cd899e-db42-42a5-b216-0c4bd20b9b62 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:10:31.281570 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cd899e-db42-42a5-b216-0c4bd20b9b62 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:10:31.296325 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application [None req-c3cd899e-db42-42a5-b216-0c4bd20b9b62 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 16 17:10:31.296325 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:10:31.296325 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:10:31.296325 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:10:31.296325 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:10:31.296325 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:10:31.296325 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:10:31.296325 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:10:31.296325 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:10:31.296325 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:10:31.296325 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:10:31.296325 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:10:31.296325 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 17:10:31.296325 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 17:10:31.296325 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 17:10:31.296325 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 17:10:31.298008 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:10:31.298008 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:10:31.298008 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 17:10:31.298008 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 17:10:31.298008 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 17:10:31.298008 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 17:10:31.298008 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:10:31.298008 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:10:31.298008 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:10:31.298008 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:10:31.298008 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:10:31.298008 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application with Lock( Jun 16 17:10:31.298008 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:10:31.298008 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:10:31.298008 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:10:31.298008 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:10:31.298008 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:10:31.298008 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:10:31.299285 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:10:31.299285 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:10:31.299285 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 17:10:31.299285 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 17:10:31.299285 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 17:10:31.299285 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 17:10:31.299285 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 17:10:31.299285 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 17:10:31.299285 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 16 17:10:31.299285 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Jun 16 17:10:31.299285 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 617/1239] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 17:10:31 2022] GET /identity/v3/users/placement => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:10:31.303491 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6461e62-e5f0-4b81-925e-a19fd0a6418a None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:10:31.406261 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6461e62-e5f0-4b81-925e-a19fd0a6418a None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:10:31.440282 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e2059e-f65c-4412-8ed2-3e6142cb8bc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:10:31.440955 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e2059e-f65c-4412-8ed2-3e6142cb8bc5 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:10:31.441245 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e2059e-f65c-4412-8ed2-3e6142cb8bc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:10:31.441527 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e2059e-f65c-4412-8ed2-3e6142cb8bc5 None admin] PATH_INFO: `/v3/users` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:10:31.442440 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e2059e-f65c-4412-8ed2-3e6142cb8bc5 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:10:31.442759 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e2059e-f65c-4412-8ed2-3e6142cb8bc5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:10:31.444247 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e2059e-f65c-4412-8ed2-3e6142cb8bc5 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:10:31.461955 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 623/1240] 10.222.0.39 () {56 vars in 1143 bytes} [Thu Jun 16 17:10:31 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:10:31.468039 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cd899e-db42-42a5-b216-0c4bd20b9b62 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:10:31.568042 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cd899e-db42-42a5-b216-0c4bd20b9b62 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:10:31.603718 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58582278-63a9-4634-b985-dc444d055b38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:10:31.604814 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58582278-63a9-4634-b985-dc444d055b38 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:10:31.605390 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58582278-63a9-4634-b985-dc444d055b38 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:10:31.605640 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58582278-63a9-4634-b985-dc444d055b38 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:10:31.668935 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:10:31.675401 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58582278-63a9-4634-b985-dc444d055b38 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:10:31.676829 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58582278-63a9-4634-b985-dc444d055b38 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:10:31.775275 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 618/1241] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 16 17:10:31 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 17:10:31.781121 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e2059e-f65c-4412-8ed2-3e6142cb8bc5 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:10:31.808109 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:10:31.883002 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e2059e-f65c-4412-8ed2-3e6142cb8bc5 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:10:31.918609 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934ed591-0572-402d-b9d2-b3db9b4820dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:10:31.919403 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934ed591-0572-402d-b9d2-b3db9b4820dd None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:10:31.919690 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934ed591-0572-402d-b9d2-b3db9b4820dd None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:10:31.919969 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934ed591-0572-402d-b9d2-b3db9b4820dd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:10:31.930446 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934ed591-0572-402d-b9d2-b3db9b4820dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:10:31.931926 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934ed591-0572-402d-b9d2-b3db9b4820dd None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:10:31.949655 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application [None req-934ed591-0572-402d-b9d2-b3db9b4820dd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:10:31.949655 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:10:31.949655 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:10:31.949655 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:10:31.949655 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:10:31.949655 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:10:31.949655 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:10:31.949655 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:10:31.949655 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:10:31.949655 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:10:31.949655 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:10:31.949655 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:10:31.949655 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 17:10:31.949655 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 17:10:31.949655 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 17:10:31.950773 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 17:10:31.950773 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:10:31.950773 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:10:31.950773 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:10:31.950773 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:10:31.950773 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:10:31.950773 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:10:31.950773 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:10:31.950773 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application with Lock( Jun 16 17:10:31.950773 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:10:31.950773 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:10:31.950773 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:10:31.950773 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:10:31.950773 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:10:31.950773 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:10:31.950773 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:10:31.950773 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:10:31.952109 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 17:10:31.952109 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 17:10:31.952109 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:10:31.952109 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Jun 16 17:10:31.952109 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 624/1242] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 17:10:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 17:10:31.956687 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58582278-63a9-4634-b985-dc444d055b38 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:10:32.059597 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:10:32.065967 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58582278-63a9-4634-b985-dc444d055b38 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:10:32.099454 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f108fa54-c5ed-4615-83f4-ae832ac31224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:10:32.100132 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f108fa54-c5ed-4615-83f4-ae832ac31224 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:10:32.104307 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f108fa54-c5ed-4615-83f4-ae832ac31224 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:10:32.104307 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f108fa54-c5ed-4615-83f4-ae832ac31224 None admin] PATH_INFO: `/v3/domains` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:10:32.104307 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f108fa54-c5ed-4615-83f4-ae832ac31224 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80873) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:10:32.104307 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f108fa54-c5ed-4615-83f4-ae832ac31224 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:10:32.104307 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f108fa54-c5ed-4615-83f4-ae832ac31224 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:10:32.114964 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 619/1243] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 16 17:10:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:10:32.120714 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934ed591-0572-402d-b9d2-b3db9b4820dd None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:10:32.198686 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:10:32.219420 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934ed591-0572-402d-b9d2-b3db9b4820dd None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:10:32.254987 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639f69d9-8ee4-4555-815b-c7aa0fb8d268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:10:32.255771 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639f69d9-8ee4-4555-815b-c7aa0fb8d268 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:10:32.256055 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639f69d9-8ee4-4555-815b-c7aa0fb8d268 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:10:32.256330 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639f69d9-8ee4-4555-815b-c7aa0fb8d268 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:10:32.262731 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639f69d9-8ee4-4555-815b-c7aa0fb8d268 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:10:32.264292 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639f69d9-8ee4-4555-815b-c7aa0fb8d268 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:10:32.278471 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application [None req-639f69d9-8ee4-4555-815b-c7aa0fb8d268 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 17:10:32.278471 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:10:32.278471 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:10:32.278471 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:10:32.278471 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:10:32.278471 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:10:32.278471 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:10:32.278471 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:10:32.278471 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:10:32.278471 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:10:32.278471 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:10:32.278471 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:10:32.278471 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 17:10:32.278471 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 17:10:32.278471 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 17:10:32.279587 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 17:10:32.279587 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:10:32.279587 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:10:32.279587 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:10:32.279587 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:10:32.279587 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:10:32.279587 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:10:32.279587 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:10:32.279587 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application with Lock( Jun 16 17:10:32.279587 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:10:32.279587 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:10:32.279587 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:10:32.279587 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:10:32.279587 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:10:32.279587 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:10:32.279587 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:10:32.279587 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:10:32.280791 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 17:10:32.280791 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 17:10:32.280791 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 17:10:32.280791 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 17:10:32.280791 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 17:10:32.280791 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 17:10:32.280791 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 17:10:32.280791 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Jun 16 17:10:32.280791 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 625/1244] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 16 17:10:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 17:10:32.286151 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f108fa54-c5ed-4615-83f4-ae832ac31224 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:10:32.385384 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f108fa54-c5ed-4615-83f4-ae832ac31224 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:10:32.418163 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142d7140-2ec4-4d84-bce6-dd9e974cf4b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:10:32.418820 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142d7140-2ec4-4d84-bce6-dd9e974cf4b4 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:10:32.419105 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142d7140-2ec4-4d84-bce6-dd9e974cf4b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:10:32.419383 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142d7140-2ec4-4d84-bce6-dd9e974cf4b4 None admin] PATH_INFO: `/v3/projects` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:10:32.420297 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142d7140-2ec4-4d84-bce6-dd9e974cf4b4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80873) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:10:32.420604 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142d7140-2ec4-4d84-bce6-dd9e974cf4b4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:10:32.422032 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142d7140-2ec4-4d84-bce6-dd9e974cf4b4 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:10:32.434352 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 620/1245] 10.222.0.39 () {56 vars in 1148 bytes} [Thu Jun 16 17:10:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:10:32.440499 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639f69d9-8ee4-4555-815b-c7aa0fb8d268 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:10:32.543232 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639f69d9-8ee4-4555-815b-c7aa0fb8d268 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:10:32.576226 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29974de2-8fd9-4411-8361-dd3d0ce7427d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:10:32.576890 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29974de2-8fd9-4411-8361-dd3d0ce7427d None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:10:32.577209 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29974de2-8fd9-4411-8361-dd3d0ce7427d None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:10:32.577459 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29974de2-8fd9-4411-8361-dd3d0ce7427d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:10:32.578343 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29974de2-8fd9-4411-8361-dd3d0ce7427d None admin] RBAC: Adding query filter params (role.id=a12797d48dac420cb2eaadbe537f60ef, scope.project.id=73015da4de1f48c29f57fff1040d2c10, user.id=2882f26811094d8e88c03701c94296fc) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:10:32.578660 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29974de2-8fd9-4411-8361-dd3d0ce7427d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:10:32.580695 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29974de2-8fd9-4411-8361-dd3d0ce7427d None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:10:32.586694 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 626/1246] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jun 16 17:10:32 2022] GET /identity/v3/role_assignments?user.id=2882f26811094d8e88c03701c94296fc&scope.project.id=73015da4de1f48c29f57fff1040d2c10&role.id=a12797d48dac420cb2eaadbe537f60ef => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:10:34.780256 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b918cf69-5c01-4877-a776-df42e437b778 None None] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:10:34.780808 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b918cf69-5c01-4877-a776-df42e437b778 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:10:34.780808 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b918cf69-5c01-4877-a776-df42e437b778 None None] PATH_INFO: `/` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:10:34.782321 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 621/1247] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 17:10:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:10:34.790674 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0523f127-9d72-4ff7-b1ab-c1bc0a5f5211 None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:10:34.791238 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0523f127-9d72-4ff7-b1ab-c1bc0a5f5211 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:10:34.791238 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0523f127-9d72-4ff7-b1ab-c1bc0a5f5211 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:10:34.796306 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:10:34.809389 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-0523f127-9d72-4ff7-b1ab-c1bc0a5f5211 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:10:34.810628 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-0523f127-9d72-4ff7-b1ab-c1bc0a5f5211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:10:34.878035 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 627/1248] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 17:10:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 17:10:34.901636 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b918cf69-5c01-4877-a776-df42e437b778 None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:10:34.920217 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:10:35.005215 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b918cf69-5c01-4877-a776-df42e437b778 None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:10:35.037971 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a319a376-c112-479c-9277-0634f0e85222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:10:35.038690 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a319a376-c112-479c-9277-0634f0e85222 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:10:35.038975 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a319a376-c112-479c-9277-0634f0e85222 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:10:35.039251 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a319a376-c112-479c-9277-0634f0e85222 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:10:35.049753 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a319a376-c112-479c-9277-0634f0e85222 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 17:10:35.057515 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application [None req-a319a376-c112-479c-9277-0634f0e85222 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 17:10:35.057515 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:10:35.057515 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:10:35.057515 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:10:35.057515 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:10:35.057515 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:10:35.057515 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:10:35.057515 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:10:35.057515 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:10:35.057515 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:10:35.057515 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:10:35.057515 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:10:35.057515 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 17:10:35.057515 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 17:10:35.057515 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 17:10:35.057515 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 17:10:35.058731 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 17:10:35.058731 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 17:10:35.058731 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 17:10:35.058731 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 17:10:35.058731 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:10:35.058731 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:10:35.058731 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:10:35.058731 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:10:35.058731 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:10:35.058731 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:10:35.058731 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:10:35.058731 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application with Lock( Jun 16 17:10:35.058731 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:10:35.058731 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:10:35.058731 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:10:35.058731 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:10:35.059980 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:10:35.059980 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:10:35.059980 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:10:35.059980 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:10:35.059980 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 17:10:35.059980 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 17:10:35.059980 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 17:10:35.059980 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 17:10:35.059980 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 17:10:35.059980 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 17:10:35.059980 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 17:10:35.059980 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Jun 16 17:10:35.059980 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 622/1249] 10.222.0.39 () {56 vars in 1096 bytes} [Thu Jun 16 17:10:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:10:35.065499 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0523f127-9d72-4ff7-b1ab-c1bc0a5f5211 None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:10:35.165982 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0523f127-9d72-4ff7-b1ab-c1bc0a5f5211 None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:10:35.195152 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:10:35.199947 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b800124e-b284-4df6-906c-82bc4797e01c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:10:35.200616 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b800124e-b284-4df6-906c-82bc4797e01c None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:10:35.200905 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b800124e-b284-4df6-906c-82bc4797e01c None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:10:35.201185 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b800124e-b284-4df6-906c-82bc4797e01c None admin] PATH_INFO: `/v3/roles` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:10:35.201967 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b800124e-b284-4df6-906c-82bc4797e01c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:10:35.202284 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b800124e-b284-4df6-906c-82bc4797e01c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:10:35.203649 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b800124e-b284-4df6-906c-82bc4797e01c None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:10:35.211572 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 628/1250] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 16 17:10:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:10:35.217553 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a319a376-c112-479c-9277-0634f0e85222 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:10:35.295575 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:10:35.318330 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a319a376-c112-479c-9277-0634f0e85222 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:10:35.351792 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74436cb-aa26-476d-9034-f91e5acb2cdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:10:35.352586 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74436cb-aa26-476d-9034-f91e5acb2cdf None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:10:35.352875 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74436cb-aa26-476d-9034-f91e5acb2cdf None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:10:35.353157 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74436cb-aa26-476d-9034-f91e5acb2cdf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:10:35.364202 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74436cb-aa26-476d-9034-f91e5acb2cdf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:10:35.365782 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74436cb-aa26-476d-9034-f91e5acb2cdf None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:10:35.382603 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application [None req-e74436cb-aa26-476d-9034-f91e5acb2cdf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:10:35.382603 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:10:35.382603 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:10:35.382603 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:10:35.382603 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:10:35.382603 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:10:35.382603 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:10:35.382603 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:10:35.382603 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:10:35.382603 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:10:35.382603 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:10:35.382603 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:10:35.382603 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 17:10:35.382603 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 17:10:35.382603 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 17:10:35.383731 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 17:10:35.383731 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:10:35.383731 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:10:35.383731 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:10:35.383731 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:10:35.383731 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:10:35.383731 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:10:35.383731 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:10:35.383731 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application with Lock( Jun 16 17:10:35.383731 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:10:35.383731 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:10:35.383731 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:10:35.383731 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:10:35.383731 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:10:35.383731 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:10:35.383731 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:10:35.383731 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:10:35.384712 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 17:10:35.384712 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 17:10:35.384712 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:10:35.384712 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Jun 16 17:10:35.384712 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 623/1251] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 17:10:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:10:35.389747 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b800124e-b284-4df6-906c-82bc4797e01c None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:10:35.489616 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b800124e-b284-4df6-906c-82bc4797e01c None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:10:35.522799 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16caaec0-85c4-484a-9e21-30e09ba692d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:10:35.523481 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16caaec0-85c4-484a-9e21-30e09ba692d2 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:10:35.523769 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16caaec0-85c4-484a-9e21-30e09ba692d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:10:35.524048 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16caaec0-85c4-484a-9e21-30e09ba692d2 None admin] PATH_INFO: `/v3/domains` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:10:35.524770 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16caaec0-85c4-484a-9e21-30e09ba692d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:10:35.525080 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16caaec0-85c4-484a-9e21-30e09ba692d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:10:35.526470 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16caaec0-85c4-484a-9e21-30e09ba692d2 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:10:35.538823 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 629/1252] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 16 17:10:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:10:35.544647 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74436cb-aa26-476d-9034-f91e5acb2cdf None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:10:35.645108 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74436cb-aa26-476d-9034-f91e5acb2cdf None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:10:35.671711 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:10:35.679347 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f978d9-1b16-4062-887a-a60d7ceea80d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:10:35.680253 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f978d9-1b16-4062-887a-a60d7ceea80d None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:10:35.680540 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f978d9-1b16-4062-887a-a60d7ceea80d None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:10:35.680819 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f978d9-1b16-4062-887a-a60d7ceea80d None admin] PATH_INFO: `/v3/users/placement` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:10:35.688229 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f978d9-1b16-4062-887a-a60d7ceea80d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:10:35.689842 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f978d9-1b16-4062-887a-a60d7ceea80d None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:10:35.703997 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application [None req-70f978d9-1b16-4062-887a-a60d7ceea80d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 16 17:10:35.703997 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:10:35.703997 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:10:35.703997 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:10:35.703997 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:10:35.703997 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:10:35.703997 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:10:35.703997 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:10:35.703997 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:10:35.703997 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:10:35.703997 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:10:35.703997 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:10:35.703997 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 17:10:35.703997 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 17:10:35.703997 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 17:10:35.703997 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 17:10:35.705744 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:10:35.705744 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:10:35.705744 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 17:10:35.705744 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 17:10:35.705744 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 17:10:35.705744 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 17:10:35.705744 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:10:35.705744 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:10:35.705744 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:10:35.705744 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:10:35.705744 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:10:35.705744 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application with Lock( Jun 16 17:10:35.705744 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:10:35.705744 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:10:35.705744 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:10:35.705744 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:10:35.705744 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:10:35.705744 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:10:35.706983 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:10:35.706983 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:10:35.706983 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 17:10:35.706983 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 17:10:35.706983 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 17:10:35.706983 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 17:10:35.706983 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 17:10:35.706983 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 17:10:35.706983 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 16 17:10:35.706983 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Jun 16 17:10:35.706983 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 624/1253] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 17:10:35 2022] GET /identity/v3/users/placement => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:10:35.711813 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16caaec0-85c4-484a-9e21-30e09ba692d2 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:10:35.770808 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:10:35.814576 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16caaec0-85c4-484a-9e21-30e09ba692d2 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:10:35.850513 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5e3375-2e6e-420d-846e-892867a8ac11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:10:35.851185 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5e3375-2e6e-420d-846e-892867a8ac11 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:10:35.851474 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5e3375-2e6e-420d-846e-892867a8ac11 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:10:35.851754 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5e3375-2e6e-420d-846e-892867a8ac11 None admin] PATH_INFO: `/v3/users` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:10:35.852597 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5e3375-2e6e-420d-846e-892867a8ac11 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:10:35.852916 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5e3375-2e6e-420d-846e-892867a8ac11 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:10:35.854405 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5e3375-2e6e-420d-846e-892867a8ac11 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:10:35.872396 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 630/1254] 10.222.0.39 () {56 vars in 1143 bytes} [Thu Jun 16 17:10:35 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:10:35.878891 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f978d9-1b16-4062-887a-a60d7ceea80d None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:10:35.980459 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f978d9-1b16-4062-887a-a60d7ceea80d None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:10:36.013191 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80205f9e-6efb-4ab4-8f68-f0ed3d7101b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:10:36.013880 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80205f9e-6efb-4ab4-8f68-f0ed3d7101b8 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:10:36.014145 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80205f9e-6efb-4ab4-8f68-f0ed3d7101b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:10:36.014424 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80205f9e-6efb-4ab4-8f68-f0ed3d7101b8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:10:36.067893 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:10:36.079865 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80205f9e-6efb-4ab4-8f68-f0ed3d7101b8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:10:36.081945 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80205f9e-6efb-4ab4-8f68-f0ed3d7101b8 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:10:36.183990 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 625/1255] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 16 17:10:35 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 17:10:36.190667 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5e3375-2e6e-420d-846e-892867a8ac11 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:10:36.288566 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5e3375-2e6e-420d-846e-892867a8ac11 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:10:36.301916 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:10:36.322415 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065a32cd-3950-4697-93b7-fac31995089d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:10:36.323204 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065a32cd-3950-4697-93b7-fac31995089d None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:10:36.323486 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065a32cd-3950-4697-93b7-fac31995089d None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:10:36.323766 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065a32cd-3950-4697-93b7-fac31995089d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:10:36.333514 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065a32cd-3950-4697-93b7-fac31995089d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:10:36.334977 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065a32cd-3950-4697-93b7-fac31995089d None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:10:36.353340 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application [None req-065a32cd-3950-4697-93b7-fac31995089d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:10:36.353340 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:10:36.353340 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:10:36.353340 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:10:36.353340 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:10:36.353340 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:10:36.353340 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:10:36.353340 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:10:36.353340 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:10:36.353340 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:10:36.353340 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:10:36.353340 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:10:36.353340 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 17:10:36.353340 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 17:10:36.353340 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 17:10:36.354475 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 17:10:36.354475 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:10:36.354475 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:10:36.354475 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:10:36.354475 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:10:36.354475 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:10:36.354475 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:10:36.354475 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:10:36.354475 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application with Lock( Jun 16 17:10:36.354475 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:10:36.354475 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:10:36.354475 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:10:36.354475 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:10:36.354475 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:10:36.354475 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:10:36.354475 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:10:36.354475 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:10:36.355754 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 17:10:36.355754 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 17:10:36.355754 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:10:36.355754 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Jun 16 17:10:36.355754 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 631/1256] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 17:10:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:10:36.360399 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80205f9e-6efb-4ab4-8f68-f0ed3d7101b8 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:10:36.446580 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:10:36.457946 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80205f9e-6efb-4ab4-8f68-f0ed3d7101b8 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:10:36.492448 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f339b89-e944-4e5a-8334-b83131aafe53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:10:36.493115 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f339b89-e944-4e5a-8334-b83131aafe53 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:10:36.493404 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f339b89-e944-4e5a-8334-b83131aafe53 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:10:36.493687 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f339b89-e944-4e5a-8334-b83131aafe53 None admin] PATH_INFO: `/v3/domains` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:10:36.494442 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f339b89-e944-4e5a-8334-b83131aafe53 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80873) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:10:36.494756 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f339b89-e944-4e5a-8334-b83131aafe53 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:10:36.496133 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f339b89-e944-4e5a-8334-b83131aafe53 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:10:36.507878 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 626/1257] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 16 17:10:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:10:36.513753 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065a32cd-3950-4697-93b7-fac31995089d None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:10:36.614142 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065a32cd-3950-4697-93b7-fac31995089d None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:10:36.647915 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e10c65-8a4a-4c97-8be8-a60612c1eb57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:10:36.648706 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e10c65-8a4a-4c97-8be8-a60612c1eb57 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:10:36.648994 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e10c65-8a4a-4c97-8be8-a60612c1eb57 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:10:36.649273 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e10c65-8a4a-4c97-8be8-a60612c1eb57 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:10:36.656049 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e10c65-8a4a-4c97-8be8-a60612c1eb57 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:10:36.657507 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e10c65-8a4a-4c97-8be8-a60612c1eb57 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:10:36.671788 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application [None req-c6e10c65-8a4a-4c97-8be8-a60612c1eb57 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 17:10:36.671788 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:10:36.671788 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:10:36.671788 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:10:36.671788 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:10:36.671788 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:10:36.671788 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:10:36.671788 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:10:36.671788 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:10:36.671788 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:10:36.671788 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:10:36.671788 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:10:36.671788 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 17:10:36.671788 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 17:10:36.671788 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 17:10:36.672842 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 17:10:36.672842 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:10:36.672842 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:10:36.672842 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:10:36.672842 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:10:36.672842 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:10:36.672842 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:10:36.672842 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:10:36.672842 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application with Lock( Jun 16 17:10:36.672842 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:10:36.672842 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:10:36.672842 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:10:36.672842 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:10:36.672842 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:10:36.672842 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:10:36.672842 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:10:36.672842 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:10:36.674638 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 17:10:36.674638 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 17:10:36.674638 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 17:10:36.674638 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 17:10:36.674638 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 17:10:36.674638 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 17:10:36.674638 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 17:10:36.674638 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Jun 16 17:10:36.674638 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 632/1258] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 16 17:10:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:10:36.679562 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f339b89-e944-4e5a-8334-b83131aafe53 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:10:36.778633 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f339b89-e944-4e5a-8334-b83131aafe53 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:10:36.814566 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bf52a4-9f67-47b9-8482-3602e101b8f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:10:36.815262 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bf52a4-9f67-47b9-8482-3602e101b8f4 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:10:36.815617 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bf52a4-9f67-47b9-8482-3602e101b8f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:10:36.815864 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bf52a4-9f67-47b9-8482-3602e101b8f4 None admin] PATH_INFO: `/v3/projects` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:10:36.816645 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bf52a4-9f67-47b9-8482-3602e101b8f4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80873) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:10:36.816961 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bf52a4-9f67-47b9-8482-3602e101b8f4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:10:36.818413 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bf52a4-9f67-47b9-8482-3602e101b8f4 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:10:36.831550 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 627/1259] 10.222.0.39 () {56 vars in 1148 bytes} [Thu Jun 16 17:10:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:10:36.837817 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e10c65-8a4a-4c97-8be8-a60612c1eb57 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:10:36.867903 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:10:36.942839 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e10c65-8a4a-4c97-8be8-a60612c1eb57 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:10:36.975866 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cf62c0-bf73-41a7-bb96-b1f5110e49d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:10:36.976508 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cf62c0-bf73-41a7-bb96-b1f5110e49d7 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:10:36.976795 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cf62c0-bf73-41a7-bb96-b1f5110e49d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:10:36.977077 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cf62c0-bf73-41a7-bb96-b1f5110e49d7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:10:36.977939 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cf62c0-bf73-41a7-bb96-b1f5110e49d7 None admin] RBAC: Adding query filter params (role.id=dba744f8ab2a4c45b9d3212f8d203aba, scope.project.id=73015da4de1f48c29f57fff1040d2c10, user.id=2882f26811094d8e88c03701c94296fc) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:10:36.978256 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cf62c0-bf73-41a7-bb96-b1f5110e49d7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:10:36.979677 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cf62c0-bf73-41a7-bb96-b1f5110e49d7 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:10:36.985049 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 633/1260] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jun 16 17:10:36 2022] GET /identity/v3/role_assignments?user.id=2882f26811094d8e88c03701c94296fc&scope.project.id=73015da4de1f48c29f57fff1040d2c10&role.id=dba744f8ab2a4c45b9d3212f8d203aba => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 17:10:39.114010 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e5804e-674c-48c1-a249-e58cef06fa3e None None] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:10:39.114538 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e5804e-674c-48c1-a249-e58cef06fa3e None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:10:39.114538 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e5804e-674c-48c1-a249-e58cef06fa3e None None] PATH_INFO: `/` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:10:39.115923 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 628/1261] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 17:10:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:10:39.121182 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f90e1b6-9d84-463b-8731-5ec291a16dfb None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:10:39.121604 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f90e1b6-9d84-463b-8731-5ec291a16dfb None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:10:39.121751 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f90e1b6-9d84-463b-8731-5ec291a16dfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:10:39.138750 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-5f90e1b6-9d84-463b-8731-5ec291a16dfb None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:10:39.139937 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-5f90e1b6-9d84-463b-8731-5ec291a16dfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:10:39.211832 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 634/1262] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 17:10:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 17:10:39.233949 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e5804e-674c-48c1-a249-e58cef06fa3e None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:10:39.245237 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:10:39.353634 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e5804e-674c-48c1-a249-e58cef06fa3e None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:10:39.388226 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5710c0-5359-4950-b1d0-1b25c29de6ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:10:39.389018 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5710c0-5359-4950-b1d0-1b25c29de6ee None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:10:39.389308 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5710c0-5359-4950-b1d0-1b25c29de6ee None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:10:39.389589 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5710c0-5359-4950-b1d0-1b25c29de6ee None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:10:39.399786 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5710c0-5359-4950-b1d0-1b25c29de6ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 17:10:39.407474 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application [None req-ce5710c0-5359-4950-b1d0-1b25c29de6ee None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 17:10:39.407474 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:10:39.407474 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:10:39.407474 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:10:39.407474 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:10:39.407474 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:10:39.407474 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:10:39.407474 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:10:39.407474 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:10:39.407474 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:10:39.407474 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:10:39.407474 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:10:39.407474 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 17:10:39.407474 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 17:10:39.407474 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 17:10:39.407474 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 17:10:39.411702 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 17:10:39.411702 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 17:10:39.411702 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 17:10:39.411702 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 17:10:39.411702 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:10:39.411702 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:10:39.411702 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:10:39.411702 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:10:39.411702 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:10:39.411702 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:10:39.411702 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:10:39.411702 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application with Lock( Jun 16 17:10:39.411702 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:10:39.411702 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:10:39.411702 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:10:39.411702 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:10:39.412560 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:10:39.412560 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:10:39.412560 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:10:39.412560 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:10:39.412560 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 17:10:39.412560 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 17:10:39.412560 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 17:10:39.412560 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 17:10:39.412560 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 17:10:39.412560 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 17:10:39.412560 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 17:10:39.412560 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Jun 16 17:10:39.412560 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 629/1263] 10.222.0.39 () {56 vars in 1096 bytes} [Thu Jun 16 17:10:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:10:39.415104 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f90e1b6-9d84-463b-8731-5ec291a16dfb None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:10:39.433555 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:10:39.512929 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f90e1b6-9d84-463b-8731-5ec291a16dfb None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:10:39.546238 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8da56bd-219b-4d9b-9c40-21a4a0091072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:10:39.546899 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8da56bd-219b-4d9b-9c40-21a4a0091072 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:10:39.547189 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8da56bd-219b-4d9b-9c40-21a4a0091072 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:10:39.547471 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8da56bd-219b-4d9b-9c40-21a4a0091072 None admin] PATH_INFO: `/v3/roles` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:10:39.548219 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8da56bd-219b-4d9b-9c40-21a4a0091072 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:10:39.548533 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8da56bd-219b-4d9b-9c40-21a4a0091072 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:10:39.550451 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8da56bd-219b-4d9b-9c40-21a4a0091072 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:10:39.558316 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 635/1264] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 16 17:10:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:10:39.564259 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5710c0-5359-4950-b1d0-1b25c29de6ee None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:10:39.637502 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:10:39.670574 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5710c0-5359-4950-b1d0-1b25c29de6ee None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:10:39.703957 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6630305-3415-4150-9c86-b66491dac7f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:10:39.704740 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6630305-3415-4150-9c86-b66491dac7f5 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:10:39.705094 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6630305-3415-4150-9c86-b66491dac7f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:10:39.705371 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6630305-3415-4150-9c86-b66491dac7f5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:10:39.716080 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6630305-3415-4150-9c86-b66491dac7f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:10:39.717676 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6630305-3415-4150-9c86-b66491dac7f5 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:10:39.734763 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application [None req-b6630305-3415-4150-9c86-b66491dac7f5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:10:39.734763 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:10:39.734763 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:10:39.734763 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:10:39.734763 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:10:39.734763 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:10:39.734763 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:10:39.734763 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:10:39.734763 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:10:39.734763 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:10:39.734763 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:10:39.734763 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:10:39.734763 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 17:10:39.734763 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 17:10:39.734763 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 17:10:39.736911 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 17:10:39.736911 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:10:39.736911 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:10:39.736911 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:10:39.736911 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:10:39.736911 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:10:39.736911 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:10:39.736911 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:10:39.736911 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application with Lock( Jun 16 17:10:39.736911 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:10:39.736911 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:10:39.736911 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:10:39.736911 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:10:39.736911 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:10:39.736911 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:10:39.736911 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:10:39.736911 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:10:39.738312 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 17:10:39.738312 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 17:10:39.738312 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:10:39.738312 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Jun 16 17:10:39.738312 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 630/1265] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 17:10:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:10:39.742699 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8da56bd-219b-4d9b-9c40-21a4a0091072 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:10:39.824843 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:10:39.843927 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8da56bd-219b-4d9b-9c40-21a4a0091072 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:10:39.878435 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc0bf4a-5f76-4945-bc03-80add34dfd0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:10:39.879149 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc0bf4a-5f76-4945-bc03-80add34dfd0a None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:10:39.879433 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc0bf4a-5f76-4945-bc03-80add34dfd0a None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:10:39.879711 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc0bf4a-5f76-4945-bc03-80add34dfd0a None admin] PATH_INFO: `/v3/domains` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:10:39.880439 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc0bf4a-5f76-4945-bc03-80add34dfd0a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:10:39.880745 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc0bf4a-5f76-4945-bc03-80add34dfd0a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:10:39.882151 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc0bf4a-5f76-4945-bc03-80add34dfd0a None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:10:39.894688 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 636/1266] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 16 17:10:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:10:39.900486 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6630305-3415-4150-9c86-b66491dac7f5 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:10:40.002458 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6630305-3415-4150-9c86-b66491dac7f5 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:10:40.022122 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:10:40.035474 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdf75b1-4868-4344-8bc1-4c9a308a4002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:10:40.036266 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdf75b1-4868-4344-8bc1-4c9a308a4002 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:10:40.036546 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdf75b1-4868-4344-8bc1-4c9a308a4002 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:10:40.036816 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdf75b1-4868-4344-8bc1-4c9a308a4002 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:10:40.044036 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdf75b1-4868-4344-8bc1-4c9a308a4002 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:10:40.045450 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdf75b1-4868-4344-8bc1-4c9a308a4002 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:10:40.059916 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application [None req-efdf75b1-4868-4344-8bc1-4c9a308a4002 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 16 17:10:40.059916 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:10:40.059916 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:10:40.059916 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:10:40.059916 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:10:40.059916 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:10:40.059916 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:10:40.059916 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:10:40.059916 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:10:40.059916 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:10:40.059916 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:10:40.059916 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:10:40.059916 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 17:10:40.059916 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 17:10:40.059916 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 17:10:40.059916 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 17:10:40.061123 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:10:40.061123 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:10:40.061123 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 17:10:40.061123 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 17:10:40.061123 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 17:10:40.061123 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 17:10:40.061123 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:10:40.061123 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:10:40.061123 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:10:40.061123 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:10:40.061123 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:10:40.061123 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application with Lock( Jun 16 17:10:40.061123 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:10:40.061123 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:10:40.061123 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:10:40.061123 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:10:40.061123 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:10:40.061123 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:10:40.062481 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:10:40.062481 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:10:40.062481 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 17:10:40.062481 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 17:10:40.062481 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 17:10:40.062481 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 17:10:40.062481 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 17:10:40.062481 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 17:10:40.062481 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 16 17:10:40.062481 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Jun 16 17:10:40.062481 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 631/1267] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 17:10:39 2022] GET /identity/v3/users/placement => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 17:10:40.067698 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc0bf4a-5f76-4945-bc03-80add34dfd0a None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:10:40.166863 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc0bf4a-5f76-4945-bc03-80add34dfd0a None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:10:40.201775 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20099bb6-4eda-4b66-b186-6c6bd9af7207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:10:40.202455 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20099bb6-4eda-4b66-b186-6c6bd9af7207 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:10:40.202746 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20099bb6-4eda-4b66-b186-6c6bd9af7207 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:10:40.203028 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20099bb6-4eda-4b66-b186-6c6bd9af7207 None admin] PATH_INFO: `/v3/users` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:10:40.203876 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20099bb6-4eda-4b66-b186-6c6bd9af7207 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:10:40.204242 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20099bb6-4eda-4b66-b186-6c6bd9af7207 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:10:40.205752 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20099bb6-4eda-4b66-b186-6c6bd9af7207 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:10:40.214851 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:10:40.223251 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 637/1268] 10.222.0.39 () {56 vars in 1143 bytes} [Thu Jun 16 17:10:40 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:10:40.228955 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdf75b1-4868-4344-8bc1-4c9a308a4002 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:10:40.327929 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdf75b1-4868-4344-8bc1-4c9a308a4002 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:10:40.362455 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a2a233-52c5-4552-960a-2ca1d236da2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:10:40.363241 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a2a233-52c5-4552-960a-2ca1d236da2a None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:10:40.363521 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a2a233-52c5-4552-960a-2ca1d236da2a None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:10:40.363804 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a2a233-52c5-4552-960a-2ca1d236da2a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:10:40.374427 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a2a233-52c5-4552-960a-2ca1d236da2a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:10:40.376214 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a2a233-52c5-4552-960a-2ca1d236da2a None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:10:40.394025 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application [None req-30a2a233-52c5-4552-960a-2ca1d236da2a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:10:40.394025 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:10:40.394025 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:10:40.394025 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:10:40.394025 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:10:40.394025 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:10:40.394025 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:10:40.394025 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:10:40.394025 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:10:40.394025 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:10:40.394025 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:10:40.394025 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:10:40.394025 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 17:10:40.394025 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 17:10:40.394025 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 17:10:40.395135 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 17:10:40.395135 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:10:40.395135 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:10:40.395135 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:10:40.395135 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:10:40.395135 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:10:40.395135 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:10:40.395135 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:10:40.395135 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application with Lock( Jun 16 17:10:40.395135 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:10:40.395135 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:10:40.395135 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:10:40.395135 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:10:40.395135 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:10:40.395135 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:10:40.395135 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:10:40.395135 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:10:40.396294 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 17:10:40.396294 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 17:10:40.396294 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:10:40.396294 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Jun 16 17:10:40.396294 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 632/1269] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 17:10:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:10:40.400846 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20099bb6-4eda-4b66-b186-6c6bd9af7207 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:10:40.504857 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20099bb6-4eda-4b66-b186-6c6bd9af7207 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:10:40.538358 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6094ec-5c1d-46e1-9a71-099c82632cc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:10:40.539012 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6094ec-5c1d-46e1-9a71-099c82632cc7 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:10:40.539295 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6094ec-5c1d-46e1-9a71-099c82632cc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:10:40.539569 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6094ec-5c1d-46e1-9a71-099c82632cc7 None admin] PATH_INFO: `/v3/domains` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:10:40.540280 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6094ec-5c1d-46e1-9a71-099c82632cc7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:10:40.540586 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6094ec-5c1d-46e1-9a71-099c82632cc7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:10:40.541958 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6094ec-5c1d-46e1-9a71-099c82632cc7 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:10:40.553547 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 638/1270] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 16 17:10:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:10:40.559260 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a2a233-52c5-4552-960a-2ca1d236da2a None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:10:40.591802 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:10:40.659500 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a2a233-52c5-4552-960a-2ca1d236da2a None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:10:40.692072 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f359e117-6760-4e0f-9e76-2a9711feb70d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:10:40.692841 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f359e117-6760-4e0f-9e76-2a9711feb70d None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:10:40.693124 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f359e117-6760-4e0f-9e76-2a9711feb70d None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:10:40.693401 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f359e117-6760-4e0f-9e76-2a9711feb70d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:10:40.699912 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f359e117-6760-4e0f-9e76-2a9711feb70d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:10:40.701405 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f359e117-6760-4e0f-9e76-2a9711feb70d None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:10:40.715481 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application [None req-f359e117-6760-4e0f-9e76-2a9711feb70d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 17:10:40.715481 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:10:40.715481 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:10:40.715481 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:10:40.715481 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:10:40.715481 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:10:40.715481 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:10:40.715481 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:10:40.715481 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:10:40.715481 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:10:40.715481 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:10:40.715481 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:10:40.715481 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 17:10:40.715481 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 17:10:40.715481 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 17:10:40.716664 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 17:10:40.716664 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:10:40.716664 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:10:40.716664 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:10:40.716664 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:10:40.716664 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:10:40.716664 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:10:40.716664 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:10:40.716664 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application with Lock( Jun 16 17:10:40.716664 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:10:40.716664 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:10:40.716664 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:10:40.716664 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:10:40.716664 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:10:40.716664 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:10:40.716664 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:10:40.716664 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:10:40.717664 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 17:10:40.717664 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 17:10:40.717664 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 17:10:40.717664 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 17:10:40.717664 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 17:10:40.717664 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 17:10:40.717664 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 17:10:40.717664 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Jun 16 17:10:40.717664 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 633/1271] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 16 17:10:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:10:40.723379 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6094ec-5c1d-46e1-9a71-099c82632cc7 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:10:40.781922 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:10:40.825690 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6094ec-5c1d-46e1-9a71-099c82632cc7 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:10:40.862045 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5b253a-b4d8-47ce-826a-58aba32ff422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:10:40.862706 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5b253a-b4d8-47ce-826a-58aba32ff422 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:10:40.862996 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5b253a-b4d8-47ce-826a-58aba32ff422 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:10:40.863274 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5b253a-b4d8-47ce-826a-58aba32ff422 None admin] PATH_INFO: `/v3/projects` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:10:40.864060 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5b253a-b4d8-47ce-826a-58aba32ff422 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:10:40.864374 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5b253a-b4d8-47ce-826a-58aba32ff422 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:10:40.865818 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5b253a-b4d8-47ce-826a-58aba32ff422 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:10:40.877668 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 639/1272] 10.222.0.39 () {56 vars in 1148 bytes} [Thu Jun 16 17:10:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:10:40.883868 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f359e117-6760-4e0f-9e76-2a9711feb70d None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:10:40.978713 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:10:40.987371 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f359e117-6760-4e0f-9e76-2a9711feb70d None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:10:41.020957 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf00c0d-1cb9-4713-8d68-2d68452218fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:10:41.021868 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf00c0d-1cb9-4713-8d68-2d68452218fa None admin] REQUEST_METHOD: `PUT` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:10:41.022155 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf00c0d-1cb9-4713-8d68-2d68452218fa None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:10:41.022445 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf00c0d-1cb9-4713-8d68-2d68452218fa None admin] PATH_INFO: `/v3/projects/73015da4de1f48c29f57fff1040d2c10/users/2882f26811094d8e88c03701c94296fc/roles/dba744f8ab2a4c45b9d3212f8d203aba` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:10:41.024412 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf00c0d-1cb9-4713-8d68-2d68452218fa None admin] RBAC: Authorizing `identity:create_grant(project_id=73015da4de1f48c29f57fff1040d2c10, user_id=2882f26811094d8e88c03701c94296fc, role_id=dba744f8ab2a4c45b9d3212f8d203aba)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:10:41.025876 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf00c0d-1cb9-4713-8d68-2d68452218fa None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:10:41.103308 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 634/1273] 10.222.0.39 () {58 vars in 1439 bytes} [Thu Jun 16 17:10:40 2022] PUT /identity/v3/projects/73015da4de1f48c29f57fff1040d2c10/users/2882f26811094d8e88c03701c94296fc/roles/dba744f8ab2a4c45b9d3212f8d203aba => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:10:43.223145 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52823ec3-25b6-4b26-8927-21aa2938c9c5 None None] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:10:43.223648 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52823ec3-25b6-4b26-8927-21aa2938c9c5 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:10:43.223648 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52823ec3-25b6-4b26-8927-21aa2938c9c5 None None] PATH_INFO: `/` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:10:43.225012 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 640/1274] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 17:10:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:10:43.230297 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a857e1c-732d-4fc4-8a94-81b3d1b69686 None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:10:43.230689 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a857e1c-732d-4fc4-8a94-81b3d1b69686 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:10:43.230891 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a857e1c-732d-4fc4-8a94-81b3d1b69686 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:10:43.246991 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-7a857e1c-732d-4fc4-8a94-81b3d1b69686 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:10:43.250180 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-7a857e1c-732d-4fc4-8a94-81b3d1b69686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:10:43.316742 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 635/1275] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 17:10:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 17:10:43.341110 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52823ec3-25b6-4b26-8927-21aa2938c9c5 None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:10:43.444362 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52823ec3-25b6-4b26-8927-21aa2938c9c5 None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:10:43.463891 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:10:43.480354 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a5230b-66c9-4382-8404-637b1306ae11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:10:43.481089 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a5230b-66c9-4382-8404-637b1306ae11 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:10:43.481379 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a5230b-66c9-4382-8404-637b1306ae11 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:10:43.481663 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a5230b-66c9-4382-8404-637b1306ae11 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:10:43.491627 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a5230b-66c9-4382-8404-637b1306ae11 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 17:10:43.499236 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application [None req-48a5230b-66c9-4382-8404-637b1306ae11 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 17:10:43.499236 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:10:43.499236 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:10:43.499236 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:10:43.499236 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:10:43.499236 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:10:43.499236 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:10:43.499236 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:10:43.499236 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:10:43.499236 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:10:43.499236 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:10:43.499236 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:10:43.499236 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 17:10:43.499236 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 17:10:43.499236 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 17:10:43.499236 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 17:10:43.500417 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 17:10:43.500417 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 17:10:43.500417 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 17:10:43.500417 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 17:10:43.500417 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:10:43.500417 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:10:43.500417 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:10:43.500417 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:10:43.500417 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:10:43.500417 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:10:43.500417 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:10:43.500417 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application with Lock( Jun 16 17:10:43.500417 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:10:43.500417 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:10:43.500417 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:10:43.500417 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:10:43.501976 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:10:43.501976 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:10:43.501976 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:10:43.501976 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:10:43.501976 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 17:10:43.501976 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 17:10:43.501976 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 17:10:43.501976 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 17:10:43.501976 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 17:10:43.501976 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 17:10:43.501976 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 17:10:43.501976 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Jun 16 17:10:43.501976 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 641/1276] 10.222.0.39 () {56 vars in 1096 bytes} [Thu Jun 16 17:10:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:10:43.507036 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a857e1c-732d-4fc4-8a94-81b3d1b69686 None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:10:43.587942 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:10:43.605685 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a857e1c-732d-4fc4-8a94-81b3d1b69686 None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:10:43.638708 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1397141e-784e-45a2-a377-56fd01d217fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:10:43.639388 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1397141e-784e-45a2-a377-56fd01d217fe None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:10:43.639675 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1397141e-784e-45a2-a377-56fd01d217fe None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:10:43.639958 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1397141e-784e-45a2-a377-56fd01d217fe None admin] PATH_INFO: `/v3/roles` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:10:43.640700 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1397141e-784e-45a2-a377-56fd01d217fe None admin] RBAC: Adding query filter params (name=admin) {{(pid=80873) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:10:43.641012 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1397141e-784e-45a2-a377-56fd01d217fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:10:43.643020 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1397141e-784e-45a2-a377-56fd01d217fe None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:10:43.651042 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 636/1277] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 16 17:10:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:10:43.657148 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a5230b-66c9-4382-8404-637b1306ae11 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:10:43.756226 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a5230b-66c9-4382-8404-637b1306ae11 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:10:43.789860 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e35adf-5af8-4ce4-9e22-360d85ee4ee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:10:43.790652 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e35adf-5af8-4ce4-9e22-360d85ee4ee2 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:10:43.790941 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e35adf-5af8-4ce4-9e22-360d85ee4ee2 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:10:43.791219 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e35adf-5af8-4ce4-9e22-360d85ee4ee2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:10:43.802156 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e35adf-5af8-4ce4-9e22-360d85ee4ee2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:10:43.803595 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e35adf-5af8-4ce4-9e22-360d85ee4ee2 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:10:43.820909 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application [None req-21e35adf-5af8-4ce4-9e22-360d85ee4ee2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:10:43.820909 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:10:43.820909 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:10:43.820909 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:10:43.820909 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:10:43.820909 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:10:43.820909 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:10:43.820909 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:10:43.820909 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:10:43.820909 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:10:43.820909 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:10:43.820909 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:10:43.820909 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 17:10:43.820909 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 17:10:43.820909 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 17:10:43.822095 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 17:10:43.822095 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:10:43.822095 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:10:43.822095 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:10:43.822095 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:10:43.822095 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:10:43.822095 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:10:43.822095 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:10:43.822095 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application with Lock( Jun 16 17:10:43.822095 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:10:43.822095 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:10:43.822095 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:10:43.822095 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:10:43.822095 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:10:43.822095 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:10:43.822095 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:10:43.822095 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:10:43.823060 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 17:10:43.823060 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 17:10:43.823060 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:10:43.823060 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Jun 16 17:10:43.823060 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 642/1278] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 17:10:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:10:43.827936 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1397141e-784e-45a2-a377-56fd01d217fe None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:10:43.929453 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1397141e-784e-45a2-a377-56fd01d217fe None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:10:43.962433 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0090e795-2b22-4869-aebf-2057473364b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:10:43.963353 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0090e795-2b22-4869-aebf-2057473364b5 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:10:43.963638 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0090e795-2b22-4869-aebf-2057473364b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:10:43.963919 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0090e795-2b22-4869-aebf-2057473364b5 None admin] PATH_INFO: `/v3/domains` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:10:43.964638 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0090e795-2b22-4869-aebf-2057473364b5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80873) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:10:43.964947 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0090e795-2b22-4869-aebf-2057473364b5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:10:43.966398 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0090e795-2b22-4869-aebf-2057473364b5 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:10:43.977994 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 637/1279] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 16 17:10:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:10:43.983958 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e35adf-5af8-4ce4-9e22-360d85ee4ee2 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:10:44.015186 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:10:44.082076 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e35adf-5af8-4ce4-9e22-360d85ee4ee2 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:10:44.115085 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec65f5f-b1ec-48b5-ad38-f12200aed6ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:10:44.115882 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec65f5f-b1ec-48b5-ad38-f12200aed6ba None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:10:44.116163 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec65f5f-b1ec-48b5-ad38-f12200aed6ba None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:10:44.116441 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec65f5f-b1ec-48b5-ad38-f12200aed6ba None admin] PATH_INFO: `/v3/users/placement` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:10:44.123804 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec65f5f-b1ec-48b5-ad38-f12200aed6ba None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:10:44.128841 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec65f5f-b1ec-48b5-ad38-f12200aed6ba None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:10:44.140000 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application [None req-4ec65f5f-b1ec-48b5-ad38-f12200aed6ba None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 16 17:10:44.140000 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:10:44.140000 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:10:44.140000 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:10:44.140000 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:10:44.140000 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:10:44.140000 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:10:44.140000 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:10:44.140000 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:10:44.140000 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:10:44.140000 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:10:44.140000 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:10:44.140000 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 17:10:44.140000 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 17:10:44.140000 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 17:10:44.140000 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 17:10:44.141154 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:10:44.141154 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:10:44.141154 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 17:10:44.141154 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 17:10:44.141154 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 17:10:44.141154 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 17:10:44.141154 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:10:44.141154 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:10:44.141154 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:10:44.141154 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:10:44.141154 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:10:44.141154 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application with Lock( Jun 16 17:10:44.141154 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:10:44.141154 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:10:44.141154 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:10:44.141154 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:10:44.141154 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:10:44.141154 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:10:44.142423 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:10:44.142423 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:10:44.142423 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 17:10:44.142423 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 17:10:44.142423 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 17:10:44.142423 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 17:10:44.142423 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 17:10:44.142423 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 17:10:44.142423 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 16 17:10:44.142423 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Jun 16 17:10:44.142423 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 643/1280] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 17:10:43 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 17:10:44.149248 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0090e795-2b22-4869-aebf-2057473364b5 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:10:44.153085 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:10:44.250749 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0090e795-2b22-4869-aebf-2057473364b5 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:10:44.285298 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74aef7d-1fc1-4b92-addc-2206694fa723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:10:44.285934 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74aef7d-1fc1-4b92-addc-2206694fa723 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:10:44.286221 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74aef7d-1fc1-4b92-addc-2206694fa723 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:10:44.286497 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74aef7d-1fc1-4b92-addc-2206694fa723 None admin] PATH_INFO: `/v3/users` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:10:44.287332 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74aef7d-1fc1-4b92-addc-2206694fa723 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80873) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:10:44.287643 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74aef7d-1fc1-4b92-addc-2206694fa723 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:10:44.289062 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74aef7d-1fc1-4b92-addc-2206694fa723 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:10:44.309148 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 638/1281] 10.222.0.39 () {56 vars in 1143 bytes} [Thu Jun 16 17:10:44 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:10:44.314983 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec65f5f-b1ec-48b5-ad38-f12200aed6ba None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:10:44.412122 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:10:44.421473 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec65f5f-b1ec-48b5-ad38-f12200aed6ba None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:10:44.454941 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546b9d3c-6ee9-4944-bc69-ab18d4fa9f60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:10:44.455840 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546b9d3c-6ee9-4944-bc69-ab18d4fa9f60 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:10:44.456329 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546b9d3c-6ee9-4944-bc69-ab18d4fa9f60 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:10:44.456962 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546b9d3c-6ee9-4944-bc69-ab18d4fa9f60 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:10:44.525946 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546b9d3c-6ee9-4944-bc69-ab18d4fa9f60 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:10:44.527397 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546b9d3c-6ee9-4944-bc69-ab18d4fa9f60 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:10:44.615882 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:10:44.626429 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 644/1282] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 16 17:10:44 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 17:10:44.632764 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74aef7d-1fc1-4b92-addc-2206694fa723 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:10:44.698951 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:10:44.736732 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74aef7d-1fc1-4b92-addc-2206694fa723 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:10:44.771158 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778a83fe-8e4b-4aab-bf4a-6c2972b5c27f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:10:44.771946 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778a83fe-8e4b-4aab-bf4a-6c2972b5c27f None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:10:44.772228 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778a83fe-8e4b-4aab-bf4a-6c2972b5c27f None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:10:44.772506 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778a83fe-8e4b-4aab-bf4a-6c2972b5c27f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:10:44.782345 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778a83fe-8e4b-4aab-bf4a-6c2972b5c27f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:10:44.784379 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778a83fe-8e4b-4aab-bf4a-6c2972b5c27f None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:10:44.801302 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application [None req-778a83fe-8e4b-4aab-bf4a-6c2972b5c27f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:10:44.801302 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:10:44.801302 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:10:44.801302 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:10:44.801302 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:10:44.801302 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:10:44.801302 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:10:44.801302 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:10:44.801302 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:10:44.801302 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:10:44.801302 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:10:44.801302 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:10:44.801302 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 17:10:44.801302 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 17:10:44.801302 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 17:10:44.802468 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 17:10:44.802468 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:10:44.802468 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:10:44.802468 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:10:44.802468 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:10:44.802468 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:10:44.802468 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:10:44.802468 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:10:44.802468 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application with Lock( Jun 16 17:10:44.802468 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:10:44.802468 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:10:44.802468 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:10:44.802468 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:10:44.802468 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:10:44.802468 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:10:44.802468 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:10:44.802468 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:10:44.803511 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 17:10:44.803511 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 17:10:44.803511 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:10:44.803511 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Jun 16 17:10:44.803511 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 639/1283] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 17:10:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 17:10:44.808457 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546b9d3c-6ee9-4944-bc69-ab18d4fa9f60 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:10:44.920671 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546b9d3c-6ee9-4944-bc69-ab18d4fa9f60 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:10:44.960642 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2deeeb3-b66b-447c-b2df-fb9b564362a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:10:44.961335 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2deeeb3-b66b-447c-b2df-fb9b564362a8 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:10:44.961627 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2deeeb3-b66b-447c-b2df-fb9b564362a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:10:44.961942 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2deeeb3-b66b-447c-b2df-fb9b564362a8 None admin] PATH_INFO: `/v3/domains` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:10:44.962695 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2deeeb3-b66b-447c-b2df-fb9b564362a8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:10:44.963290 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2deeeb3-b66b-447c-b2df-fb9b564362a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:10:44.964782 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2deeeb3-b66b-447c-b2df-fb9b564362a8 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:10:44.982714 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 645/1284] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 16 17:10:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:10:44.989481 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778a83fe-8e4b-4aab-bf4a-6c2972b5c27f None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:10:45.104976 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778a83fe-8e4b-4aab-bf4a-6c2972b5c27f None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:10:45.121588 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:10:45.143851 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5265ee03-d0cd-43ab-861d-3a64392e008a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:10:45.144576 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5265ee03-d0cd-43ab-861d-3a64392e008a None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:10:45.144866 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5265ee03-d0cd-43ab-861d-3a64392e008a None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:10:45.145149 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5265ee03-d0cd-43ab-861d-3a64392e008a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:10:45.152614 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5265ee03-d0cd-43ab-861d-3a64392e008a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:10:45.154137 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5265ee03-d0cd-43ab-861d-3a64392e008a None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:10:45.169864 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application [None req-5265ee03-d0cd-43ab-861d-3a64392e008a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 17:10:45.169864 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:10:45.169864 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:10:45.169864 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:10:45.169864 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:10:45.169864 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:10:45.169864 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:10:45.169864 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:10:45.169864 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:10:45.169864 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:10:45.169864 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:10:45.169864 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:10:45.169864 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 17:10:45.169864 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 17:10:45.169864 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 17:10:45.171200 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 17:10:45.171200 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:10:45.171200 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:10:45.171200 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:10:45.171200 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:10:45.171200 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:10:45.171200 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:10:45.171200 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:10:45.171200 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application with Lock( Jun 16 17:10:45.171200 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:10:45.171200 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:10:45.171200 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:10:45.171200 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:10:45.171200 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:10:45.171200 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:10:45.171200 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:10:45.171200 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:10:45.172272 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 17:10:45.172272 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 17:10:45.172272 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 17:10:45.172272 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 17:10:45.172272 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 17:10:45.172272 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 17:10:45.172272 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 17:10:45.172272 dv-cinder-837356-2-smb devstack@keystone.service[80873]: ERROR keystone.server.flask.application Jun 16 17:10:45.172272 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 640/1285] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 16 17:10:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:10:45.177340 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2deeeb3-b66b-447c-b2df-fb9b564362a8 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:10:45.238722 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:10:45.291060 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2deeeb3-b66b-447c-b2df-fb9b564362a8 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:10:45.327370 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72640fe4-d22e-4b38-8ef4-0da8f25f9fbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:10:45.328033 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72640fe4-d22e-4b38-8ef4-0da8f25f9fbf None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:10:45.328318 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72640fe4-d22e-4b38-8ef4-0da8f25f9fbf None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:10:45.328594 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72640fe4-d22e-4b38-8ef4-0da8f25f9fbf None admin] PATH_INFO: `/v3/projects` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:10:45.329457 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72640fe4-d22e-4b38-8ef4-0da8f25f9fbf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:10:45.329697 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72640fe4-d22e-4b38-8ef4-0da8f25f9fbf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:10:45.331152 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72640fe4-d22e-4b38-8ef4-0da8f25f9fbf None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:10:45.344816 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 646/1286] 10.222.0.39 () {56 vars in 1148 bytes} [Thu Jun 16 17:10:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:10:45.351865 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5265ee03-d0cd-43ab-861d-3a64392e008a None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:10:45.460138 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5265ee03-d0cd-43ab-861d-3a64392e008a None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:10:45.494052 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7fcb2c-a08e-4fae-b38c-83005c83a957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:10:45.494690 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7fcb2c-a08e-4fae-b38c-83005c83a957 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:10:45.494981 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7fcb2c-a08e-4fae-b38c-83005c83a957 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:10:45.495266 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7fcb2c-a08e-4fae-b38c-83005c83a957 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:10:45.496126 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7fcb2c-a08e-4fae-b38c-83005c83a957 None admin] RBAC: Adding query filter params (role.id=dba744f8ab2a4c45b9d3212f8d203aba, scope.project.id=73015da4de1f48c29f57fff1040d2c10, user.id=2882f26811094d8e88c03701c94296fc) {{(pid=80873) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:10:45.496443 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7fcb2c-a08e-4fae-b38c-83005c83a957 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:10:45.497887 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7fcb2c-a08e-4fae-b38c-83005c83a957 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:10:45.504911 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 641/1287] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jun 16 17:10:45 2022] GET /identity/v3/role_assignments?user.id=2882f26811094d8e88c03701c94296fc&scope.project.id=73015da4de1f48c29f57fff1040d2c10&role.id=dba744f8ab2a4c45b9d3212f8d203aba => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:10:47.647068 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baeb905-faf0-4162-b8e9-7739b98c52fa None None] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:10:47.647743 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baeb905-faf0-4162-b8e9-7739b98c52fa None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:10:47.647743 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baeb905-faf0-4162-b8e9-7739b98c52fa None None] PATH_INFO: `/` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:10:47.649070 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 647/1288] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 17:10:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:10:47.654357 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4666d1fa-8a88-4283-a2d6-d8c975f0d9dd None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:10:47.660333 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4666d1fa-8a88-4283-a2d6-d8c975f0d9dd None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:10:47.660333 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4666d1fa-8a88-4283-a2d6-d8c975f0d9dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:10:47.672397 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-4666d1fa-8a88-4283-a2d6-d8c975f0d9dd None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:10:47.673596 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-4666d1fa-8a88-4283-a2d6-d8c975f0d9dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:10:47.702593 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:10:47.740704 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 642/1289] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 17:10:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 17:10:47.762709 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baeb905-faf0-4162-b8e9-7739b98c52fa None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:10:47.862953 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baeb905-faf0-4162-b8e9-7739b98c52fa None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:10:47.874030 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:10:47.897638 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc72752-67b7-40e9-be42-d72dbeeeb5a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:10:47.898418 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc72752-67b7-40e9-be42-d72dbeeeb5a5 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:10:47.898703 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc72752-67b7-40e9-be42-d72dbeeeb5a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:10:47.898981 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc72752-67b7-40e9-be42-d72dbeeeb5a5 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:10:47.899628 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc72752-67b7-40e9-be42-d72dbeeeb5a5 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:10:47.900973 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc72752-67b7-40e9-be42-d72dbeeeb5a5 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:10:47.912463 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application [None req-4fc72752-67b7-40e9-be42-d72dbeeeb5a5 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 16 17:10:47.912463 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:10:47.912463 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 17:10:47.912463 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 17:10:47.912463 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 17:10:47.912463 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 17:10:47.912463 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 17:10:47.912463 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 17:10:47.912463 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 16 17:10:47.912463 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Jun 16 17:10:47.912463 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 17:10:47.912463 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Jun 16 17:10:47.912463 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:10:47.912463 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:10:47.912463 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:10:47.912463 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:10:47.912463 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:10:47.913813 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:10:47.913813 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:10:47.913813 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:10:47.913813 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:10:47.913813 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:10:47.913813 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:10:47.913813 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 17:10:47.913813 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 17:10:47.913813 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 17:10:47.913813 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 17:10:47.913813 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:10:47.913813 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:10:47.913813 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:10:47.913813 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:10:47.913813 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:10:47.913813 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:10:47.914967 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:10:47.914967 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application with Lock( Jun 16 17:10:47.914967 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:10:47.914967 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:10:47.914967 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:10:47.914967 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:10:47.914967 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:10:47.914967 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:10:47.914967 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:10:47.914967 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:10:47.914967 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 17:10:47.914967 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 17:10:47.914967 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 16 17:10:47.914967 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Jun 16 17:10:47.914967 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 648/1290] 10.222.0.39 () {56 vars in 1117 bytes} [Thu Jun 16 17:10:47 2022] GET /identity/v3/services/placement => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:10:47.919781 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4666d1fa-8a88-4283-a2d6-d8c975f0d9dd None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:10:48.018733 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4666d1fa-8a88-4283-a2d6-d8c975f0d9dd None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:10:48.052208 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8134f72-c05d-44e1-8801-7ffb235c101d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:10:48.052871 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8134f72-c05d-44e1-8801-7ffb235c101d None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:10:48.053154 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8134f72-c05d-44e1-8801-7ffb235c101d None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:10:48.053431 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8134f72-c05d-44e1-8801-7ffb235c101d None admin] PATH_INFO: `/v3/services` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:10:48.054164 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8134f72-c05d-44e1-8801-7ffb235c101d None admin] RBAC: Adding query filter params (name=placement) {{(pid=80873) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:10:48.054470 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8134f72-c05d-44e1-8801-7ffb235c101d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:10:48.055815 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8134f72-c05d-44e1-8801-7ffb235c101d None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:10:48.060762 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 643/1291] 10.222.0.39 () {56 vars in 1116 bytes} [Thu Jun 16 17:10:47 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:10:48.067216 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc72752-67b7-40e9-be42-d72dbeeeb5a5 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:10:48.167002 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc72752-67b7-40e9-be42-d72dbeeeb5a5 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:10:48.200094 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ce21c7-e02f-4263-9165-9a04002ff5a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:10:48.200751 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ce21c7-e02f-4263-9165-9a04002ff5a6 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:10:48.201043 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ce21c7-e02f-4263-9165-9a04002ff5a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:10:48.201332 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ce21c7-e02f-4263-9165-9a04002ff5a6 None admin] PATH_INFO: `/v3/services` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:10:48.202069 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ce21c7-e02f-4263-9165-9a04002ff5a6 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:10:48.202382 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ce21c7-e02f-4263-9165-9a04002ff5a6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:10:48.203750 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ce21c7-e02f-4263-9165-9a04002ff5a6 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:10:48.208773 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 649/1292] 10.222.0.39 () {56 vars in 1116 bytes} [Thu Jun 16 17:10:48 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:10:50.326387 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e11232-4a3b-4b8e-a953-fc85e470be89 None None] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:10:50.326924 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e11232-4a3b-4b8e-a953-fc85e470be89 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:10:50.326924 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e11232-4a3b-4b8e-a953-fc85e470be89 None None] PATH_INFO: `/` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:10:50.328247 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 644/1293] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 17:10:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:10:50.334297 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d336f0-8153-4ff1-af62-270c9e35dfeb None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:10:50.334735 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d336f0-8153-4ff1-af62-270c9e35dfeb None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:10:50.334847 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d336f0-8153-4ff1-af62-270c9e35dfeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:10:50.351514 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-84d336f0-8153-4ff1-af62-270c9e35dfeb None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:10:50.352704 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-84d336f0-8153-4ff1-af62-270c9e35dfeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:10:50.382576 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:10:50.419431 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 650/1294] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 17:10:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 17:10:50.442617 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e11232-4a3b-4b8e-a953-fc85e470be89 None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:10:50.473942 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:10:50.540459 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e11232-4a3b-4b8e-a953-fc85e470be89 None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:10:50.574102 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c2a513-d852-4892-af0b-140a60220636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:10:50.574754 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c2a513-d852-4892-af0b-140a60220636 None admin] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:10:50.575038 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c2a513-d852-4892-af0b-140a60220636 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:10:50.575330 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c2a513-d852-4892-af0b-140a60220636 None admin] PATH_INFO: `/v3/services` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:10:50.576034 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c2a513-d852-4892-af0b-140a60220636 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:10:50.577432 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c2a513-d852-4892-af0b-140a60220636 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:10:50.638164 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 645/1295] 10.222.0.39 () {60 vars in 1141 bytes} [Thu Jun 16 17:10:50 2022] POST /identity/v3/services => generated 246 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:10:52.744991 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5063fd-d37d-417e-ac51-58c55e076730 None None] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:10:52.745553 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5063fd-d37d-417e-ac51-58c55e076730 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:10:52.745658 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5063fd-d37d-417e-ac51-58c55e076730 None None] PATH_INFO: `/` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:10:52.747091 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 651/1296] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 17:10:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:10:52.752459 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605e4182-1d57-438f-bf4e-c324f1974728 None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:10:52.752876 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605e4182-1d57-438f-bf4e-c324f1974728 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:10:52.753028 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605e4182-1d57-438f-bf4e-c324f1974728 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:10:52.769803 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-605e4182-1d57-438f-bf4e-c324f1974728 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:10:52.770967 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-605e4182-1d57-438f-bf4e-c324f1974728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:10:52.851317 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 646/1297] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 17:10:52 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 17:10:52.873866 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5063fd-d37d-417e-ac51-58c55e076730 None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:10:52.979498 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5063fd-d37d-417e-ac51-58c55e076730 None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:10:53.012964 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f512027f-7e11-4dce-8f63-a38e434a3186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:10:53.013689 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f512027f-7e11-4dce-8f63-a38e434a3186 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:10:53.014009 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f512027f-7e11-4dce-8f63-a38e434a3186 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:10:53.014313 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f512027f-7e11-4dce-8f63-a38e434a3186 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:10:53.014964 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f512027f-7e11-4dce-8f63-a38e434a3186 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:10:53.016939 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f512027f-7e11-4dce-8f63-a38e434a3186 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:10:53.028715 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application [None req-f512027f-7e11-4dce-8f63-a38e434a3186 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 16 17:10:53.028715 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:10:53.028715 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 17:10:53.028715 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 17:10:53.028715 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 17:10:53.028715 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 17:10:53.028715 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 17:10:53.028715 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 17:10:53.028715 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 16 17:10:53.028715 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Jun 16 17:10:53.028715 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 17:10:53.028715 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Jun 16 17:10:53.028715 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:10:53.028715 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:10:53.028715 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:10:53.028715 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:10:53.028715 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:10:53.029959 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:10:53.029959 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:10:53.029959 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:10:53.029959 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:10:53.029959 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:10:53.029959 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:10:53.029959 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 17:10:53.029959 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 17:10:53.029959 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 17:10:53.029959 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 17:10:53.029959 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:10:53.029959 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:10:53.029959 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:10:53.029959 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:10:53.029959 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:10:53.029959 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:10:53.031218 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:10:53.031218 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application with Lock( Jun 16 17:10:53.031218 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:10:53.031218 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:10:53.031218 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:10:53.031218 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:10:53.031218 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:10:53.031218 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:10:53.031218 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:10:53.031218 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:10:53.031218 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 17:10:53.031218 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 17:10:53.031218 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 16 17:10:53.031218 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Jun 16 17:10:53.031218 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 652/1298] 10.222.0.39 () {56 vars in 1117 bytes} [Thu Jun 16 17:10:52 2022] GET /identity/v3/services/placement => generated 90 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:10:53.036734 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605e4182-1d57-438f-bf4e-c324f1974728 None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:10:53.054789 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:10:53.143298 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605e4182-1d57-438f-bf4e-c324f1974728 None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:10:53.177253 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a5391b-654d-4dc2-b292-8fe3c633ee07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:10:53.177941 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a5391b-654d-4dc2-b292-8fe3c633ee07 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:10:53.178228 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a5391b-654d-4dc2-b292-8fe3c633ee07 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:10:53.178507 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a5391b-654d-4dc2-b292-8fe3c633ee07 None admin] PATH_INFO: `/v3/services` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:10:53.179211 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a5391b-654d-4dc2-b292-8fe3c633ee07 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80873) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:10:53.179521 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a5391b-654d-4dc2-b292-8fe3c633ee07 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:10:53.180957 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a5391b-654d-4dc2-b292-8fe3c633ee07 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:10:53.186074 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 647/1299] 10.222.0.39 () {56 vars in 1116 bytes} [Thu Jun 16 17:10:53 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:10:53.192533 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f512027f-7e11-4dce-8f63-a38e434a3186 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:10:53.225523 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:10:53.293241 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f512027f-7e11-4dce-8f63-a38e434a3186 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:10:53.326751 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab5c7b0-ffe2-4d48-9f6f-8493bbdd58d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:10:53.327407 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab5c7b0-ffe2-4d48-9f6f-8493bbdd58d5 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:10:53.327695 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab5c7b0-ffe2-4d48-9f6f-8493bbdd58d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:10:53.327975 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab5c7b0-ffe2-4d48-9f6f-8493bbdd58d5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:10:53.328765 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab5c7b0-ffe2-4d48-9f6f-8493bbdd58d5 None admin] RBAC: Adding query filter params (interface=public, service_id=0ff4247ca15047069d0a82f1d2b2ad80, region_id=RegionOne) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:10:53.329728 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab5c7b0-ffe2-4d48-9f6f-8493bbdd58d5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:10:53.331129 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab5c7b0-ffe2-4d48-9f6f-8493bbdd58d5 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:10:53.336225 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 653/1300] 10.222.0.39 () {56 vars in 1251 bytes} [Thu Jun 16 17:10:53 2022] GET /identity/v3/endpoints?service_id=0ff4247ca15047069d0a82f1d2b2ad80&interface=public®ion_id=RegionOne => generated 194 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:10:53.342332 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a5391b-654d-4dc2-b292-8fe3c633ee07 None admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:10:53.422820 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:10:53.442400 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a5391b-654d-4dc2-b292-8fe3c633ee07 None admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:10:53.481268 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7225fc8b-7432-476f-bb9d-faa2eea6da07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:10:53.481968 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7225fc8b-7432-476f-bb9d-faa2eea6da07 None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:10:53.482295 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7225fc8b-7432-476f-bb9d-faa2eea6da07 None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:10:53.482576 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7225fc8b-7432-476f-bb9d-faa2eea6da07 None admin] PATH_INFO: `/v3/services` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:10:53.483255 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7225fc8b-7432-476f-bb9d-faa2eea6da07 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:10:53.484737 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7225fc8b-7432-476f-bb9d-faa2eea6da07 None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:10:53.491768 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 648/1301] 10.222.0.39 () {56 vars in 1087 bytes} [Thu Jun 16 17:10:53 2022] GET /identity/v3/services => generated 2191 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:10:55.630593 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089c65e8-8f03-4fb7-bf1a-dad3918750d8 None None] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:10:55.631174 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089c65e8-8f03-4fb7-bf1a-dad3918750d8 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:10:55.631174 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089c65e8-8f03-4fb7-bf1a-dad3918750d8 None None] PATH_INFO: `/` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:10:55.632523 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 654/1302] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 17:10:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:10:55.637738 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645a046f-7300-4012-90a4-b5feb07db740 None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:10:55.638273 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645a046f-7300-4012-90a4-b5feb07db740 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:10:55.638378 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645a046f-7300-4012-90a4-b5feb07db740 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:10:55.655473 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-645a046f-7300-4012-90a4-b5feb07db740 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:10:55.656656 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-645a046f-7300-4012-90a4-b5feb07db740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:10:55.723499 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 649/1303] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 17:10:55 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 17:10:55.746846 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089c65e8-8f03-4fb7-bf1a-dad3918750d8 None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:10:55.841376 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:10:55.847994 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089c65e8-8f03-4fb7-bf1a-dad3918750d8 None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:10:55.882899 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6bf6e7-a171-4bbb-b0d9-c3b342d58ba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:10:55.883628 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6bf6e7-a171-4bbb-b0d9-c3b342d58ba9 None admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:10:55.883918 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6bf6e7-a171-4bbb-b0d9-c3b342d58ba9 None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:10:55.884201 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6bf6e7-a171-4bbb-b0d9-c3b342d58ba9 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:10:55.884855 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6bf6e7-a171-4bbb-b0d9-c3b342d58ba9 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:10:55.886265 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6bf6e7-a171-4bbb-b0d9-c3b342d58ba9 None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:10:55.899161 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application [None req-1c6bf6e7-a171-4bbb-b0d9-c3b342d58ba9 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 16 17:10:55.899161 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:10:55.899161 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 17:10:55.899161 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 17:10:55.899161 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 17:10:55.899161 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 17:10:55.899161 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 17:10:55.899161 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 17:10:55.899161 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 16 17:10:55.899161 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Jun 16 17:10:55.899161 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 17:10:55.899161 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Jun 16 17:10:55.899161 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:10:55.899161 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:10:55.899161 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:10:55.899161 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:10:55.899161 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:10:55.900220 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:10:55.900220 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:10:55.900220 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:10:55.900220 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:10:55.900220 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:10:55.900220 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:10:55.900220 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 17:10:55.900220 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 17:10:55.900220 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 17:10:55.900220 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 17:10:55.900220 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:10:55.900220 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:10:55.900220 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:10:55.900220 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:10:55.900220 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:10:55.900220 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:10:55.901183 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:10:55.901183 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application with Lock( Jun 16 17:10:55.901183 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:10:55.901183 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:10:55.901183 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:10:55.901183 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:10:55.901183 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:10:55.901183 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:10:55.901183 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:10:55.901183 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:10:55.901183 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 17:10:55.901183 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 17:10:55.901183 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 16 17:10:55.901183 dv-cinder-837356-2-smb devstack@keystone.service[80874]: ERROR keystone.server.flask.application Jun 16 17:10:55.901183 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 655/1304] 10.222.0.39 () {56 vars in 1117 bytes} [Thu Jun 16 17:10:55 2022] GET /identity/v3/services/placement => generated 90 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:10:55.906561 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645a046f-7300-4012-90a4-b5feb07db740 None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:10:55.989952 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:10:56.015464 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645a046f-7300-4012-90a4-b5feb07db740 None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:10:56.048923 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f2425f-57d5-47fb-9653-2f2820cd268e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:10:56.051766 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f2425f-57d5-47fb-9653-2f2820cd268e None admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:10:56.051766 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f2425f-57d5-47fb-9653-2f2820cd268e None admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:10:56.051766 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f2425f-57d5-47fb-9653-2f2820cd268e None admin] PATH_INFO: `/v3/services` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:10:56.051766 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f2425f-57d5-47fb-9653-2f2820cd268e None admin] RBAC: Adding query filter params (name=placement) {{(pid=80873) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:10:56.051766 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f2425f-57d5-47fb-9653-2f2820cd268e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:10:56.052603 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f2425f-57d5-47fb-9653-2f2820cd268e None admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:10:56.057811 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 650/1305] 10.222.0.39 () {56 vars in 1116 bytes} [Thu Jun 16 17:10:55 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:10:56.064074 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6bf6e7-a171-4bbb-b0d9-c3b342d58ba9 None admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:10:56.161745 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6bf6e7-a171-4bbb-b0d9-c3b342d58ba9 None admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:10:56.194801 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c8b0ce-6cb6-4d16-accb-e0938200fc2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:10:56.195452 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c8b0ce-6cb6-4d16-accb-e0938200fc2f None admin] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:10:56.195740 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c8b0ce-6cb6-4d16-accb-e0938200fc2f None admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:10:56.196021 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c8b0ce-6cb6-4d16-accb-e0938200fc2f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:10:56.196788 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c8b0ce-6cb6-4d16-accb-e0938200fc2f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:10:56.198190 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c8b0ce-6cb6-4d16-accb-e0938200fc2f None admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:10:56.284561 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 656/1306] 10.222.0.39 () {60 vars in 1144 bytes} [Thu Jun 16 17:10:56 2022] POST /identity/v3/endpoints => generated 331 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:11:06.054700 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=30 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:11:06.279397 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:46.581289 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2adff0-5a16-484a-8bae-7c247644a56e None None] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:46.581886 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2adff0-5a16-484a-8bae-7c247644a56e None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:46.581993 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2adff0-5a16-484a-8bae-7c247644a56e None None] PATH_INFO: `/` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:46.589338 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244b7750-e8c7-4c20-b3c6-f883e919acdb None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:46.590021 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244b7750-e8c7-4c20-b3c6-f883e919acdb None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:46.590021 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244b7750-e8c7-4c20-b3c6-f883e919acdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:46.592971 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 651/1307] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 17:16:46 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:16:46.689822 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-244b7750-e8c7-4c20-b3c6-f883e919acdb None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:16:46.691103 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-244b7750-e8c7-4c20-b3c6-f883e919acdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:16:46.807329 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 657/1308] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 17:16:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 17:16:46.869936 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b292cc-0439-48b1-b145-073decd416b5 None None] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:46.870235 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b292cc-0439-48b1-b145-073decd416b5 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:46.870521 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b292cc-0439-48b1-b145-073decd416b5 None None] PATH_INFO: `/` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:46.872398 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 652/1309] 10.222.0.39 () {54 vars in 964 bytes} [Thu Jun 16 17:16:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:16:46.878182 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7387fa5f-45f3-413a-a3c3-e1d088a7a126 None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:46.878529 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7387fa5f-45f3-413a-a3c3-e1d088a7a126 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:46.878678 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7387fa5f-45f3-413a-a3c3-e1d088a7a126 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:46.981705 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-7387fa5f-45f3-413a-a3c3-e1d088a7a126 None None] MFA Rules not processed for user `b5d25bfa8dc042329d57cd55fa7b7b23`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:16:46.981705 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-7387fa5f-45f3-413a-a3c3-e1d088a7a126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:16:47.005209 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:47.077994 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 658/1310] 10.222.0.39 () {58 vars in 1061 bytes} [Thu Jun 16 17:16:46 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:16:47.087371 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b292cc-0439-48b1-b145-073decd416b5 None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:47.089205 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-50b292cc-0439-48b1-b145-073decd416b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:16:47.205500 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b292cc-0439-48b1-b145-073decd416b5 None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:47.285552 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45259835-44aa-46d5-a7e5-af1fbf19505e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5d25bfa8dc042329d57cd55fa7b7b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:47.286986 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45259835-44aa-46d5-a7e5-af1fbf19505e service neutron] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:47.286986 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45259835-44aa-46d5-a7e5-af1fbf19505e service neutron] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:47.286986 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45259835-44aa-46d5-a7e5-af1fbf19505e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:47.288498 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-45259835-44aa-46d5-a7e5-af1fbf19505e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:16:47.352429 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:47.416899 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45259835-44aa-46d5-a7e5-af1fbf19505e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:47.418382 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45259835-44aa-46d5-a7e5-af1fbf19505e service neutron] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:47.444561 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 653/1311] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:16:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:16:49.907213 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8730b1-d604-4cbe-b77c-fdc04a9d9356 None None] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:49.907745 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8730b1-d604-4cbe-b77c-fdc04a9d9356 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:49.907745 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8730b1-d604-4cbe-b77c-fdc04a9d9356 None None] PATH_INFO: `/` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:49.909300 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 659/1312] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 17:16:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:16:49.914803 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23325a90-2237-428c-8ca2-8b4793ff938e None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:49.915232 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23325a90-2237-428c-8ca2-8b4793ff938e None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:49.915409 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23325a90-2237-428c-8ca2-8b4793ff938e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:49.992072 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-23325a90-2237-428c-8ca2-8b4793ff938e None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:16:49.993804 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-23325a90-2237-428c-8ca2-8b4793ff938e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:16:50.119944 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 654/1313] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 17:16:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:16:50.159323 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8730b1-d604-4cbe-b77c-fdc04a9d9356 None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:50.161503 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-da8730b1-d604-4cbe-b77c-fdc04a9d9356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:16:50.284070 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8730b1-d604-4cbe-b77c-fdc04a9d9356 None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:50.361398 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:50.364117 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb12dfab-e3e1-49d7-9329-8761e853a5e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5d25bfa8dc042329d57cd55fa7b7b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:50.364770 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb12dfab-e3e1-49d7-9329-8761e853a5e8 service neutron] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:50.365054 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb12dfab-e3e1-49d7-9329-8761e853a5e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:50.365332 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb12dfab-e3e1-49d7-9329-8761e853a5e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:50.367101 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-bb12dfab-e3e1-49d7-9329-8761e853a5e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:16:50.485804 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb12dfab-e3e1-49d7-9329-8761e853a5e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:50.487059 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb12dfab-e3e1-49d7-9329-8761e853a5e8 service neutron] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:50.507069 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 660/1314] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:16:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:16:53.174541 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fd7efd-41f2-4a4b-922c-29e54e994c0d None None] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:53.175055 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fd7efd-41f2-4a4b-922c-29e54e994c0d None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:53.175055 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fd7efd-41f2-4a4b-922c-29e54e994c0d None None] PATH_INFO: `/` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:53.176444 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 655/1315] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 17:16:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:16:53.181417 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c864cc46-6354-4a26-809a-ea0a2b561620 None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:53.181827 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c864cc46-6354-4a26-809a-ea0a2b561620 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:53.182016 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c864cc46-6354-4a26-809a-ea0a2b561620 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:53.245731 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-c864cc46-6354-4a26-809a-ea0a2b561620 None None] MFA Rules not processed for user `ef9bfbcc66f1498383e8c137bc8a81b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:16:53.246967 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-c864cc46-6354-4a26-809a-ea0a2b561620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:16:53.297421 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:53.341944 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 661/1316] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 17:16:53 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:16:53.381591 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fd7efd-41f2-4a4b-922c-29e54e994c0d None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:53.383172 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-62fd7efd-41f2-4a4b-922c-29e54e994c0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:16:53.393031 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:53.490539 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fd7efd-41f2-4a4b-922c-29e54e994c0d None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:53.563114 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a22fec-bf51-4664-a352-e75d6df664b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5d25bfa8dc042329d57cd55fa7b7b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:53.563763 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a22fec-bf51-4664-a352-e75d6df664b5 service neutron] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:53.564056 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a22fec-bf51-4664-a352-e75d6df664b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:53.564334 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a22fec-bf51-4664-a352-e75d6df664b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:53.566031 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-48a22fec-bf51-4664-a352-e75d6df664b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:16:53.627623 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:53.675853 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a22fec-bf51-4664-a352-e75d6df664b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:53.678006 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a22fec-bf51-4664-a352-e75d6df664b5 service neutron] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:53.696066 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 656/1317] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:16:53 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:16:56.647524 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085f5865-089d-4b71-8eb8-6837aa8fc756 None None] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:56.648121 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085f5865-089d-4b71-8eb8-6837aa8fc756 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:56.648121 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085f5865-089d-4b71-8eb8-6837aa8fc756 None None] PATH_INFO: `/` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:56.649468 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 662/1318] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 17:16:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:16:56.654625 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97609457-ea46-4244-9855-b2e838161361 None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:56.655030 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97609457-ea46-4244-9855-b2e838161361 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:56.655197 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97609457-ea46-4244-9855-b2e838161361 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:56.719876 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-97609457-ea46-4244-9855-b2e838161361 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:16:56.721059 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-97609457-ea46-4244-9855-b2e838161361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:16:56.814474 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 657/1319] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 17:16:56 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 17:16:56.856296 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085f5865-089d-4b71-8eb8-6837aa8fc756 None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:56.857968 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-085f5865-089d-4b71-8eb8-6837aa8fc756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:16:56.962101 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085f5865-089d-4b71-8eb8-6837aa8fc756 None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:57.034637 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbf0e76-637d-4cc4-8ed9-5c2bf7c848b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5d25bfa8dc042329d57cd55fa7b7b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:57.035312 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbf0e76-637d-4cc4-8ed9-5c2bf7c848b4 service neutron] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:57.035598 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbf0e76-637d-4cc4-8ed9-5c2bf7c848b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:57.035877 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbf0e76-637d-4cc4-8ed9-5c2bf7c848b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:57.037627 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-3fbf0e76-637d-4cc4-8ed9-5c2bf7c848b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:16:57.045246 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:57.147501 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbf0e76-637d-4cc4-8ed9-5c2bf7c848b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:57.148935 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbf0e76-637d-4cc4-8ed9-5c2bf7c848b4 service neutron] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:57.167440 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 663/1320] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:16:56 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:17:00.478407 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388f72c0-1b1b-43c9-8c18-2c5d2d73f5ad None None] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:00.478982 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388f72c0-1b1b-43c9-8c18-2c5d2d73f5ad None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:00.478982 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388f72c0-1b1b-43c9-8c18-2c5d2d73f5ad None None] PATH_INFO: `/` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:00.480395 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 658/1321] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 17:17:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:17:00.485628 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbb0c80-a295-40a9-98e8-bf5f49efb3f0 None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:00.486086 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbb0c80-a295-40a9-98e8-bf5f49efb3f0 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:00.486300 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbb0c80-a295-40a9-98e8-bf5f49efb3f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:00.552284 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-2bbb0c80-a295-40a9-98e8-bf5f49efb3f0 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:17:00.553501 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-2bbb0c80-a295-40a9-98e8-bf5f49efb3f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:17:00.612370 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:00.651617 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 664/1322] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 17:17:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:17:00.688816 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388f72c0-1b1b-43c9-8c18-2c5d2d73f5ad None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:00.690509 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-388f72c0-1b1b-43c9-8c18-2c5d2d73f5ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:17:00.711826 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:00.806676 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388f72c0-1b1b-43c9-8c18-2c5d2d73f5ad None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:00.890885 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586d0f94-8ad3-4bec-b4f6-0cee5158e58d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5d25bfa8dc042329d57cd55fa7b7b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:00.891656 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586d0f94-8ad3-4bec-b4f6-0cee5158e58d service neutron] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:00.891841 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586d0f94-8ad3-4bec-b4f6-0cee5158e58d service neutron] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:00.892120 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586d0f94-8ad3-4bec-b4f6-0cee5158e58d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:00.893874 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-586d0f94-8ad3-4bec-b4f6-0cee5158e58d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:17:00.967829 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:01.006470 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586d0f94-8ad3-4bec-b4f6-0cee5158e58d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:01.007905 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586d0f94-8ad3-4bec-b4f6-0cee5158e58d service neutron] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:01.026296 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 659/1323] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:17:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:17:03.232054 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d01870-fcf8-4d73-b7f7-ebbf75f02ad2 None None] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:03.232571 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d01870-fcf8-4d73-b7f7-ebbf75f02ad2 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:03.232571 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d01870-fcf8-4d73-b7f7-ebbf75f02ad2 None None] PATH_INFO: `/` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:03.233932 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 665/1324] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 17:17:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:17:03.239696 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d5430c-c4e8-48da-958a-583fd8fc84f6 None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:03.240151 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d5430c-c4e8-48da-958a-583fd8fc84f6 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:03.240312 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d5430c-c4e8-48da-958a-583fd8fc84f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:03.307295 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-27d5430c-c4e8-48da-958a-583fd8fc84f6 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:17:03.308503 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-27d5430c-c4e8-48da-958a-583fd8fc84f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:17:03.406907 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 660/1325] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 17:17:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:17:03.444243 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d01870-fcf8-4d73-b7f7-ebbf75f02ad2 None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:03.445827 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-04d01870-fcf8-4d73-b7f7-ebbf75f02ad2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:17:03.558796 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d01870-fcf8-4d73-b7f7-ebbf75f02ad2 None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:03.639886 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c88fdea-d389-44f0-b592-a102666e663d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5d25bfa8dc042329d57cd55fa7b7b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:03.640551 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c88fdea-d389-44f0-b592-a102666e663d service neutron] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:03.640839 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c88fdea-d389-44f0-b592-a102666e663d service neutron] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:03.641118 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c88fdea-d389-44f0-b592-a102666e663d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:03.642916 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-6c88fdea-d389-44f0-b592-a102666e663d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:17:03.662337 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:03.758708 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c88fdea-d389-44f0-b592-a102666e663d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:03.760222 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c88fdea-d389-44f0-b592-a102666e663d service neutron] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:03.779015 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 666/1326] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:17:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:17:05.972348 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebb69ae-23c0-4c00-b6ae-bea600685660 None None] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:05.972877 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebb69ae-23c0-4c00-b6ae-bea600685660 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:05.973095 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebb69ae-23c0-4c00-b6ae-bea600685660 None None] PATH_INFO: `/` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:05.974530 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 661/1327] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 17:17:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:17:05.980054 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea85b4b0-9ecd-49b7-83f2-60bc17cc3215 None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:05.980615 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea85b4b0-9ecd-49b7-83f2-60bc17cc3215 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:05.980615 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea85b4b0-9ecd-49b7-83f2-60bc17cc3215 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:06.047741 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-ea85b4b0-9ecd-49b7-83f2-60bc17cc3215 None None] MFA Rules not processed for user `ef9bfbcc66f1498383e8c137bc8a81b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:17:06.048966 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-ea85b4b0-9ecd-49b7-83f2-60bc17cc3215 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:17:06.115872 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:06.148910 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 667/1328] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 17:17:05 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:17:06.201454 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348b2128-2b3f-4c4b-93c6-9f2f51c9d43c None None] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:06.201875 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348b2128-2b3f-4c4b-93c6-9f2f51c9d43c None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:06.202234 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348b2128-2b3f-4c4b-93c6-9f2f51c9d43c None None] PATH_INFO: `/` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:06.203699 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 662/1329] 10.222.0.39 () {54 vars in 964 bytes} [Thu Jun 16 17:17:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:17:06.210222 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fef95b-b366-463e-97ad-ba037fe903ae None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:06.210524 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fef95b-b366-463e-97ad-ba037fe903ae None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:06.210990 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fef95b-b366-463e-97ad-ba037fe903ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:06.288844 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-30fef95b-b366-463e-97ad-ba037fe903ae None None] MFA Rules not processed for user `b5d25bfa8dc042329d57cd55fa7b7b23`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:17:06.290107 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-30fef95b-b366-463e-97ad-ba037fe903ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:17:06.368672 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 668/1330] 10.222.0.39 () {58 vars in 1061 bytes} [Thu Jun 16 17:17:06 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 17:17:06.386106 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348b2128-2b3f-4c4b-93c6-9f2f51c9d43c None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:06.387942 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-348b2128-2b3f-4c4b-93c6-9f2f51c9d43c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:17:06.426047 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:06.512754 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348b2128-2b3f-4c4b-93c6-9f2f51c9d43c None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:06.597872 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea75bec-20f5-4591-b86c-6ccfb38e5ad0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5d25bfa8dc042329d57cd55fa7b7b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:06.598588 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea75bec-20f5-4591-b86c-6ccfb38e5ad0 service neutron] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:06.598883 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea75bec-20f5-4591-b86c-6ccfb38e5ad0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:06.599163 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea75bec-20f5-4591-b86c-6ccfb38e5ad0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:06.600865 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-2ea75bec-20f5-4591-b86c-6ccfb38e5ad0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:17:06.684097 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:06.716740 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea75bec-20f5-4591-b86c-6ccfb38e5ad0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:06.718305 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea75bec-20f5-4591-b86c-6ccfb38e5ad0 service neutron] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:06.740240 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 663/1331] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:17:06 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:17:09.756713 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128f5002-9c8f-42ba-b4d9-b8a000de4db4 None None] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:09.757284 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128f5002-9c8f-42ba-b4d9-b8a000de4db4 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:09.757284 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128f5002-9c8f-42ba-b4d9-b8a000de4db4 None None] PATH_INFO: `/` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:09.758674 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 669/1332] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 17:17:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:17:09.763770 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f0126f-981a-4a5b-8d17-e8ea2cc0d441 None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:09.764200 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f0126f-981a-4a5b-8d17-e8ea2cc0d441 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:09.764341 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f0126f-981a-4a5b-8d17-e8ea2cc0d441 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:09.828263 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-48f0126f-981a-4a5b-8d17-e8ea2cc0d441 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:17:09.829469 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-48f0126f-981a-4a5b-8d17-e8ea2cc0d441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:17:09.927562 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 664/1333] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 17:17:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:17:09.963180 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128f5002-9c8f-42ba-b4d9-b8a000de4db4 None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:09.964766 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-128f5002-9c8f-42ba-b4d9-b8a000de4db4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:17:10.034056 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:10.068345 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128f5002-9c8f-42ba-b4d9-b8a000de4db4 None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:10.140830 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7e515a-228c-4b10-8e81-5e9d13a97c15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5d25bfa8dc042329d57cd55fa7b7b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:10.141478 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7e515a-228c-4b10-8e81-5e9d13a97c15 service neutron] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:10.141790 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7e515a-228c-4b10-8e81-5e9d13a97c15 service neutron] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:10.142081 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7e515a-228c-4b10-8e81-5e9d13a97c15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:10.143741 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-2f7e515a-228c-4b10-8e81-5e9d13a97c15 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:17:10.252201 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7e515a-228c-4b10-8e81-5e9d13a97c15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:10.254178 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7e515a-228c-4b10-8e81-5e9d13a97c15 service neutron] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:10.264022 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:10.272559 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 670/1334] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:17:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:17:12.465252 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29c702b-d6bb-4a45-abf5-3ef86b1098e2 None None] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:12.465829 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29c702b-d6bb-4a45-abf5-3ef86b1098e2 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:12.465930 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29c702b-d6bb-4a45-abf5-3ef86b1098e2 None None] PATH_INFO: `/` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:12.467282 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 665/1335] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 17:17:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:17:12.473305 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce173d6-12c3-4383-a193-5334a9f6640d None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:12.473873 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce173d6-12c3-4383-a193-5334a9f6640d None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:12.473973 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce173d6-12c3-4383-a193-5334a9f6640d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:12.543678 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-fce173d6-12c3-4383-a193-5334a9f6640d None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:17:12.544907 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-fce173d6-12c3-4383-a193-5334a9f6640d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:17:12.640180 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 671/1336] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 17:17:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:17:12.680168 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29c702b-d6bb-4a45-abf5-3ef86b1098e2 None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:12.681747 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-b29c702b-d6bb-4a45-abf5-3ef86b1098e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:17:12.721918 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:12.784489 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29c702b-d6bb-4a45-abf5-3ef86b1098e2 None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:12.858878 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e97bec-cb9d-4a55-9d28-8013d15adebd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5d25bfa8dc042329d57cd55fa7b7b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:12.859522 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e97bec-cb9d-4a55-9d28-8013d15adebd service neutron] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:12.859806 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e97bec-cb9d-4a55-9d28-8013d15adebd service neutron] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:12.860085 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e97bec-cb9d-4a55-9d28-8013d15adebd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:12.861723 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-e1e97bec-cb9d-4a55-9d28-8013d15adebd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:17:12.945590 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:12.971505 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e97bec-cb9d-4a55-9d28-8013d15adebd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:12.973056 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e97bec-cb9d-4a55-9d28-8013d15adebd service neutron] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:12.991511 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 666/1337] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:17:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:17:15.840587 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c817e1b5-042b-4e7d-8e93-6ea9df8bef27 None None] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:15.841126 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c817e1b5-042b-4e7d-8e93-6ea9df8bef27 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:15.841126 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c817e1b5-042b-4e7d-8e93-6ea9df8bef27 None None] PATH_INFO: `/` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:15.842599 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 672/1338] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 17:17:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:17:15.848743 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80032fbe-e836-45da-b551-b92ccf4d2c92 None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:15.849137 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80032fbe-e836-45da-b551-b92ccf4d2c92 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:15.849317 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80032fbe-e836-45da-b551-b92ccf4d2c92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:15.915233 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-80032fbe-e836-45da-b551-b92ccf4d2c92 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:17:15.916442 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-80032fbe-e836-45da-b551-b92ccf4d2c92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:17:16.015053 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 667/1339] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 17:17:15 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:17:16.051928 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c817e1b5-042b-4e7d-8e93-6ea9df8bef27 None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:16.053524 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-c817e1b5-042b-4e7d-8e93-6ea9df8bef27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:17:16.134778 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:16.163717 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c817e1b5-042b-4e7d-8e93-6ea9df8bef27 None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:16.239392 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259e2299-c1a3-4af5-849a-41edba5df475 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5d25bfa8dc042329d57cd55fa7b7b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:16.240018 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259e2299-c1a3-4af5-849a-41edba5df475 service neutron] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:16.240306 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259e2299-c1a3-4af5-849a-41edba5df475 service neutron] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:16.240586 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259e2299-c1a3-4af5-849a-41edba5df475 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:16.242277 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-259e2299-c1a3-4af5-849a-41edba5df475 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:17:16.351874 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259e2299-c1a3-4af5-849a-41edba5df475 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:16.353379 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259e2299-c1a3-4af5-849a-41edba5df475 service neutron] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:16.372976 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 673/1340] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:17:16 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:17:20.754135 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcf7d0c-e92e-46d5-897b-fe1ea251736b None None] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:20.754660 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcf7d0c-e92e-46d5-897b-fe1ea251736b None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:20.754660 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcf7d0c-e92e-46d5-897b-fe1ea251736b None None] PATH_INFO: `/` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:20.755952 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 668/1341] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 17:17:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:17:20.762198 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb4fa2d-27af-4df4-94d6-e86e8b721604 None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:20.762682 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb4fa2d-27af-4df4-94d6-e86e8b721604 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:20.762764 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb4fa2d-27af-4df4-94d6-e86e8b721604 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:20.769623 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:20.838658 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-ecb4fa2d-27af-4df4-94d6-e86e8b721604 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:17:20.840729 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-ecb4fa2d-27af-4df4-94d6-e86e8b721604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:17:20.954694 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 674/1342] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 17:17:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:17:20.994758 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcf7d0c-e92e-46d5-897b-fe1ea251736b None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:20.996928 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-dbcf7d0c-e92e-46d5-897b-fe1ea251736b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:17:21.049258 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:21.096388 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcf7d0c-e92e-46d5-897b-fe1ea251736b None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:21.100570 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea50929-917f-4367-af93-974673bf16a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5d25bfa8dc042329d57cd55fa7b7b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:21.101227 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea50929-917f-4367-af93-974673bf16a2 service neutron] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:21.101514 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea50929-917f-4367-af93-974673bf16a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:21.101820 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea50929-917f-4367-af93-974673bf16a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:21.110949 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea50929-917f-4367-af93-974673bf16a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:21.112382 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea50929-917f-4367-af93-974673bf16a2 service neutron] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:21.122203 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 669/1343] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:17:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:17:24.207694 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4e9da0-3a5b-4407-913c-7a9b6d39dd34 None None] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:24.208191 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4e9da0-3a5b-4407-913c-7a9b6d39dd34 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:24.208454 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4e9da0-3a5b-4407-913c-7a9b6d39dd34 None None] PATH_INFO: `/` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:24.209853 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 675/1344] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 17:17:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:17:24.215779 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b414015f-cb4b-4f55-a0b7-ad4ee8840660 None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:24.216329 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b414015f-cb4b-4f55-a0b7-ad4ee8840660 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:24.216329 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b414015f-cb4b-4f55-a0b7-ad4ee8840660 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:24.245548 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-b414015f-cb4b-4f55-a0b7-ad4ee8840660 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:17:24.246858 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-b414015f-cb4b-4f55-a0b7-ad4ee8840660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:17:24.325656 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 670/1345] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 17:17:24 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:17:24.363616 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4e9da0-3a5b-4407-913c-7a9b6d39dd34 None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:24.365583 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-6a4e9da0-3a5b-4407-913c-7a9b6d39dd34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:17:24.379398 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4e9da0-3a5b-4407-913c-7a9b6d39dd34 None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:24.383023 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58fccbb-2bd0-4334-981b-048f8041be80 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5d25bfa8dc042329d57cd55fa7b7b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:24.383734 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58fccbb-2bd0-4334-981b-048f8041be80 service neutron] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:24.384092 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58fccbb-2bd0-4334-981b-048f8041be80 service neutron] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:24.384449 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58fccbb-2bd0-4334-981b-048f8041be80 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:24.394690 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58fccbb-2bd0-4334-981b-048f8041be80 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:24.396207 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58fccbb-2bd0-4334-981b-048f8041be80 service neutron] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:24.406275 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 676/1346] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:17:24 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:17:29.090198 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c1686e-75f5-4789-bdfc-1f6961c47914 None None] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:29.090736 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c1686e-75f5-4789-bdfc-1f6961c47914 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:29.090827 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c1686e-75f5-4789-bdfc-1f6961c47914 None None] PATH_INFO: `/` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:29.092194 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 671/1347] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 17:17:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:17:29.098119 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6225e0d4-1404-4d7b-813c-4d7c658bde12 None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:29.098626 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6225e0d4-1404-4d7b-813c-4d7c658bde12 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:29.098737 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6225e0d4-1404-4d7b-813c-4d7c658bde12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:29.117135 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-6225e0d4-1404-4d7b-813c-4d7c658bde12 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:17:29.118388 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-6225e0d4-1404-4d7b-813c-4d7c658bde12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:17:29.126362 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 677/1348] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 17:17:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:17:29.164923 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c1686e-75f5-4789-bdfc-1f6961c47914 None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:29.176240 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c1686e-75f5-4789-bdfc-1f6961c47914 None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:29.179829 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79512544-57c4-46e1-86fc-396d4ac062b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5d25bfa8dc042329d57cd55fa7b7b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:29.180482 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79512544-57c4-46e1-86fc-396d4ac062b3 service neutron] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:29.180771 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79512544-57c4-46e1-86fc-396d4ac062b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:29.181051 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79512544-57c4-46e1-86fc-396d4ac062b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:29.191664 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79512544-57c4-46e1-86fc-396d4ac062b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:29.193106 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79512544-57c4-46e1-86fc-396d4ac062b3 service neutron] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:29.203268 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 672/1349] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:17:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:17:34.388164 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cd259f-c5ed-4474-b9e0-79e42d206eb0 None None] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:34.388700 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cd259f-c5ed-4474-b9e0-79e42d206eb0 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:34.388790 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cd259f-c5ed-4474-b9e0-79e42d206eb0 None None] PATH_INFO: `/` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:34.390557 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 678/1350] 10.222.0.39 () {54 vars in 921 bytes} [Thu Jun 16 17:17:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 17:17:34.395685 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dd7627-2d84-4439-9379-75802ec78951 None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:34.396088 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dd7627-2d84-4439-9379-75802ec78951 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:34.396254 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dd7627-2d84-4439-9379-75802ec78951 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:34.468994 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-b3dd7627-2d84-4439-9379-75802ec78951 None None] MFA Rules not processed for user `2882f26811094d8e88c03701c94296fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:17:34.470251 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-b3dd7627-2d84-4439-9379-75802ec78951 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:17:34.508790 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:34.565695 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 673/1351] 10.222.0.39 () {58 vars in 1018 bytes} [Thu Jun 16 17:17:34 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:17:38.941289 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1341e96e-849c-401a-9341-da086af2a75a None None] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:38.941820 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1341e96e-849c-401a-9341-da086af2a75a None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:38.941907 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1341e96e-849c-401a-9341-da086af2a75a None None] PATH_INFO: `/` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:38.943524 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 679/1352] 10.222.0.39 () {54 vars in 921 bytes} [Thu Jun 16 17:17:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:17:38.949883 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28da4d5-df14-4943-aeb7-58d77dd0c3a6 None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:38.950529 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28da4d5-df14-4943-aeb7-58d77dd0c3a6 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:38.950529 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28da4d5-df14-4943-aeb7-58d77dd0c3a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:38.972475 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-f28da4d5-df14-4943-aeb7-58d77dd0c3a6 None None] MFA Rules not processed for user `2882f26811094d8e88c03701c94296fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:17:38.973680 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-f28da4d5-df14-4943-aeb7-58d77dd0c3a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:17:38.982662 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 674/1353] 10.222.0.39 () {58 vars in 1018 bytes} [Thu Jun 16 17:17:38 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:17:39.112833 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=72 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:40.599250 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47d93a4-9514-4000-9869-29dc94576a9f None None] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:40.599900 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47d93a4-9514-4000-9869-29dc94576a9f None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:40.599900 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47d93a4-9514-4000-9869-29dc94576a9f None None] PATH_INFO: `/` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:40.601462 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 680/1354] 10.222.0.39 () {54 vars in 921 bytes} [Thu Jun 16 17:17:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:17:40.606732 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb8838f-347c-4e2e-972a-188b26cc34a2 None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:40.607162 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb8838f-347c-4e2e-972a-188b26cc34a2 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:40.607419 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb8838f-347c-4e2e-972a-188b26cc34a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:40.626116 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-fdb8838f-347c-4e2e-972a-188b26cc34a2 None None] MFA Rules not processed for user `2882f26811094d8e88c03701c94296fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:17:40.627302 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-fdb8838f-347c-4e2e-972a-188b26cc34a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:17:40.636467 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 675/1355] 10.222.0.39 () {58 vars in 1018 bytes} [Thu Jun 16 17:17:40 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:17:44.447371 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9f4c8c-30d6-4067-96fe-7c068df16a13 None None] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:44.447920 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9f4c8c-30d6-4067-96fe-7c068df16a13 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:44.447920 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9f4c8c-30d6-4067-96fe-7c068df16a13 None None] PATH_INFO: `/` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:44.449208 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 681/1356] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 17:17:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:17:44.454409 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b08589-8b1a-4f0c-ac8b-380c6b1804e1 None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:44.454803 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b08589-8b1a-4f0c-ac8b-380c6b1804e1 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:44.454970 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b08589-8b1a-4f0c-ac8b-380c6b1804e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:44.472877 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-85b08589-8b1a-4f0c-ac8b-380c6b1804e1 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:17:44.474101 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-85b08589-8b1a-4f0c-ac8b-380c6b1804e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:17:44.483268 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 676/1357] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 17:17:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:17:44.537954 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbf8ef8-6983-4694-aacd-8f0e3765d585 None None] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:44.538611 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbf8ef8-6983-4694-aacd-8f0e3765d585 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:44.539052 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbf8ef8-6983-4694-aacd-8f0e3765d585 None None] PATH_INFO: `/` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:44.543588 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 682/1358] 10.222.0.39 () {54 vars in 961 bytes} [Thu Jun 16 17:17:44 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:17:44.554852 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057a535a-99a7-45dc-91b4-0f44f2591005 None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:44.555400 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057a535a-99a7-45dc-91b4-0f44f2591005 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:44.555926 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057a535a-99a7-45dc-91b4-0f44f2591005 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:44.623200 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-057a535a-99a7-45dc-91b4-0f44f2591005 None None] MFA Rules not processed for user `3d381bb41dea4f1e90c3cf3815ac88dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:17:44.625132 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-057a535a-99a7-45dc-91b4-0f44f2591005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:17:44.724974 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 677/1359] 10.222.0.39 () {58 vars in 1058 bytes} [Thu Jun 16 17:17:44 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:17:44.733082 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbf8ef8-6983-4694-aacd-8f0e3765d585 None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:44.750592 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbf8ef8-6983-4694-aacd-8f0e3765d585 None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:44.756132 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3a21e2-7d8d-425e-919f-22543e8ae7e0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d381bb41dea4f1e90c3cf3815ac88dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:44.756860 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3a21e2-7d8d-425e-919f-22543e8ae7e0 service nova] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:44.757216 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3a21e2-7d8d-425e-919f-22543e8ae7e0 service nova] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:44.757564 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3a21e2-7d8d-425e-919f-22543e8ae7e0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:44.766194 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3a21e2-7d8d-425e-919f-22543e8ae7e0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:44.767851 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3a21e2-7d8d-425e-919f-22543e8ae7e0 service nova] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:44.778163 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 683/1360] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:17:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:17:47.159974 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3767e5c-de47-4ea9-902a-93bdfc21df6a None None] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:47.160548 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3767e5c-de47-4ea9-902a-93bdfc21df6a None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:47.160548 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3767e5c-de47-4ea9-902a-93bdfc21df6a None None] PATH_INFO: `/` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:47.162153 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 678/1361] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 17:17:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:17:47.167437 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48011b5-556e-4fd9-8bae-2ba5bbad068e None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:47.167840 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48011b5-556e-4fd9-8bae-2ba5bbad068e None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:47.167989 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48011b5-556e-4fd9-8bae-2ba5bbad068e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:47.185865 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-b48011b5-556e-4fd9-8bae-2ba5bbad068e None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:17:47.187069 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-b48011b5-556e-4fd9-8bae-2ba5bbad068e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:17:47.198989 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 684/1362] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 17:17:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:17:47.243568 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3767e5c-de47-4ea9-902a-93bdfc21df6a None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:47.258638 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3767e5c-de47-4ea9-902a-93bdfc21df6a None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:47.264444 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c9f404-660d-4b16-936f-3f79abce04e3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d381bb41dea4f1e90c3cf3815ac88dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:47.265091 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c9f404-660d-4b16-936f-3f79abce04e3 service nova] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:47.265376 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c9f404-660d-4b16-936f-3f79abce04e3 service nova] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:47.265655 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c9f404-660d-4b16-936f-3f79abce04e3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:47.274454 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c9f404-660d-4b16-936f-3f79abce04e3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:47.276112 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c9f404-660d-4b16-936f-3f79abce04e3 service nova] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:47.286487 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 679/1363] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:17:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:17:49.867788 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9de332-3eec-4a2a-ad65-74a85ea87160 None None] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:49.868334 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9de332-3eec-4a2a-ad65-74a85ea87160 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:49.868334 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9de332-3eec-4a2a-ad65-74a85ea87160 None None] PATH_INFO: `/` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:49.869722 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 685/1364] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 17:17:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:17:49.875092 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4563e62-e152-431c-b225-380379909423 None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:49.875489 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4563e62-e152-431c-b225-380379909423 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:49.875695 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4563e62-e152-431c-b225-380379909423 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:49.902826 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-f4563e62-e152-431c-b225-380379909423 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:17:49.905440 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-f4563e62-e152-431c-b225-380379909423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:17:49.914615 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 680/1365] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 17:17:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:17:49.975169 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efc3c3c-365e-4379-b97f-5cd023f926fc None None] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:49.975618 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efc3c3c-365e-4379-b97f-5cd023f926fc None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:49.976005 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efc3c3c-365e-4379-b97f-5cd023f926fc None None] PATH_INFO: `/` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:49.977456 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 686/1366] 10.222.0.39 () {54 vars in 961 bytes} [Thu Jun 16 17:17:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:17:49.983401 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2d774c-8975-41a4-99d3-96d57a3bdb1c None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:49.983697 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2d774c-8975-41a4-99d3-96d57a3bdb1c None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:49.983981 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2d774c-8975-41a4-99d3-96d57a3bdb1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:50.007213 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-ec2d774c-8975-41a4-99d3-96d57a3bdb1c None None] MFA Rules not processed for user `3d381bb41dea4f1e90c3cf3815ac88dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:17:50.008447 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-ec2d774c-8975-41a4-99d3-96d57a3bdb1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:17:50.020169 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 681/1367] 10.222.0.39 () {58 vars in 1058 bytes} [Thu Jun 16 17:17:49 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:17:50.029453 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efc3c3c-365e-4379-b97f-5cd023f926fc None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:50.046024 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efc3c3c-365e-4379-b97f-5cd023f926fc None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:50.052259 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0dbc61-318e-4b6e-9a5c-19d0e54f9da5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d381bb41dea4f1e90c3cf3815ac88dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:50.052916 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0dbc61-318e-4b6e-9a5c-19d0e54f9da5 service nova] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:50.053202 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0dbc61-318e-4b6e-9a5c-19d0e54f9da5 service nova] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:50.053477 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0dbc61-318e-4b6e-9a5c-19d0e54f9da5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:50.062428 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0dbc61-318e-4b6e-9a5c-19d0e54f9da5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:50.064004 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0dbc61-318e-4b6e-9a5c-19d0e54f9da5 service nova] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:50.073519 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 687/1368] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:17:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 17:17:52.430060 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f021ef-2982-4353-8ae0-10a5052ebc9c None None] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:52.430623 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f021ef-2982-4353-8ae0-10a5052ebc9c None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:52.430623 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f021ef-2982-4353-8ae0-10a5052ebc9c None None] PATH_INFO: `/` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:52.431993 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 682/1369] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 17:17:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:17:52.437203 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46e227e-7703-4785-bde5-76bbc58f8439 None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:52.437620 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46e227e-7703-4785-bde5-76bbc58f8439 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:52.437820 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46e227e-7703-4785-bde5-76bbc58f8439 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:52.456159 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-f46e227e-7703-4785-bde5-76bbc58f8439 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:17:52.457348 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-f46e227e-7703-4785-bde5-76bbc58f8439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:17:52.465434 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 688/1370] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 17:17:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:17:52.509849 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f021ef-2982-4353-8ae0-10a5052ebc9c None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:52.526709 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f021ef-2982-4353-8ae0-10a5052ebc9c None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:52.534872 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b47edd-959f-4380-beb6-108f9bf293b0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d381bb41dea4f1e90c3cf3815ac88dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:52.535535 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b47edd-959f-4380-beb6-108f9bf293b0 service nova] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:52.535822 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b47edd-959f-4380-beb6-108f9bf293b0 service nova] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:52.536097 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b47edd-959f-4380-beb6-108f9bf293b0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:52.545181 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b47edd-959f-4380-beb6-108f9bf293b0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:52.546777 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b47edd-959f-4380-beb6-108f9bf293b0 service nova] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:52.556463 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 683/1371] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:17:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:17:52.713328 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b722fa2b-09f1-437c-870a-fd8440c3e95e None None] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:52.713632 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b722fa2b-09f1-437c-870a-fd8440c3e95e None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:52.714382 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b722fa2b-09f1-437c-870a-fd8440c3e95e None None] PATH_INFO: `/` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:52.715771 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 689/1372] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 17:17:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:17:52.722382 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca95512-688c-4378-a443-cb5d1fe028da None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:52.722705 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca95512-688c-4378-a443-cb5d1fe028da None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:52.722990 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca95512-688c-4378-a443-cb5d1fe028da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:52.741548 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-eca95512-688c-4378-a443-cb5d1fe028da None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:17:52.742787 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-eca95512-688c-4378-a443-cb5d1fe028da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:17:52.751015 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 684/1373] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 17:17:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:17:53.031123 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f16cf1-7cd9-4a5f-8061-e4b0ab38e72a None None] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:53.033361 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f16cf1-7cd9-4a5f-8061-e4b0ab38e72a None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:53.033361 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f16cf1-7cd9-4a5f-8061-e4b0ab38e72a None None] PATH_INFO: `/` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:53.033361 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 690/1374] 10.222.0.39 () {54 vars in 963 bytes} [Thu Jun 16 17:17:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:17:53.038440 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b83ef2e-bf8c-4755-88fc-999d334ab80c None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:53.038716 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b83ef2e-bf8c-4755-88fc-999d334ab80c None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:53.039069 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b83ef2e-bf8c-4755-88fc-999d334ab80c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:53.046240 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:53.101851 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-7b83ef2e-bf8c-4755-88fc-999d334ab80c None None] MFA Rules not processed for user `ef37136b89d34edc9cd94c7aa81b2095`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:17:53.103069 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-7b83ef2e-bf8c-4755-88fc-999d334ab80c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:17:53.172880 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 685/1375] 10.222.0.39 () {58 vars in 1060 bytes} [Thu Jun 16 17:17:53 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:17:53.180583 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f16cf1-7cd9-4a5f-8061-e4b0ab38e72a None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:53.193065 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f16cf1-7cd9-4a5f-8061-e4b0ab38e72a None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:53.196771 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d41d4c-a5bc-4d5b-8be2-9fb85b8dc6fd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef37136b89d34edc9cd94c7aa81b2095', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:53.197554 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d41d4c-a5bc-4d5b-8be2-9fb85b8dc6fd service cinder] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:53.197949 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d41d4c-a5bc-4d5b-8be2-9fb85b8dc6fd service cinder] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:53.198434 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d41d4c-a5bc-4d5b-8be2-9fb85b8dc6fd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:53.209585 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d41d4c-a5bc-4d5b-8be2-9fb85b8dc6fd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:53.211241 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d41d4c-a5bc-4d5b-8be2-9fb85b8dc6fd service cinder] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:53.223401 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 691/1376] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:17:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:17:54.938636 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2762302a-5dba-43d4-ac5f-66503d0ad14e None None] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:54.939177 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2762302a-5dba-43d4-ac5f-66503d0ad14e None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:54.940165 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2762302a-5dba-43d4-ac5f-66503d0ad14e None None] PATH_INFO: `/` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:54.942382 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 686/1377] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 17:17:54 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:17:54.950443 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ce8f43-938a-484f-9314-b1268ea5c51f None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:54.950443 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ce8f43-938a-484f-9314-b1268ea5c51f None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:54.950443 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ce8f43-938a-484f-9314-b1268ea5c51f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:54.969109 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-97ce8f43-938a-484f-9314-b1268ea5c51f None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:17:54.970457 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-97ce8f43-938a-484f-9314-b1268ea5c51f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:17:54.978853 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 692/1378] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 17:17:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:17:55.025114 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2762302a-5dba-43d4-ac5f-66503d0ad14e None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:55.040244 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2762302a-5dba-43d4-ac5f-66503d0ad14e None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:55.045951 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ab71c4-f1ea-41fa-8a65-7c77ff1e01b6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d381bb41dea4f1e90c3cf3815ac88dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:55.046626 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ab71c4-f1ea-41fa-8a65-7c77ff1e01b6 service nova] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:55.046917 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ab71c4-f1ea-41fa-8a65-7c77ff1e01b6 service nova] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:55.047202 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ab71c4-f1ea-41fa-8a65-7c77ff1e01b6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:55.057164 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ab71c4-f1ea-41fa-8a65-7c77ff1e01b6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:55.058821 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ab71c4-f1ea-41fa-8a65-7c77ff1e01b6 service nova] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:55.070307 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 687/1379] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:17:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:17:57.380825 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea754b4b-1909-49d0-8d05-6129a6b8e0ff None None] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:57.381395 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea754b4b-1909-49d0-8d05-6129a6b8e0ff None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:57.381829 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea754b4b-1909-49d0-8d05-6129a6b8e0ff None None] PATH_INFO: `/` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:57.383408 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 693/1380] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 17:17:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:17:57.388823 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e805be2-70f4-4187-8e44-2a7079e236be None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:57.389306 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e805be2-70f4-4187-8e44-2a7079e236be None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:57.389410 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e805be2-70f4-4187-8e44-2a7079e236be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:57.407492 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-3e805be2-70f4-4187-8e44-2a7079e236be None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:17:57.409197 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-3e805be2-70f4-4187-8e44-2a7079e236be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:17:57.417046 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 688/1381] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 17:17:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:17:57.462393 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea754b4b-1909-49d0-8d05-6129a6b8e0ff None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:57.478074 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea754b4b-1909-49d0-8d05-6129a6b8e0ff None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:57.483914 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab3f092-3535-4bd0-acfa-fa0fcf560205 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d381bb41dea4f1e90c3cf3815ac88dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:57.484563 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab3f092-3535-4bd0-acfa-fa0fcf560205 service nova] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:57.484849 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab3f092-3535-4bd0-acfa-fa0fcf560205 service nova] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:57.485128 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab3f092-3535-4bd0-acfa-fa0fcf560205 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:57.494471 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab3f092-3535-4bd0-acfa-fa0fcf560205 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:57.496049 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab3f092-3535-4bd0-acfa-fa0fcf560205 service nova] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:57.505789 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 694/1382] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:17:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:17:59.836856 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f9251f-4444-475e-ac1d-210d9ed65b94 None None] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:59.837621 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f9251f-4444-475e-ac1d-210d9ed65b94 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:59.837621 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f9251f-4444-475e-ac1d-210d9ed65b94 None None] PATH_INFO: `/` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:59.838937 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 689/1383] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 17:17:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:17:59.844583 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d59d2e7-7fb9-4b26-9495-9384b9645400 None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:59.845036 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d59d2e7-7fb9-4b26-9495-9384b9645400 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:59.845144 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d59d2e7-7fb9-4b26-9495-9384b9645400 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:59.864096 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-1d59d2e7-7fb9-4b26-9495-9384b9645400 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:17:59.865293 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-1d59d2e7-7fb9-4b26-9495-9384b9645400 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:17:59.873201 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 695/1384] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 17:17:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:17:59.916774 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f9251f-4444-475e-ac1d-210d9ed65b94 None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:59.932485 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f9251f-4444-475e-ac1d-210d9ed65b94 None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:59.938351 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15316a92-02ff-411c-9b4f-78a1e9abeaaa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d381bb41dea4f1e90c3cf3815ac88dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:59.939649 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15316a92-02ff-411c-9b4f-78a1e9abeaaa service nova] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:59.940157 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15316a92-02ff-411c-9b4f-78a1e9abeaaa service nova] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:59.940539 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15316a92-02ff-411c-9b4f-78a1e9abeaaa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:59.950455 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15316a92-02ff-411c-9b4f-78a1e9abeaaa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:59.952472 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15316a92-02ff-411c-9b4f-78a1e9abeaaa service nova] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:59.964235 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 690/1385] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:17:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:18:02.179646 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180414b6-0034-402d-b5ad-3ce383ed8578 None None] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:02.180211 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180414b6-0034-402d-b5ad-3ce383ed8578 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:02.180322 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180414b6-0034-402d-b5ad-3ce383ed8578 None None] PATH_INFO: `/` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:02.182175 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 696/1386] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 17:18:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:18:02.187458 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccb3e19-e37c-44ee-a058-9d6e7f4f3c9c None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:02.187931 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccb3e19-e37c-44ee-a058-9d6e7f4f3c9c None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:02.188015 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccb3e19-e37c-44ee-a058-9d6e7f4f3c9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:02.207380 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-cccb3e19-e37c-44ee-a058-9d6e7f4f3c9c None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:18:02.208702 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-cccb3e19-e37c-44ee-a058-9d6e7f4f3c9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:18:02.220691 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 691/1387] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 17:18:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 17:18:02.266559 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180414b6-0034-402d-b5ad-3ce383ed8578 None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:18:02.284501 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180414b6-0034-402d-b5ad-3ce383ed8578 None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:18:02.291188 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988645c3-fb4b-4fde-93b2-70a51e0caa5d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d381bb41dea4f1e90c3cf3815ac88dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:18:02.291951 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988645c3-fb4b-4fde-93b2-70a51e0caa5d service nova] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:02.292366 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988645c3-fb4b-4fde-93b2-70a51e0caa5d service nova] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:02.292709 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988645c3-fb4b-4fde-93b2-70a51e0caa5d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:02.303622 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988645c3-fb4b-4fde-93b2-70a51e0caa5d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:18:02.305610 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988645c3-fb4b-4fde-93b2-70a51e0caa5d service nova] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:18:02.318609 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 697/1388] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:18:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:18:04.626255 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd65ca4-8fa2-47ac-bd2f-872d77c7fc62 None None] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:04.627682 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd65ca4-8fa2-47ac-bd2f-872d77c7fc62 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:04.627682 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd65ca4-8fa2-47ac-bd2f-872d77c7fc62 None None] PATH_INFO: `/` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:04.628845 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 692/1389] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 17:18:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:18:04.635308 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eaa8e3-aa5c-4fea-92c6-8706a57c52a1 None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:04.636130 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eaa8e3-aa5c-4fea-92c6-8706a57c52a1 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:04.636478 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eaa8e3-aa5c-4fea-92c6-8706a57c52a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:04.658061 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-86eaa8e3-aa5c-4fea-92c6-8706a57c52a1 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:18:04.659604 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-86eaa8e3-aa5c-4fea-92c6-8706a57c52a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:18:04.668947 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 698/1390] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 17:18:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:18:04.714323 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd65ca4-8fa2-47ac-bd2f-872d77c7fc62 None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:18:04.729270 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd65ca4-8fa2-47ac-bd2f-872d77c7fc62 None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:18:04.734783 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb695b5-88af-4963-a347-a7ab2c5f8d7a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d381bb41dea4f1e90c3cf3815ac88dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:18:04.735426 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb695b5-88af-4963-a347-a7ab2c5f8d7a service nova] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:04.735719 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb695b5-88af-4963-a347-a7ab2c5f8d7a service nova] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:04.736556 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb695b5-88af-4963-a347-a7ab2c5f8d7a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:04.745068 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb695b5-88af-4963-a347-a7ab2c5f8d7a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:18:04.747848 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb695b5-88af-4963-a347-a7ab2c5f8d7a service nova] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:18:04.757237 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 693/1391] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:18:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:18:07.461664 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a546b81d-a4fe-4534-b402-6ab880b70940 None None] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:07.462388 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a546b81d-a4fe-4534-b402-6ab880b70940 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:07.462388 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a546b81d-a4fe-4534-b402-6ab880b70940 None None] PATH_INFO: `/` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:07.463747 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 699/1392] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 17:18:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:18:07.469276 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fedb721-e49c-4161-a591-89524c2a1006 None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:07.469688 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fedb721-e49c-4161-a591-89524c2a1006 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:07.469873 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fedb721-e49c-4161-a591-89524c2a1006 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:07.487618 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-1fedb721-e49c-4161-a591-89524c2a1006 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:18:07.488820 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-1fedb721-e49c-4161-a591-89524c2a1006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:18:07.496775 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 694/1393] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 17:18:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:18:07.541366 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a546b81d-a4fe-4534-b402-6ab880b70940 None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:18:07.557543 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a546b81d-a4fe-4534-b402-6ab880b70940 None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:18:07.563081 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34d6863-7150-4d6c-8b5b-fc662d1128c3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d381bb41dea4f1e90c3cf3815ac88dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:18:07.563760 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34d6863-7150-4d6c-8b5b-fc662d1128c3 service nova] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:07.564069 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34d6863-7150-4d6c-8b5b-fc662d1128c3 service nova] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:07.564336 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34d6863-7150-4d6c-8b5b-fc662d1128c3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:07.573603 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34d6863-7150-4d6c-8b5b-fc662d1128c3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:18:07.575254 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34d6863-7150-4d6c-8b5b-fc662d1128c3 service nova] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:18:07.585287 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 700/1394] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:18:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:18:09.465640 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bf424a-6609-4c9f-b6e3-1d210c046eb0 None None] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:09.466325 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bf424a-6609-4c9f-b6e3-1d210c046eb0 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:09.466325 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bf424a-6609-4c9f-b6e3-1d210c046eb0 None None] PATH_INFO: `/` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:09.467877 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 695/1395] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 17:18:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:18:09.473641 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f8d97b-99ee-4640-9ad2-c54402894376 None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:09.474148 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f8d97b-99ee-4640-9ad2-c54402894376 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:09.474257 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f8d97b-99ee-4640-9ad2-c54402894376 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:09.480424 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=52 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:18:09.493129 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-57f8d97b-99ee-4640-9ad2-c54402894376 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:18:09.494903 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-57f8d97b-99ee-4640-9ad2-c54402894376 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:18:09.502604 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 701/1396] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 17:18:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:18:09.562860 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15a71ab-2554-43a7-82a7-24277e02577e None None] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:09.563412 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15a71ab-2554-43a7-82a7-24277e02577e None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:09.563713 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15a71ab-2554-43a7-82a7-24277e02577e None None] PATH_INFO: `/` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:09.566684 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 696/1397] 10.222.0.39 () {54 vars in 962 bytes} [Thu Jun 16 17:18:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:18:09.571786 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a911df-ca6d-4674-8932-381c1ddf5192 None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:09.572084 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a911df-ca6d-4674-8932-381c1ddf5192 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:09.572370 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a911df-ca6d-4674-8932-381c1ddf5192 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:09.623220 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-83a911df-ca6d-4674-8932-381c1ddf5192 None None] MFA Rules not processed for user `3985eae1ec3240129eec8d1f4d8d21e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:18:09.624436 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-83a911df-ca6d-4674-8932-381c1ddf5192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:18:09.686388 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 702/1398] 10.222.0.39 () {58 vars in 1059 bytes} [Thu Jun 16 17:18:09 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:18:09.693901 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15a71ab-2554-43a7-82a7-24277e02577e None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:18:09.704484 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15a71ab-2554-43a7-82a7-24277e02577e None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:18:09.708036 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf77dab8-62ef-494e-8e52-3ab45263d82e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3985eae1ec3240129eec8d1f4d8d21e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:18:09.708997 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf77dab8-62ef-494e-8e52-3ab45263d82e service glance] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:09.708997 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf77dab8-62ef-494e-8e52-3ab45263d82e service glance] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:09.709229 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf77dab8-62ef-494e-8e52-3ab45263d82e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:09.718795 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf77dab8-62ef-494e-8e52-3ab45263d82e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:18:09.720133 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf77dab8-62ef-494e-8e52-3ab45263d82e service glance] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:18:09.730646 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 697/1399] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:18:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:18:09.887714 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a57f17-787c-4c1a-ad15-cce1e105a293 None None] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:09.889311 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a57f17-787c-4c1a-ad15-cce1e105a293 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:09.889311 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a57f17-787c-4c1a-ad15-cce1e105a293 None None] PATH_INFO: `/` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:09.889666 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 703/1400] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 17:18:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:18:09.895506 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a52b88-b5a3-480c-87e2-044db955701b None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:09.895801 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a52b88-b5a3-480c-87e2-044db955701b None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:09.896085 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a52b88-b5a3-480c-87e2-044db955701b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:09.915889 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-96a52b88-b5a3-480c-87e2-044db955701b None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:18:09.918135 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-96a52b88-b5a3-480c-87e2-044db955701b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:18:09.928736 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 698/1401] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 17:18:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:18:09.975796 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a57f17-787c-4c1a-ad15-cce1e105a293 None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:18:09.990168 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a57f17-787c-4c1a-ad15-cce1e105a293 None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:18:09.995700 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adc7251-9231-4d89-acde-ff06c07b3232 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d381bb41dea4f1e90c3cf3815ac88dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:18:09.996337 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adc7251-9231-4d89-acde-ff06c07b3232 service nova] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:09.996630 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adc7251-9231-4d89-acde-ff06c07b3232 service nova] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:09.996912 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adc7251-9231-4d89-acde-ff06c07b3232 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:10.005268 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adc7251-9231-4d89-acde-ff06c07b3232 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:18:10.006878 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adc7251-9231-4d89-acde-ff06c07b3232 service nova] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:18:10.016625 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 704/1402] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:18:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:18:10.616522 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff74d3a-252e-4230-8c42-3b50017e3080 None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:10.617033 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff74d3a-252e-4230-8c42-3b50017e3080 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:10.617139 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff74d3a-252e-4230-8c42-3b50017e3080 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:10.667141 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-3ff74d3a-252e-4230-8c42-3b50017e3080 None None] MFA Rules not processed for user `f7f35c1c15a84a92863d4f3f96d76830`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:18:10.668405 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-3ff74d3a-252e-4230-8c42-3b50017e3080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:18:10.701705 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:18:10.734066 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 699/1403] 10.222.0.39 () {58 vars in 1009 bytes} [Thu Jun 16 17:18:10 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:18:10.776569 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41608d05-273a-4a2f-ac3d-824bd9e8f453 None None] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:10.777056 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41608d05-273a-4a2f-ac3d-824bd9e8f453 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:10.777284 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41608d05-273a-4a2f-ac3d-824bd9e8f453 None None] PATH_INFO: `/` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:10.778737 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 705/1404] 10.222.0.39 () {54 vars in 942 bytes} [Thu Jun 16 17:18:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:18:10.785585 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e109c9-d02a-4e52-9dd3-b3edc9a7912c None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:10.785920 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e109c9-d02a-4e52-9dd3-b3edc9a7912c None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:10.786305 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e109c9-d02a-4e52-9dd3-b3edc9a7912c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:10.834090 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-35e109c9-d02a-4e52-9dd3-b3edc9a7912c None None] MFA Rules not processed for user `bbec2dfe63764ed88a23e172ead0afa4`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:18:10.835293 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-35e109c9-d02a-4e52-9dd3-b3edc9a7912c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:18:10.914143 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 700/1405] 10.222.0.39 () {58 vars in 1039 bytes} [Thu Jun 16 17:18:10 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:18:10.923545 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41608d05-273a-4a2f-ac3d-824bd9e8f453 None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:18:10.937379 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41608d05-273a-4a2f-ac3d-824bd9e8f453 None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:18:10.943078 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41081387-78ac-403a-ad99-5b6b9cb566be service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbec2dfe63764ed88a23e172ead0afa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:18:10.943764 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41081387-78ac-403a-ad99-5b6b9cb566be service swift] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:10.944048 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41081387-78ac-403a-ad99-5b6b9cb566be service swift] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:10.944324 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41081387-78ac-403a-ad99-5b6b9cb566be service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:10.953276 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41081387-78ac-403a-ad99-5b6b9cb566be service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:18:10.954946 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41081387-78ac-403a-ad99-5b6b9cb566be service swift] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:18:10.963966 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 706/1406] 10.222.0.39 () {60 vars in 1384 bytes} [Thu Jun 16 17:18:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 17:18:12.437567 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b2440d-c8e6-4527-962e-2f905946e105 None None] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:12.438151 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b2440d-c8e6-4527-962e-2f905946e105 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:12.438260 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b2440d-c8e6-4527-962e-2f905946e105 None None] PATH_INFO: `/` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:12.440573 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 701/1407] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 17:18:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:18:12.445023 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df43267-a020-4889-91d6-7ffc7707475c None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:12.445553 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df43267-a020-4889-91d6-7ffc7707475c None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:12.445553 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df43267-a020-4889-91d6-7ffc7707475c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:12.463879 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-7df43267-a020-4889-91d6-7ffc7707475c None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:18:12.465414 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-7df43267-a020-4889-91d6-7ffc7707475c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:18:12.484356 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 707/1408] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 17:18:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:18:12.529961 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b2440d-c8e6-4527-962e-2f905946e105 None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:18:12.546205 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b2440d-c8e6-4527-962e-2f905946e105 None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:18:12.552668 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2310727b-4eb9-4077-b9ab-cfd2f136af32 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d381bb41dea4f1e90c3cf3815ac88dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:18:12.553318 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2310727b-4eb9-4077-b9ab-cfd2f136af32 service nova] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:12.553605 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2310727b-4eb9-4077-b9ab-cfd2f136af32 service nova] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:12.554176 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2310727b-4eb9-4077-b9ab-cfd2f136af32 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:12.563357 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2310727b-4eb9-4077-b9ab-cfd2f136af32 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:18:12.565290 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2310727b-4eb9-4077-b9ab-cfd2f136af32 service nova] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:18:12.632883 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 702/1409] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:18:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:18:22.458601 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=55 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:18:22.572340 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=62 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:18:35.476119 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b52bab-954a-4681-8621-d5da160b77f6 None None] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:35.476739 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b52bab-954a-4681-8621-d5da160b77f6 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:35.476739 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b52bab-954a-4681-8621-d5da160b77f6 None None] PATH_INFO: `/` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:35.478097 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 708/1410] 10.222.0.39 () {54 vars in 918 bytes} [Thu Jun 16 17:18:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:18:35.483240 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8593a753-b49b-46b1-a936-89dbeb545362 None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:35.483728 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8593a753-b49b-46b1-a936-89dbeb545362 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:35.483837 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8593a753-b49b-46b1-a936-89dbeb545362 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:35.504028 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-8593a753-b49b-46b1-a936-89dbeb545362 None None] MFA Rules not processed for user `2882f26811094d8e88c03701c94296fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:18:35.505345 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-8593a753-b49b-46b1-a936-89dbeb545362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:18:35.514560 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 703/1411] 10.222.0.39 () {58 vars in 1015 bytes} [Thu Jun 16 17:18:35 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:18:35.529177 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e106a9-c805-4600-a362-95d9225bb728 None None] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:35.529540 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e106a9-c805-4600-a362-95d9225bb728 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:35.529930 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e106a9-c805-4600-a362-95d9225bb728 None None] PATH_INFO: `/` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:35.531566 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 709/1412] 10.222.0.39 () {54 vars in 918 bytes} [Thu Jun 16 17:18:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:18:35.536679 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02deca5f-225c-40b5-8587-714aefdc0418 None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:35.536976 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02deca5f-225c-40b5-8587-714aefdc0418 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:35.537260 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02deca5f-225c-40b5-8587-714aefdc0418 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:35.557193 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-02deca5f-225c-40b5-8587-714aefdc0418 None None] MFA Rules not processed for user `3d381bb41dea4f1e90c3cf3815ac88dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:18:35.558440 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-02deca5f-225c-40b5-8587-714aefdc0418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:18:35.573486 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 704/1413] 10.222.0.39 () {58 vars in 1015 bytes} [Thu Jun 16 17:18:35 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:18:38.175424 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36593ca9-f5bc-4c50-a5f9-9a3f93683b21 None None] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:38.175945 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36593ca9-f5bc-4c50-a5f9-9a3f93683b21 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:38.175945 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36593ca9-f5bc-4c50-a5f9-9a3f93683b21 None None] PATH_INFO: `/` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:38.177258 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 710/1414] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 17:18:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:18:38.182635 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d274f3-a0a2-4bb7-b8a5-c67e4b467b9e None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:38.185358 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d274f3-a0a2-4bb7-b8a5-c67e4b467b9e None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:38.185358 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d274f3-a0a2-4bb7-b8a5-c67e4b467b9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:38.201005 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-87d274f3-a0a2-4bb7-b8a5-c67e4b467b9e None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:18:38.202245 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-87d274f3-a0a2-4bb7-b8a5-c67e4b467b9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:18:38.210802 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 705/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 17:18:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:18:38.255335 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36593ca9-f5bc-4c50-a5f9-9a3f93683b21 None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:18:38.270200 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36593ca9-f5bc-4c50-a5f9-9a3f93683b21 None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:18:38.275689 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d6b015-6827-4fa0-a49d-450e43e983b2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d381bb41dea4f1e90c3cf3815ac88dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:18:38.276320 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d6b015-6827-4fa0-a49d-450e43e983b2 service nova] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:38.276607 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d6b015-6827-4fa0-a49d-450e43e983b2 service nova] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:38.276887 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d6b015-6827-4fa0-a49d-450e43e983b2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:38.285722 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d6b015-6827-4fa0-a49d-450e43e983b2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:18:38.287315 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d6b015-6827-4fa0-a49d-450e43e983b2 service nova] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:18:38.296703 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 711/1416] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:18:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:18:39.254483 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f11f3c-9e22-4d9c-9385-b3d66f425cf4 None None] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:39.255015 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f11f3c-9e22-4d9c-9385-b3d66f425cf4 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:39.255015 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f11f3c-9e22-4d9c-9385-b3d66f425cf4 None None] PATH_INFO: `/` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:39.256352 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 706/1417] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 16 17:18:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:18:39.261363 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9979310f-3542-43d5-a0f0-4999d0612330 None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:39.261797 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9979310f-3542-43d5-a0f0-4999d0612330 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:39.261970 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9979310f-3542-43d5-a0f0-4999d0612330 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:39.280273 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-9979310f-3542-43d5-a0f0-4999d0612330 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:18:39.281480 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-9979310f-3542-43d5-a0f0-4999d0612330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:18:39.289365 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 712/1418] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 16 17:18:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:18:39.462738 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f11f3c-9e22-4d9c-9385-b3d66f425cf4 None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:18:39.476976 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f11f3c-9e22-4d9c-9385-b3d66f425cf4 None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:18:39.482280 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bdfc60-97c3-4f8b-8bd1-6329c0f77d2a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d381bb41dea4f1e90c3cf3815ac88dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:18:39.488872 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bdfc60-97c3-4f8b-8bd1-6329c0f77d2a service nova] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:39.488872 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bdfc60-97c3-4f8b-8bd1-6329c0f77d2a service nova] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:39.488872 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bdfc60-97c3-4f8b-8bd1-6329c0f77d2a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:39.491924 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bdfc60-97c3-4f8b-8bd1-6329c0f77d2a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:18:39.493486 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bdfc60-97c3-4f8b-8bd1-6329c0f77d2a service nova] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:18:39.503434 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 707/1419] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:18:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:18:40.433747 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2774df50-6c5c-448f-b714-84d84c63e95b None None] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:40.434340 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2774df50-6c5c-448f-b714-84d84c63e95b None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:40.434451 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2774df50-6c5c-448f-b714-84d84c63e95b None None] PATH_INFO: `/` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:40.435812 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 713/1420] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 16 17:18:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:18:40.440659 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dd1adc-0223-48eb-a46e-e79e9d8096ef None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:40.441118 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dd1adc-0223-48eb-a46e-e79e9d8096ef None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:40.441224 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dd1adc-0223-48eb-a46e-e79e9d8096ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:40.459762 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-b6dd1adc-0223-48eb-a46e-e79e9d8096ef None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:18:40.460981 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-b6dd1adc-0223-48eb-a46e-e79e9d8096ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:18:40.469161 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 708/1421] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 16 17:18:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:18:40.620785 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2774df50-6c5c-448f-b714-84d84c63e95b None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:18:40.635702 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2774df50-6c5c-448f-b714-84d84c63e95b None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:18:40.641220 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdf1e46-b26e-45df-9caa-965eca59d782 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d381bb41dea4f1e90c3cf3815ac88dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:18:40.641903 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdf1e46-b26e-45df-9caa-965eca59d782 service nova] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:40.642202 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdf1e46-b26e-45df-9caa-965eca59d782 service nova] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:40.643130 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdf1e46-b26e-45df-9caa-965eca59d782 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:40.653165 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdf1e46-b26e-45df-9caa-965eca59d782 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:18:40.654827 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdf1e46-b26e-45df-9caa-965eca59d782 service nova] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:18:40.664675 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 714/1422] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:18:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:18:41.574240 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64e255c-3eb5-4dfe-9c1d-a73248bf6994 None None] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:41.574814 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64e255c-3eb5-4dfe-9c1d-a73248bf6994 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:41.574814 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64e255c-3eb5-4dfe-9c1d-a73248bf6994 None None] PATH_INFO: `/` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:41.576190 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 709/1423] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 16 17:18:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:18:41.581890 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e1c4b2-13cf-4261-aeb6-15b35b2bb79c None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:41.582295 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e1c4b2-13cf-4261-aeb6-15b35b2bb79c None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:41.582464 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e1c4b2-13cf-4261-aeb6-15b35b2bb79c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:41.600449 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-93e1c4b2-13cf-4261-aeb6-15b35b2bb79c None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:18:41.601968 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-93e1c4b2-13cf-4261-aeb6-15b35b2bb79c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:18:41.609710 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 715/1424] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 16 17:18:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:18:41.760728 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64e255c-3eb5-4dfe-9c1d-a73248bf6994 None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:18:41.775054 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64e255c-3eb5-4dfe-9c1d-a73248bf6994 None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:18:41.780367 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df7a617-cf07-4c07-a4d2-f1617c1ebffe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d381bb41dea4f1e90c3cf3815ac88dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:18:41.780999 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df7a617-cf07-4c07-a4d2-f1617c1ebffe service nova] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:41.781283 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df7a617-cf07-4c07-a4d2-f1617c1ebffe service nova] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:41.781558 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df7a617-cf07-4c07-a4d2-f1617c1ebffe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:41.789785 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df7a617-cf07-4c07-a4d2-f1617c1ebffe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:18:41.791349 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df7a617-cf07-4c07-a4d2-f1617c1ebffe service nova] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:18:41.801081 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 710/1425] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:18:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:18:42.728806 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c88f70-e592-477e-b69f-2ed0db679e7e None None] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:42.729380 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c88f70-e592-477e-b69f-2ed0db679e7e None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:42.729380 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c88f70-e592-477e-b69f-2ed0db679e7e None None] PATH_INFO: `/` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:42.730809 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 716/1426] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 16 17:18:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:18:42.735577 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b092610-c766-47b3-8e0b-2a5a89db3f3e None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:42.736145 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b092610-c766-47b3-8e0b-2a5a89db3f3e None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:42.736145 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b092610-c766-47b3-8e0b-2a5a89db3f3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:42.753981 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-0b092610-c766-47b3-8e0b-2a5a89db3f3e None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:18:42.755181 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-0b092610-c766-47b3-8e0b-2a5a89db3f3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:18:42.762981 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 711/1427] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 16 17:18:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:18:42.919531 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c88f70-e592-477e-b69f-2ed0db679e7e None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:18:42.933908 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c88f70-e592-477e-b69f-2ed0db679e7e None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:18:42.939917 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146ada71-34a1-48bb-87b3-c8ac6f7c5299 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d381bb41dea4f1e90c3cf3815ac88dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:18:42.940559 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146ada71-34a1-48bb-87b3-c8ac6f7c5299 service nova] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:42.940850 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146ada71-34a1-48bb-87b3-c8ac6f7c5299 service nova] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:42.941134 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146ada71-34a1-48bb-87b3-c8ac6f7c5299 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:42.949366 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146ada71-34a1-48bb-87b3-c8ac6f7c5299 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:18:42.950985 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146ada71-34a1-48bb-87b3-c8ac6f7c5299 service nova] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:18:42.961081 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 717/1428] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:18:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:18:43.890560 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b768e3-2578-4abb-bcf9-43f687877b39 None None] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:43.891118 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b768e3-2578-4abb-bcf9-43f687877b39 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:43.891118 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b768e3-2578-4abb-bcf9-43f687877b39 None None] PATH_INFO: `/` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:43.892558 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 712/1429] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 16 17:18:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:18:43.897610 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63509e53-4a9e-4572-89be-10e5f1e4fc7f None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:43.898095 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63509e53-4a9e-4572-89be-10e5f1e4fc7f None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:43.898301 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63509e53-4a9e-4572-89be-10e5f1e4fc7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:43.916953 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-63509e53-4a9e-4572-89be-10e5f1e4fc7f None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:18:43.918198 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-63509e53-4a9e-4572-89be-10e5f1e4fc7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:18:43.926815 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 718/1430] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 16 17:18:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:18:44.088729 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b768e3-2578-4abb-bcf9-43f687877b39 None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:18:44.107004 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b768e3-2578-4abb-bcf9-43f687877b39 None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:18:44.113208 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497d5cf0-b4a1-4abc-805b-5ad460a6dc13 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d381bb41dea4f1e90c3cf3815ac88dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:18:44.113877 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497d5cf0-b4a1-4abc-805b-5ad460a6dc13 service nova] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:44.114162 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497d5cf0-b4a1-4abc-805b-5ad460a6dc13 service nova] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:44.114441 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497d5cf0-b4a1-4abc-805b-5ad460a6dc13 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:44.123190 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497d5cf0-b4a1-4abc-805b-5ad460a6dc13 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:18:44.124759 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497d5cf0-b4a1-4abc-805b-5ad460a6dc13 service nova] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:18:44.134129 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 713/1431] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:18:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:18:45.153524 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66786aed-59b2-4e72-a4ce-1e10a790f6d6 None None] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:45.153524 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66786aed-59b2-4e72-a4ce-1e10a790f6d6 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:45.153524 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66786aed-59b2-4e72-a4ce-1e10a790f6d6 None None] PATH_INFO: `/` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:45.153524 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 719/1432] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 16 17:18:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:18:45.154403 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cf97ee-86aa-4245-b7a8-3ffc3e2d6cf5 None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:45.154403 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cf97ee-86aa-4245-b7a8-3ffc3e2d6cf5 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:45.154403 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cf97ee-86aa-4245-b7a8-3ffc3e2d6cf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:45.171198 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-c3cf97ee-86aa-4245-b7a8-3ffc3e2d6cf5 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:18:45.172380 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-c3cf97ee-86aa-4245-b7a8-3ffc3e2d6cf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:18:45.180999 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 714/1433] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 16 17:18:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:18:45.332009 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66786aed-59b2-4e72-a4ce-1e10a790f6d6 None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:18:45.346891 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66786aed-59b2-4e72-a4ce-1e10a790f6d6 None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:18:45.352363 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8fac3b-4490-4bcd-b9a0-e54ecc81fb1a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d381bb41dea4f1e90c3cf3815ac88dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:18:45.352987 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8fac3b-4490-4bcd-b9a0-e54ecc81fb1a service nova] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:45.353264 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8fac3b-4490-4bcd-b9a0-e54ecc81fb1a service nova] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:45.353544 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8fac3b-4490-4bcd-b9a0-e54ecc81fb1a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:45.362065 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8fac3b-4490-4bcd-b9a0-e54ecc81fb1a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:18:45.363627 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8fac3b-4490-4bcd-b9a0-e54ecc81fb1a service nova] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:18:45.372868 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 720/1434] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:18:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:18:46.308775 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78227faa-6207-4b18-b73b-3b7e97cc7a03 None None] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:46.309329 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78227faa-6207-4b18-b73b-3b7e97cc7a03 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:46.309329 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78227faa-6207-4b18-b73b-3b7e97cc7a03 None None] PATH_INFO: `/` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:46.310728 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 715/1435] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 16 17:18:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:18:46.316154 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9852324-963c-429f-9e79-ec4b976231f0 None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:46.316592 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9852324-963c-429f-9e79-ec4b976231f0 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:46.316724 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9852324-963c-429f-9e79-ec4b976231f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:46.334734 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-e9852324-963c-429f-9e79-ec4b976231f0 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:18:46.336058 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-e9852324-963c-429f-9e79-ec4b976231f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:18:46.344235 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 721/1436] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 16 17:18:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:18:46.496951 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78227faa-6207-4b18-b73b-3b7e97cc7a03 None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:18:46.511324 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78227faa-6207-4b18-b73b-3b7e97cc7a03 None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:18:46.516716 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70802b7f-6081-42c7-9453-26fe87be2dca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d381bb41dea4f1e90c3cf3815ac88dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:18:46.517895 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70802b7f-6081-42c7-9453-26fe87be2dca service nova] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:46.518212 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70802b7f-6081-42c7-9453-26fe87be2dca service nova] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:46.518502 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70802b7f-6081-42c7-9453-26fe87be2dca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:46.527078 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70802b7f-6081-42c7-9453-26fe87be2dca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:18:46.528645 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70802b7f-6081-42c7-9453-26fe87be2dca service nova] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:18:46.538719 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 716/1437] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:18:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:18:47.448001 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7833b1d5-6620-4bf3-b07f-775e525af194 None None] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:47.448585 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7833b1d5-6620-4bf3-b07f-775e525af194 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:47.448585 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7833b1d5-6620-4bf3-b07f-775e525af194 None None] PATH_INFO: `/` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:47.450325 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 722/1438] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 16 17:18:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:18:47.455433 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ab6a95-2c50-4c5e-952f-4e9481e594a9 None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:47.455879 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ab6a95-2c50-4c5e-952f-4e9481e594a9 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:47.456000 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ab6a95-2c50-4c5e-952f-4e9481e594a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:47.474478 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-21ab6a95-2c50-4c5e-952f-4e9481e594a9 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:18:47.475671 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-21ab6a95-2c50-4c5e-952f-4e9481e594a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:18:47.483462 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 717/1439] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 16 17:18:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:18:47.635670 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7833b1d5-6620-4bf3-b07f-775e525af194 None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:18:47.650166 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7833b1d5-6620-4bf3-b07f-775e525af194 None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:18:47.655553 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1ce692-b8a6-41fb-89f3-bdeb35261ec9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d381bb41dea4f1e90c3cf3815ac88dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:18:47.656181 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1ce692-b8a6-41fb-89f3-bdeb35261ec9 service nova] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:47.656470 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1ce692-b8a6-41fb-89f3-bdeb35261ec9 service nova] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:47.656752 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1ce692-b8a6-41fb-89f3-bdeb35261ec9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:47.665451 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1ce692-b8a6-41fb-89f3-bdeb35261ec9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:18:47.667067 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1ce692-b8a6-41fb-89f3-bdeb35261ec9 service nova] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:18:47.676992 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 723/1440] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:18:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:18:49.700490 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66110396-2dc1-4803-8a83-e8257fb7df36 None None] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:49.701078 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66110396-2dc1-4803-8a83-e8257fb7df36 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:49.701078 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66110396-2dc1-4803-8a83-e8257fb7df36 None None] PATH_INFO: `/` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:49.702551 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 718/1441] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 17:18:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:18:49.707829 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce7297d-25b6-4705-964d-a97b752913b1 None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:49.708235 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce7297d-25b6-4705-964d-a97b752913b1 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:49.708403 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce7297d-25b6-4705-964d-a97b752913b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:49.726967 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-9ce7297d-25b6-4705-964d-a97b752913b1 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:18:49.728153 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-9ce7297d-25b6-4705-964d-a97b752913b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:18:49.736453 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 724/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 17:18:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:18:49.774288 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66110396-2dc1-4803-8a83-e8257fb7df36 None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:18:49.785591 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66110396-2dc1-4803-8a83-e8257fb7df36 None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:18:49.789212 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27950a4f-b937-4343-9c0e-a009b431c03d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5d25bfa8dc042329d57cd55fa7b7b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:18:49.789878 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27950a4f-b937-4343-9c0e-a009b431c03d service neutron] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:49.790164 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27950a4f-b937-4343-9c0e-a009b431c03d service neutron] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:49.790441 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27950a4f-b937-4343-9c0e-a009b431c03d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:49.799912 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27950a4f-b937-4343-9c0e-a009b431c03d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:18:49.801319 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27950a4f-b937-4343-9c0e-a009b431c03d service neutron] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:18:49.810675 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 719/1443] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:18:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 17:18:52.101483 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceacf558-68b4-4a81-aeb4-61cc30a61bff None None] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:52.102104 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceacf558-68b4-4a81-aeb4-61cc30a61bff None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:52.102104 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceacf558-68b4-4a81-aeb4-61cc30a61bff None None] PATH_INFO: `/` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:52.103455 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 725/1444] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 17:18:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:18:52.108665 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83004a0-5d17-4a38-afe5-6e8a9eee9b24 None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:52.109077 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83004a0-5d17-4a38-afe5-6e8a9eee9b24 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:52.109277 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83004a0-5d17-4a38-afe5-6e8a9eee9b24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:52.127366 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-a83004a0-5d17-4a38-afe5-6e8a9eee9b24 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:18:52.128569 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-a83004a0-5d17-4a38-afe5-6e8a9eee9b24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:18:52.136419 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 720/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 17:18:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:18:52.174480 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceacf558-68b4-4a81-aeb4-61cc30a61bff None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:18:52.186074 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceacf558-68b4-4a81-aeb4-61cc30a61bff None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:18:52.190254 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ac7e1a-5a15-4253-bdc4-4c3a31d82960 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5d25bfa8dc042329d57cd55fa7b7b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:18:52.190921 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ac7e1a-5a15-4253-bdc4-4c3a31d82960 service neutron] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:52.191230 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ac7e1a-5a15-4253-bdc4-4c3a31d82960 service neutron] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:52.191532 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ac7e1a-5a15-4253-bdc4-4c3a31d82960 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:52.200502 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ac7e1a-5a15-4253-bdc4-4c3a31d82960 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:18:52.201967 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ac7e1a-5a15-4253-bdc4-4c3a31d82960 service neutron] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:18:52.212002 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 726/1446] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:18:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:18:54.824270 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef6544f-f8d4-43f7-affd-0f0224f07e5e None None] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:54.824861 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef6544f-f8d4-43f7-affd-0f0224f07e5e None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:54.824861 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef6544f-f8d4-43f7-affd-0f0224f07e5e None None] PATH_INFO: `/` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:54.826308 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 721/1447] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 17:18:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 17:18:54.832173 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6736fbd2-d17c-4044-a683-c917d30159c1 None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:54.832595 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6736fbd2-d17c-4044-a683-c917d30159c1 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:54.832746 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6736fbd2-d17c-4044-a683-c917d30159c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:54.850946 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-6736fbd2-d17c-4044-a683-c917d30159c1 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:18:54.852070 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-6736fbd2-d17c-4044-a683-c917d30159c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:18:54.859807 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 727/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 17:18:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:18:54.898756 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef6544f-f8d4-43f7-affd-0f0224f07e5e None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:18:54.909332 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef6544f-f8d4-43f7-affd-0f0224f07e5e None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:18:54.912809 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f2f456-3bb7-4c45-972d-fa6ce1b784ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5d25bfa8dc042329d57cd55fa7b7b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:18:54.913590 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f2f456-3bb7-4c45-972d-fa6ce1b784ac service neutron] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:54.913902 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f2f456-3bb7-4c45-972d-fa6ce1b784ac service neutron] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:54.914181 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f2f456-3bb7-4c45-972d-fa6ce1b784ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:54.922949 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f2f456-3bb7-4c45-972d-fa6ce1b784ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:18:54.924359 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f2f456-3bb7-4c45-972d-fa6ce1b784ac service neutron] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:18:54.933690 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 722/1449] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:18:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:18:57.199307 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daf1c32-24fd-434b-910d-6629db5d1a39 None None] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:57.200073 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daf1c32-24fd-434b-910d-6629db5d1a39 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:57.200556 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daf1c32-24fd-434b-910d-6629db5d1a39 None None] PATH_INFO: `/` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:57.203320 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 728/1450] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 17:18:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:18:57.209727 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80adb3da-0cfb-443c-a532-27c72d6b0980 None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:57.210344 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80adb3da-0cfb-443c-a532-27c72d6b0980 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:57.210344 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80adb3da-0cfb-443c-a532-27c72d6b0980 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:57.228049 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-80adb3da-0cfb-443c-a532-27c72d6b0980 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:18:57.229237 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-80adb3da-0cfb-443c-a532-27c72d6b0980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:18:57.236968 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 723/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 17:18:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:18:57.276120 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daf1c32-24fd-434b-910d-6629db5d1a39 None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:18:57.286879 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daf1c32-24fd-434b-910d-6629db5d1a39 None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:18:57.290389 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2da1c8c-a32b-4a51-b740-1de7a10446c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5d25bfa8dc042329d57cd55fa7b7b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:18:57.291023 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2da1c8c-a32b-4a51-b740-1de7a10446c9 service neutron] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:57.291315 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2da1c8c-a32b-4a51-b740-1de7a10446c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:57.291599 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2da1c8c-a32b-4a51-b740-1de7a10446c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:57.301027 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2da1c8c-a32b-4a51-b740-1de7a10446c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:18:57.302492 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2da1c8c-a32b-4a51-b740-1de7a10446c9 service neutron] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:18:57.311988 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 729/1452] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:18:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:18:59.503616 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be6c2b6-5c3d-42e0-96ec-271c1d5cf94c None None] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:59.504205 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be6c2b6-5c3d-42e0-96ec-271c1d5cf94c None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:59.504205 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be6c2b6-5c3d-42e0-96ec-271c1d5cf94c None None] PATH_INFO: `/` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:59.505590 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 724/1453] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 17:18:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:18:59.511731 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96907b44-518d-4cda-94fc-bf94d4923749 None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:59.512280 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96907b44-518d-4cda-94fc-bf94d4923749 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:59.512280 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96907b44-518d-4cda-94fc-bf94d4923749 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:59.532152 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-96907b44-518d-4cda-94fc-bf94d4923749 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:18:59.534218 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-96907b44-518d-4cda-94fc-bf94d4923749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:18:59.543125 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 730/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 17:18:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:18:59.584559 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be6c2b6-5c3d-42e0-96ec-271c1d5cf94c None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:18:59.595880 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be6c2b6-5c3d-42e0-96ec-271c1d5cf94c None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:18:59.599417 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b070a5f-81fc-43f8-9e82-68961f18f1b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5d25bfa8dc042329d57cd55fa7b7b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:18:59.600054 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b070a5f-81fc-43f8-9e82-68961f18f1b7 service neutron] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:59.600343 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b070a5f-81fc-43f8-9e82-68961f18f1b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:59.600630 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b070a5f-81fc-43f8-9e82-68961f18f1b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:59.609813 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b070a5f-81fc-43f8-9e82-68961f18f1b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:18:59.611269 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b070a5f-81fc-43f8-9e82-68961f18f1b7 service neutron] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:18:59.621292 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 725/1455] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:18:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:19:01.810771 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413817c8-57c3-4f4e-8a65-bd80e2ce4984 None None] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:19:01.811352 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413817c8-57c3-4f4e-8a65-bd80e2ce4984 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:19:01.811352 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413817c8-57c3-4f4e-8a65-bd80e2ce4984 None None] PATH_INFO: `/` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:19:01.812678 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 731/1456] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 17:19:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:19:01.818768 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889a6c80-9e2f-48ad-8443-ac0ec1ec7368 None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:19:01.819232 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889a6c80-9e2f-48ad-8443-ac0ec1ec7368 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:19:01.819568 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889a6c80-9e2f-48ad-8443-ac0ec1ec7368 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:19:01.837828 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-889a6c80-9e2f-48ad-8443-ac0ec1ec7368 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:19:01.839065 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-889a6c80-9e2f-48ad-8443-ac0ec1ec7368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:19:01.847384 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 726/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 17:19:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:19:01.886386 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413817c8-57c3-4f4e-8a65-bd80e2ce4984 None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:19:01.898655 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413817c8-57c3-4f4e-8a65-bd80e2ce4984 None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:19:01.902253 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf12975-5988-4354-8292-3c7f1011366c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5d25bfa8dc042329d57cd55fa7b7b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:19:01.902905 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf12975-5988-4354-8292-3c7f1011366c service neutron] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:19:01.903197 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf12975-5988-4354-8292-3c7f1011366c service neutron] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:19:01.903482 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf12975-5988-4354-8292-3c7f1011366c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:19:01.912798 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf12975-5988-4354-8292-3c7f1011366c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:19:01.914445 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf12975-5988-4354-8292-3c7f1011366c service neutron] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:19:01.924375 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 732/1458] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:19:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:19:04.120346 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdbcbd4-c887-488b-aeb8-a19f077fb171 None None] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:19:04.120935 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdbcbd4-c887-488b-aeb8-a19f077fb171 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:19:04.120935 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdbcbd4-c887-488b-aeb8-a19f077fb171 None None] PATH_INFO: `/` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:19:04.122341 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 727/1459] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 17:19:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:19:04.128061 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65632157-74f4-4a62-8bba-d90cee8d07eb None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:19:04.128509 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65632157-74f4-4a62-8bba-d90cee8d07eb None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:19:04.128641 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65632157-74f4-4a62-8bba-d90cee8d07eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:19:04.134811 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=70 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:19:04.152752 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-65632157-74f4-4a62-8bba-d90cee8d07eb None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:19:04.152752 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-65632157-74f4-4a62-8bba-d90cee8d07eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:19:04.156515 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 733/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 17:19:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:19:04.194535 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdbcbd4-c887-488b-aeb8-a19f077fb171 None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:19:04.199640 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=73 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:19:04.205890 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdbcbd4-c887-488b-aeb8-a19f077fb171 None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:19:04.210122 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33abd94-5bc5-40e7-8274-90477e6c51e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5d25bfa8dc042329d57cd55fa7b7b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:19:04.210122 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33abd94-5bc5-40e7-8274-90477e6c51e1 service neutron] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:19:04.210431 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33abd94-5bc5-40e7-8274-90477e6c51e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:19:04.210716 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33abd94-5bc5-40e7-8274-90477e6c51e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:19:04.219983 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33abd94-5bc5-40e7-8274-90477e6c51e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:19:04.221451 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33abd94-5bc5-40e7-8274-90477e6c51e1 service neutron] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:19:04.231202 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 728/1461] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:19:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:19:06.401348 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b55a89-57bd-4335-bbb0-e8974f5349d2 None None] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:19:06.401905 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b55a89-57bd-4335-bbb0-e8974f5349d2 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:19:06.402037 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b55a89-57bd-4335-bbb0-e8974f5349d2 None None] PATH_INFO: `/` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:19:06.403309 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 734/1462] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 17:19:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:19:06.408556 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e96d625-6955-4329-b459-d3ccb37b8706 None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:19:06.408974 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e96d625-6955-4329-b459-d3ccb37b8706 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:19:06.409127 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e96d625-6955-4329-b459-d3ccb37b8706 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:19:06.426623 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-0e96d625-6955-4329-b459-d3ccb37b8706 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:19:06.427825 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-0e96d625-6955-4329-b459-d3ccb37b8706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:19:06.435666 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 729/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 17:19:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 17:19:06.473448 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b55a89-57bd-4335-bbb0-e8974f5349d2 None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:19:06.484334 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b55a89-57bd-4335-bbb0-e8974f5349d2 None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:19:06.488530 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6eb2b52-5f8a-4e85-b3ef-763dc3024fdb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5d25bfa8dc042329d57cd55fa7b7b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:19:06.489167 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eb2b52-5f8a-4e85-b3ef-763dc3024fdb service neutron] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:19:06.489458 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eb2b52-5f8a-4e85-b3ef-763dc3024fdb service neutron] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:19:06.489737 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eb2b52-5f8a-4e85-b3ef-763dc3024fdb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:19:06.498629 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6eb2b52-5f8a-4e85-b3ef-763dc3024fdb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:19:06.500052 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6eb2b52-5f8a-4e85-b3ef-763dc3024fdb service neutron] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:19:06.510105 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 735/1464] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:19:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:19:08.719642 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b0b19c-4ca1-417f-b0ed-2b2140639405 None None] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:19:08.720198 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b0b19c-4ca1-417f-b0ed-2b2140639405 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:19:08.720198 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b0b19c-4ca1-417f-b0ed-2b2140639405 None None] PATH_INFO: `/` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:19:08.721603 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 730/1465] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 17:19:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:19:08.727169 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f376e47c-b11f-462f-b583-804e99f3dbf2 None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:19:08.727576 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f376e47c-b11f-462f-b583-804e99f3dbf2 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:19:08.727743 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f376e47c-b11f-462f-b583-804e99f3dbf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:19:08.746105 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-f376e47c-b11f-462f-b583-804e99f3dbf2 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:19:08.747313 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-f376e47c-b11f-462f-b583-804e99f3dbf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:19:08.755802 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 736/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 17:19:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:19:08.791497 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b0b19c-4ca1-417f-b0ed-2b2140639405 None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:19:08.802750 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b0b19c-4ca1-417f-b0ed-2b2140639405 None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:19:08.806329 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c41412-8be6-4090-a439-0fcaff634c34 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5d25bfa8dc042329d57cd55fa7b7b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:19:08.806935 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c41412-8be6-4090-a439-0fcaff634c34 service neutron] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:19:08.807224 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c41412-8be6-4090-a439-0fcaff634c34 service neutron] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:19:08.807507 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c41412-8be6-4090-a439-0fcaff634c34 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:19:08.817009 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c41412-8be6-4090-a439-0fcaff634c34 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:19:08.818463 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c41412-8be6-4090-a439-0fcaff634c34 service neutron] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:19:08.827970 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 731/1467] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:19:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:19:11.003339 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace8ef5d-a10f-4263-b4da-af3c8a694823 None None] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:19:11.003936 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace8ef5d-a10f-4263-b4da-af3c8a694823 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:19:11.003936 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace8ef5d-a10f-4263-b4da-af3c8a694823 None None] PATH_INFO: `/` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:19:11.005312 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 737/1468] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 17:19:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:19:11.010520 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63cc11e-10fc-4c4b-81f5-2b32e869afac None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:19:11.010919 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63cc11e-10fc-4c4b-81f5-2b32e869afac None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:19:11.011090 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63cc11e-10fc-4c4b-81f5-2b32e869afac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:19:11.029250 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-c63cc11e-10fc-4c4b-81f5-2b32e869afac None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:19:11.030498 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-c63cc11e-10fc-4c4b-81f5-2b32e869afac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:19:11.039041 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 732/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 17:19:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:19:11.075505 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace8ef5d-a10f-4263-b4da-af3c8a694823 None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:19:11.086959 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace8ef5d-a10f-4263-b4da-af3c8a694823 None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:19:11.090514 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299db188-e186-4b6e-94d7-926cdff131e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5d25bfa8dc042329d57cd55fa7b7b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:19:11.091424 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299db188-e186-4b6e-94d7-926cdff131e5 service neutron] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:19:11.091712 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299db188-e186-4b6e-94d7-926cdff131e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:19:11.091997 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299db188-e186-4b6e-94d7-926cdff131e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:19:11.101519 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299db188-e186-4b6e-94d7-926cdff131e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:19:11.102983 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299db188-e186-4b6e-94d7-926cdff131e5 service neutron] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:19:11.112751 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 738/1470] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:19:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:19:21.024204 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=17 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:19:21.108157 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=17 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:19:31.256487 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024a0cc2-59b0-4bd2-a0d8-cc60ceb02482 None None] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:19:31.257060 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024a0cc2-59b0-4bd2-a0d8-cc60ceb02482 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:19:31.257060 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024a0cc2-59b0-4bd2-a0d8-cc60ceb02482 None None] PATH_INFO: `/` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:19:31.258404 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 733/1471] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 17:19:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:19:31.263428 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6dab50-ed84-4ac6-8e4b-69124eece75c None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:19:31.263876 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6dab50-ed84-4ac6-8e4b-69124eece75c None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:19:31.263985 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6dab50-ed84-4ac6-8e4b-69124eece75c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:19:31.281887 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-6a6dab50-ed84-4ac6-8e4b-69124eece75c None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:19:31.283086 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-6a6dab50-ed84-4ac6-8e4b-69124eece75c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:19:31.290990 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 739/1472] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 17:19:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:19:31.337855 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d327e8-8f87-4993-b840-5a622a76804b None None] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:19:31.338150 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d327e8-8f87-4993-b840-5a622a76804b None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:19:31.338430 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d327e8-8f87-4993-b840-5a622a76804b None None] PATH_INFO: `/` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:19:31.339789 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 734/1473] 10.222.0.39 () {54 vars in 962 bytes} [Thu Jun 16 17:19:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:19:31.344702 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c683bac4-2c10-4eb1-83b1-199b6afdfbd4 None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:19:31.344994 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c683bac4-2c10-4eb1-83b1-199b6afdfbd4 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:19:31.345273 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c683bac4-2c10-4eb1-83b1-199b6afdfbd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:19:31.364032 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-c683bac4-2c10-4eb1-83b1-199b6afdfbd4 None None] MFA Rules not processed for user `3985eae1ec3240129eec8d1f4d8d21e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:19:31.365224 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-c683bac4-2c10-4eb1-83b1-199b6afdfbd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:19:31.371578 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 740/1474] 10.222.0.39 () {58 vars in 1059 bytes} [Thu Jun 16 17:19:31 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:19:31.380138 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d327e8-8f87-4993-b840-5a622a76804b None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:19:31.391051 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d327e8-8f87-4993-b840-5a622a76804b None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:19:31.394532 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd2791e-b236-4cb9-9532-55c66b46c3fb service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3985eae1ec3240129eec8d1f4d8d21e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:19:31.395152 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd2791e-b236-4cb9-9532-55c66b46c3fb service glance] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:19:31.395435 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd2791e-b236-4cb9-9532-55c66b46c3fb service glance] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:19:31.395714 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd2791e-b236-4cb9-9532-55c66b46c3fb service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:19:31.404484 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd2791e-b236-4cb9-9532-55c66b46c3fb service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:19:31.406505 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd2791e-b236-4cb9-9532-55c66b46c3fb service glance] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:19:31.415961 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 735/1475] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:19:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:19:33.661039 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e568da-aa82-4960-9b45-74d2ba079d75 None None] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:19:33.661630 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e568da-aa82-4960-9b45-74d2ba079d75 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:19:33.661630 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e568da-aa82-4960-9b45-74d2ba079d75 None None] PATH_INFO: `/` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:19:33.662980 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 741/1476] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 17:19:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:19:33.668063 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25ab4bf-a8b4-43ba-8552-c85539b21025 None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:19:33.668500 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25ab4bf-a8b4-43ba-8552-c85539b21025 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:19:33.668636 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25ab4bf-a8b4-43ba-8552-c85539b21025 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:19:33.686222 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-b25ab4bf-a8b4-43ba-8552-c85539b21025 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:19:33.687806 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-b25ab4bf-a8b4-43ba-8552-c85539b21025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:19:33.695770 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 736/1477] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 17:19:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:19:33.720145 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e568da-aa82-4960-9b45-74d2ba079d75 None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:19:33.732487 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e568da-aa82-4960-9b45-74d2ba079d75 None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:19:33.736856 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fa470e-ae27-496e-a734-b8fcff2d5e6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:19:33.737492 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fa470e-ae27-496e-a734-b8fcff2d5e6b admin admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:19:33.737794 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fa470e-ae27-496e-a734-b8fcff2d5e6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:19:33.738078 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fa470e-ae27-496e-a734-b8fcff2d5e6b admin admin] PATH_INFO: `/v3/projects` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:19:33.738807 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fa470e-ae27-496e-a734-b8fcff2d5e6b admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:19:33.740602 dv-cinder-837356-2-smb devstack@keystone.service[80874]: WARNING py.warnings [None req-36fa470e-ae27-496e-a734-b8fcff2d5e6b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 16 17:19:33.740602 dv-cinder-837356-2-smb devstack@keystone.service[80874]: warnings.warn(msg) Jun 16 17:19:33.740602 dv-cinder-837356-2-smb devstack@keystone.service[80874]: Jun 16 17:19:33.741741 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fa470e-ae27-496e-a734-b8fcff2d5e6b admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:19:33.761142 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 742/1478] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 17:19:33 2022] GET /identity/v3/projects => generated 2553 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:19:35.944839 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6de16a-3c8f-4bcb-9d2f-480634a9df8d None None] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:19:35.945465 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6de16a-3c8f-4bcb-9d2f-480634a9df8d None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:19:35.945465 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6de16a-3c8f-4bcb-9d2f-480634a9df8d None None] PATH_INFO: `/` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:19:35.946795 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 737/1479] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 17:19:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:19:35.952016 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56e52ae-a96f-45c3-be71-f7060a9436a7 None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:19:35.952517 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56e52ae-a96f-45c3-be71-f7060a9436a7 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:19:35.952616 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56e52ae-a96f-45c3-be71-f7060a9436a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:19:35.970974 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-d56e52ae-a96f-45c3-be71-f7060a9436a7 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:19:35.972164 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-d56e52ae-a96f-45c3-be71-f7060a9436a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:19:35.980560 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 743/1480] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 17:19:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:19:36.023757 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6de16a-3c8f-4bcb-9d2f-480634a9df8d None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:19:36.038192 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6de16a-3c8f-4bcb-9d2f-480634a9df8d None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:19:36.043635 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11443d71-4ad9-4f43-bdd3-cfc14c0a1b79 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d381bb41dea4f1e90c3cf3815ac88dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:19:36.044269 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11443d71-4ad9-4f43-bdd3-cfc14c0a1b79 service nova] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:19:36.044555 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11443d71-4ad9-4f43-bdd3-cfc14c0a1b79 service nova] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:19:36.044835 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11443d71-4ad9-4f43-bdd3-cfc14c0a1b79 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:19:36.053612 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11443d71-4ad9-4f43-bdd3-cfc14c0a1b79 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:19:36.055200 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11443d71-4ad9-4f43-bdd3-cfc14c0a1b79 service nova] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:19:36.065621 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 738/1481] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:19:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:19:38.407166 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d388a943-2f82-4683-ae70-4a9564d6aa67 None None] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:19:38.407751 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d388a943-2f82-4683-ae70-4a9564d6aa67 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:19:38.407751 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d388a943-2f82-4683-ae70-4a9564d6aa67 None None] PATH_INFO: `/` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:19:38.409104 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 744/1482] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 17:19:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:19:38.414444 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da9baf5-b41b-4e5d-882d-fa9154d5aaab None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:19:38.414890 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da9baf5-b41b-4e5d-882d-fa9154d5aaab None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:19:38.415026 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da9baf5-b41b-4e5d-882d-fa9154d5aaab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:19:38.433252 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-4da9baf5-b41b-4e5d-882d-fa9154d5aaab None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:19:38.434482 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-4da9baf5-b41b-4e5d-882d-fa9154d5aaab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:19:38.442874 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 739/1483] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 17:19:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:19:38.479230 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d388a943-2f82-4683-ae70-4a9564d6aa67 None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:19:38.489952 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d388a943-2f82-4683-ae70-4a9564d6aa67 None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:19:38.493516 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8884a97-54cc-4f21-b160-bcf8e667dd40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5d25bfa8dc042329d57cd55fa7b7b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:19:38.494181 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8884a97-54cc-4f21-b160-bcf8e667dd40 service neutron] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:19:38.494474 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8884a97-54cc-4f21-b160-bcf8e667dd40 service neutron] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:19:38.494755 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8884a97-54cc-4f21-b160-bcf8e667dd40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:19:38.504168 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8884a97-54cc-4f21-b160-bcf8e667dd40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:19:38.505589 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8884a97-54cc-4f21-b160-bcf8e667dd40 service neutron] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:19:38.515586 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 745/1484] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:19:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:19:40.726903 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ec69b3-fb53-474d-b0c5-819f2996574c None None] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:19:40.727498 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ec69b3-fb53-474d-b0c5-819f2996574c None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:19:40.727498 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ec69b3-fb53-474d-b0c5-819f2996574c None None] PATH_INFO: `/` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:19:40.728826 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 740/1485] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 17:19:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:19:40.734198 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae0101e-5628-4e0c-9adf-4c904ac96b61 None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:19:40.734635 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae0101e-5628-4e0c-9adf-4c904ac96b61 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:19:40.734772 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae0101e-5628-4e0c-9adf-4c904ac96b61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:19:40.752689 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-8ae0101e-5628-4e0c-9adf-4c904ac96b61 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:19:40.753926 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-8ae0101e-5628-4e0c-9adf-4c904ac96b61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:19:40.762187 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 746/1486] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 17:19:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:19:40.800049 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ec69b3-fb53-474d-b0c5-819f2996574c None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:19:40.810814 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ec69b3-fb53-474d-b0c5-819f2996574c None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:19:40.814892 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f20a43-f814-41dc-9f86-e050d655cb52 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5d25bfa8dc042329d57cd55fa7b7b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:19:40.815550 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f20a43-f814-41dc-9f86-e050d655cb52 service neutron] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:19:40.815833 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f20a43-f814-41dc-9f86-e050d655cb52 service neutron] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:19:40.816108 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f20a43-f814-41dc-9f86-e050d655cb52 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:19:40.825354 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f20a43-f814-41dc-9f86-e050d655cb52 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:19:40.826677 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f20a43-f814-41dc-9f86-e050d655cb52 service neutron] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:19:40.836697 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 741/1487] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:19:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:19:43.081725 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2c85be-ad14-465e-bbc8-497306e08258 None None] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:19:43.082283 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2c85be-ad14-465e-bbc8-497306e08258 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:19:43.082380 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2c85be-ad14-465e-bbc8-497306e08258 None None] PATH_INFO: `/` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:19:43.083701 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 747/1488] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 17:19:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:19:43.088906 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c58507c-2ef4-4413-8630-457199141ccb None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:19:43.089338 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c58507c-2ef4-4413-8630-457199141ccb None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:19:43.089470 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c58507c-2ef4-4413-8630-457199141ccb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:19:43.107684 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-4c58507c-2ef4-4413-8630-457199141ccb None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:19:43.109458 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-4c58507c-2ef4-4413-8630-457199141ccb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:19:43.117401 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 742/1489] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 17:19:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:19:43.157919 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2c85be-ad14-465e-bbc8-497306e08258 None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:19:43.204438 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2c85be-ad14-465e-bbc8-497306e08258 None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:19:43.204438 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcb0222-c4a1-4512-a188-d1d7d8fbc0c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5d25bfa8dc042329d57cd55fa7b7b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:19:43.204438 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcb0222-c4a1-4512-a188-d1d7d8fbc0c3 service neutron] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:19:43.204438 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcb0222-c4a1-4512-a188-d1d7d8fbc0c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:19:43.205077 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcb0222-c4a1-4512-a188-d1d7d8fbc0c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:19:43.205077 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcb0222-c4a1-4512-a188-d1d7d8fbc0c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:19:43.205077 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcb0222-c4a1-4512-a188-d1d7d8fbc0c3 service neutron] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:19:43.205077 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 748/1490] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:19:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:19:45.677550 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e2ca08-6864-4a8f-b3cc-fc3dd2915cc1 None None] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:19:45.678108 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e2ca08-6864-4a8f-b3cc-fc3dd2915cc1 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:19:45.678108 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e2ca08-6864-4a8f-b3cc-fc3dd2915cc1 None None] PATH_INFO: `/` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:19:45.679440 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 743/1491] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 17:19:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:19:45.684877 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb06894-5245-466b-90d7-50f11fa5310d None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:19:45.685314 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb06894-5245-466b-90d7-50f11fa5310d None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:19:45.685484 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb06894-5245-466b-90d7-50f11fa5310d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:19:45.703555 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-8fb06894-5245-466b-90d7-50f11fa5310d None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:19:45.704759 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-8fb06894-5245-466b-90d7-50f11fa5310d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:19:45.712590 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 749/1492] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 17:19:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:19:45.752515 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e2ca08-6864-4a8f-b3cc-fc3dd2915cc1 None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:19:45.763071 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e2ca08-6864-4a8f-b3cc-fc3dd2915cc1 None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:19:45.766522 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cc219f-1c78-4bd5-b704-3d32dd96b7bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5d25bfa8dc042329d57cd55fa7b7b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:19:45.767149 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cc219f-1c78-4bd5-b704-3d32dd96b7bd service neutron] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:19:45.767430 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cc219f-1c78-4bd5-b704-3d32dd96b7bd service neutron] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:19:45.767705 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cc219f-1c78-4bd5-b704-3d32dd96b7bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:19:45.777144 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cc219f-1c78-4bd5-b704-3d32dd96b7bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:19:45.778577 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cc219f-1c78-4bd5-b704-3d32dd96b7bd service neutron] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:19:45.787695 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 744/1493] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:19:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:19:55.698542 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=33 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:19:55.783666 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=33 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:21:20.816122 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899ba26c-9102-4310-8ca5-540dc90cc480 None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:21:20.816732 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899ba26c-9102-4310-8ca5-540dc90cc480 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:21:20.816732 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899ba26c-9102-4310-8ca5-540dc90cc480 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:21:20.835420 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-899ba26c-9102-4310-8ca5-540dc90cc480 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:21:20.836877 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-899ba26c-9102-4310-8ca5-540dc90cc480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:21:20.845179 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 750/1494] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:21:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:21:20.854430 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e04a894-ee4e-411a-84be-961f7ed33c6b None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:21:20.854933 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e04a894-ee4e-411a-84be-961f7ed33c6b None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:21:20.855037 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e04a894-ee4e-411a-84be-961f7ed33c6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:21:20.872720 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-1e04a894-ee4e-411a-84be-961f7ed33c6b None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:21:20.873954 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-1e04a894-ee4e-411a-84be-961f7ed33c6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:21:20.882022 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 745/1495] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:21:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:21:20.886915 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899ba26c-9102-4310-8ca5-540dc90cc480 None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:21:20.897436 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899ba26c-9102-4310-8ca5-540dc90cc480 None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:21:20.902040 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72ff03e-b96f-4879-9bcd-ed9f76b02c46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:21:20.902696 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72ff03e-b96f-4879-9bcd-ed9f76b02c46 admin admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:21:20.902983 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72ff03e-b96f-4879-9bcd-ed9f76b02c46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:21:20.903264 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72ff03e-b96f-4879-9bcd-ed9f76b02c46 admin admin] PATH_INFO: `/v3/domains` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:21:20.903997 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72ff03e-b96f-4879-9bcd-ed9f76b02c46 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:21:20.904307 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72ff03e-b96f-4879-9bcd-ed9f76b02c46 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:21:20.905946 dv-cinder-837356-2-smb devstack@keystone.service[80874]: WARNING py.warnings [None req-c72ff03e-b96f-4879-9bcd-ed9f76b02c46 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 17:21:20.905946 dv-cinder-837356-2-smb devstack@keystone.service[80874]: warnings.warn(msg) Jun 16 17:21:20.905946 dv-cinder-837356-2-smb devstack@keystone.service[80874]: Jun 16 17:21:20.906825 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72ff03e-b96f-4879-9bcd-ed9f76b02c46 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:21:20.918358 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 751/1496] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 16 17:21:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:21:20.926498 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e04a894-ee4e-411a-84be-961f7ed33c6b None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:21:20.935658 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e04a894-ee4e-411a-84be-961f7ed33c6b None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:21:20.940493 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4c8044-24fb-495f-84ae-e58fc14fbf86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:21:20.941151 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4c8044-24fb-495f-84ae-e58fc14fbf86 admin admin] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:21:20.941439 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4c8044-24fb-495f-84ae-e58fc14fbf86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:21:20.941717 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4c8044-24fb-495f-84ae-e58fc14fbf86 admin admin] PATH_INFO: `/v3/projects` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:21:20.942465 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4c8044-24fb-495f-84ae-e58fc14fbf86 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:21:20.944311 dv-cinder-837356-2-smb devstack@keystone.service[80873]: WARNING py.warnings [None req-aa4c8044-24fb-495f-84ae-e58fc14fbf86 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 16 17:21:20.944311 dv-cinder-837356-2-smb devstack@keystone.service[80873]: warnings.warn(msg) Jun 16 17:21:20.944311 dv-cinder-837356-2-smb devstack@keystone.service[80873]: Jun 16 17:21:20.945554 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4c8044-24fb-495f-84ae-e58fc14fbf86 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:21:21.047309 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 746/1497] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 16 17:21:20 2022] POST /identity/v3/projects => generated 379 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:21:21.051846 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72ff03e-b96f-4879-9bcd-ed9f76b02c46 admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:21:21.062678 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72ff03e-b96f-4879-9bcd-ed9f76b02c46 admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:21:21.118202 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7c8304-79b6-4ca5-88c3-086de0961a36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:21:21.118866 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7c8304-79b6-4ca5-88c3-086de0961a36 admin admin] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:21:21.119152 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7c8304-79b6-4ca5-88c3-086de0961a36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:21:21.119586 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7c8304-79b6-4ca5-88c3-086de0961a36 admin admin] PATH_INFO: `/v3/users` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:21:21.120198 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7c8304-79b6-4ca5-88c3-086de0961a36 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:21:21.121203 dv-cinder-837356-2-smb devstack@keystone.service[80874]: WARNING py.warnings [None req-9a7c8304-79b6-4ca5-88c3-086de0961a36 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 16 17:21:21.121203 dv-cinder-837356-2-smb devstack@keystone.service[80874]: warnings.warn(msg) Jun 16 17:21:21.121203 dv-cinder-837356-2-smb devstack@keystone.service[80874]: Jun 16 17:21:21.122428 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7c8304-79b6-4ca5-88c3-086de0961a36 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:21:21.211003 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 752/1498] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 16 17:21:21 2022] POST /identity/v3/users => generated 290 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:21:21.212459 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4c8044-24fb-495f-84ae-e58fc14fbf86 admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:21:21.223673 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4c8044-24fb-495f-84ae-e58fc14fbf86 admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:21:21.228527 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213f9d5d-c6f7-421e-b472-c776916eb760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:21:21.229218 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213f9d5d-c6f7-421e-b472-c776916eb760 admin admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:21:21.229502 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213f9d5d-c6f7-421e-b472-c776916eb760 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:21:21.229801 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213f9d5d-c6f7-421e-b472-c776916eb760 admin admin] PATH_INFO: `/v3/roles` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:21:21.230600 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213f9d5d-c6f7-421e-b472-c776916eb760 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:21:21.231622 dv-cinder-837356-2-smb devstack@keystone.service[80873]: WARNING py.warnings [None req-213f9d5d-c6f7-421e-b472-c776916eb760 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 17:21:21.231622 dv-cinder-837356-2-smb devstack@keystone.service[80873]: warnings.warn(msg) Jun 16 17:21:21.231622 dv-cinder-837356-2-smb devstack@keystone.service[80873]: Jun 16 17:21:21.232522 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213f9d5d-c6f7-421e-b472-c776916eb760 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:21:21.251083 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 747/1499] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 17:21:21 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:21:21.252298 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7c8304-79b6-4ca5-88c3-086de0961a36 admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:21:21.262897 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7c8304-79b6-4ca5-88c3-086de0961a36 admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:21:21.268632 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67520193-477e-40ed-abda-caaa2eece5cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:21:21.269342 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67520193-477e-40ed-abda-caaa2eece5cd admin admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:21:21.269632 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67520193-477e-40ed-abda-caaa2eece5cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:21:21.269959 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67520193-477e-40ed-abda-caaa2eece5cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:21:21.270698 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67520193-477e-40ed-abda-caaa2eece5cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:21:21.271703 dv-cinder-837356-2-smb devstack@keystone.service[80874]: WARNING py.warnings [None req-67520193-477e-40ed-abda-caaa2eece5cd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 17:21:21.271703 dv-cinder-837356-2-smb devstack@keystone.service[80874]: warnings.warn(msg) Jun 16 17:21:21.271703 dv-cinder-837356-2-smb devstack@keystone.service[80874]: Jun 16 17:21:21.272601 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67520193-477e-40ed-abda-caaa2eece5cd admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:21:21.288281 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 753/1500] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 17:21:21 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:21:21.292623 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213f9d5d-c6f7-421e-b472-c776916eb760 admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:21:21.302850 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213f9d5d-c6f7-421e-b472-c776916eb760 admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:21:21.307502 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0331183-f0ea-4b56-9445-b0fdb8ad88cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:21:21.308393 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0331183-f0ea-4b56-9445-b0fdb8ad88cd admin admin] REQUEST_METHOD: `PUT` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:21:21.308681 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0331183-f0ea-4b56-9445-b0fdb8ad88cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:21:21.308965 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0331183-f0ea-4b56-9445-b0fdb8ad88cd admin admin] PATH_INFO: `/v3/projects/e021cc0ef6204173b7bd63fb43265795/users/37685afbb60e4767acc8240245015a97/roles/896bff49c5d6464eb612a15f4aa9badc` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:21:21.324893 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0331183-f0ea-4b56-9445-b0fdb8ad88cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=e021cc0ef6204173b7bd63fb43265795, user_id=37685afbb60e4767acc8240245015a97, role_id=896bff49c5d6464eb612a15f4aa9badc)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:21:21.325965 dv-cinder-837356-2-smb devstack@keystone.service[80873]: WARNING py.warnings [None req-e0331183-f0ea-4b56-9445-b0fdb8ad88cd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 16 17:21:21.325965 dv-cinder-837356-2-smb devstack@keystone.service[80873]: warnings.warn(msg) Jun 16 17:21:21.325965 dv-cinder-837356-2-smb devstack@keystone.service[80873]: Jun 16 17:21:21.328487 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0331183-f0ea-4b56-9445-b0fdb8ad88cd admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:21:21.404705 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 748/1501] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 17:21:21 2022] PUT /identity/v3/projects/e021cc0ef6204173b7bd63fb43265795/users/37685afbb60e4767acc8240245015a97/roles/896bff49c5d6464eb612a15f4aa9badc => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 17:21:21.416057 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184164fe-4cba-4787-9bbe-fef04644aa2b None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:21:21.416378 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184164fe-4cba-4787-9bbe-fef04644aa2b None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:21:21.416667 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184164fe-4cba-4787-9bbe-fef04644aa2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:21:21.445781 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-184164fe-4cba-4787-9bbe-fef04644aa2b None None] MFA Rules not processed for user `37685afbb60e4767acc8240245015a97`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:21:21.447036 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-184164fe-4cba-4787-9bbe-fef04644aa2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:21:21.529155 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 754/1502] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:21:21 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:21:21.542405 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae22814-8054-44c4-8270-823cc1c958a8 None None] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:21:21.542703 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae22814-8054-44c4-8270-823cc1c958a8 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:21:21.542995 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae22814-8054-44c4-8270-823cc1c958a8 None None] PATH_INFO: `/` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:21:21.544430 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 749/1503] 10.222.0.39 () {54 vars in 963 bytes} [Thu Jun 16 17:21:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:21:21.550155 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc1f184-e216-4edc-abaa-82cc13bbd8a2 None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:21:21.550445 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc1f184-e216-4edc-abaa-82cc13bbd8a2 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:21:21.550745 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc1f184-e216-4edc-abaa-82cc13bbd8a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:21:21.569659 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-ddc1f184-e216-4edc-abaa-82cc13bbd8a2 None None] MFA Rules not processed for user `ef37136b89d34edc9cd94c7aa81b2095`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:21:21.570958 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-ddc1f184-e216-4edc-abaa-82cc13bbd8a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:21:21.617091 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:21:21.626529 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 755/1504] 10.222.0.39 () {58 vars in 1060 bytes} [Thu Jun 16 17:21:21 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:21:21.634454 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae22814-8054-44c4-8270-823cc1c958a8 None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:21:21.645620 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae22814-8054-44c4-8270-823cc1c958a8 None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:21:21.649227 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b325e7f-ea96-45dd-9d35-7173c9f0b211 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef37136b89d34edc9cd94c7aa81b2095', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:21:21.649981 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b325e7f-ea96-45dd-9d35-7173c9f0b211 service cinder] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:21:21.650285 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b325e7f-ea96-45dd-9d35-7173c9f0b211 service cinder] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:21:21.650571 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b325e7f-ea96-45dd-9d35-7173c9f0b211 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:21:21.660555 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b325e7f-ea96-45dd-9d35-7173c9f0b211 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:21:21.662083 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b325e7f-ea96-45dd-9d35-7173c9f0b211 service cinder] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:21:21.672109 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 750/1505] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:21:21 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:21:21.715824 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8476fab-2a29-4377-af70-ffcb469da972 None None] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:21:21.718046 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8476fab-2a29-4377-af70-ffcb469da972 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:21:21.718046 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8476fab-2a29-4377-af70-ffcb469da972 None None] PATH_INFO: `/` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:21:21.718046 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 756/1506] 10.222.0.39 () {52 vars in 829 bytes} [Thu Jun 16 17:21:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:21:21.721800 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b325e7f-ea96-45dd-9d35-7173c9f0b211 service cinder] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:21:21.785967 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b325e7f-ea96-45dd-9d35-7173c9f0b211 service cinder] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:21:21.790937 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a213d85b-765c-4097-95e7-119b363e3af3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:21:21.791849 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a213d85b-765c-4097-95e7-119b363e3af3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:21:21.792138 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a213d85b-765c-4097-95e7-119b363e3af3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:21:21.792426 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a213d85b-765c-4097-95e7-119b363e3af3 admin admin] PATH_INFO: `/v3/users/37685afbb60e4767acc8240245015a97` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:21:21.793697 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a213d85b-765c-4097-95e7-119b363e3af3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=37685afbb60e4767acc8240245015a97)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:21:21.794749 dv-cinder-837356-2-smb devstack@keystone.service[80873]: WARNING py.warnings [None req-a213d85b-765c-4097-95e7-119b363e3af3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 16 17:21:21.794749 dv-cinder-837356-2-smb devstack@keystone.service[80873]: warnings.warn(msg) Jun 16 17:21:21.794749 dv-cinder-837356-2-smb devstack@keystone.service[80873]: Jun 16 17:21:21.796722 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a213d85b-765c-4097-95e7-119b363e3af3 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:21:22.004385 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-a213d85b-765c-4097-95e7-119b363e3af3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37685afbb60e4767acc8240245015a97'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:21:22.005131 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-a213d85b-765c-4097-95e7-119b363e3af3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37685afbb60e4767acc8240245015a97'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:21:22.005743 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-a213d85b-765c-4097-95e7-119b363e3af3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37685afbb60e4767acc8240245015a97'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:21:22.068413 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-a213d85b-765c-4097-95e7-119b363e3af3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37685afbb60e4767acc8240245015a97'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:21:22.081910 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-a213d85b-765c-4097-95e7-119b363e3af3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37685afbb60e4767acc8240245015a97'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:21:22.098887 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:21:22.109082 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 751/1507] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 16 17:21:21 2022] DELETE /identity/v3/users/37685afbb60e4767acc8240245015a97 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:21:22.114345 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c095b2ee-c267-4524-a9d0-3f8acc2ca001 None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:21:22.114872 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c095b2ee-c267-4524-a9d0-3f8acc2ca001 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:21:22.115024 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c095b2ee-c267-4524-a9d0-3f8acc2ca001 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:21:22.133673 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-c095b2ee-c267-4524-a9d0-3f8acc2ca001 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:21:22.135030 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-c095b2ee-c267-4524-a9d0-3f8acc2ca001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:21:22.197641 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 757/1508] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:21:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:21:22.207982 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a213d85b-765c-4097-95e7-119b363e3af3 admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:21:22.209409 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-a213d85b-765c-4097-95e7-119b363e3af3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:21:22.266440 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a213d85b-765c-4097-95e7-119b363e3af3 admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:21:22.270063 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc417d2-7b4a-455a-b487-1a500cf1c404 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5d25bfa8dc042329d57cd55fa7b7b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:21:22.270716 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc417d2-7b4a-455a-b487-1a500cf1c404 service neutron] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:21:22.271009 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc417d2-7b4a-455a-b487-1a500cf1c404 service neutron] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:21:22.271295 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc417d2-7b4a-455a-b487-1a500cf1c404 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:21:22.280771 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc417d2-7b4a-455a-b487-1a500cf1c404 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:21:22.282242 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc417d2-7b4a-455a-b487-1a500cf1c404 service neutron] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:21:22.291611 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 752/1509] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:21:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:21:22.807949 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c095b2ee-c267-4524-a9d0-3f8acc2ca001 None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:21:22.809496 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-c095b2ee-c267-4524-a9d0-3f8acc2ca001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:21:22.822170 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c095b2ee-c267-4524-a9d0-3f8acc2ca001 None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:21:22.827402 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fac483-6764-4fea-b5a1-7fa9f0ebc3a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:21:22.828269 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fac483-6764-4fea-b5a1-7fa9f0ebc3a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:21:22.828551 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fac483-6764-4fea-b5a1-7fa9f0ebc3a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:21:22.828831 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fac483-6764-4fea-b5a1-7fa9f0ebc3a7 admin admin] PATH_INFO: `/v3/projects/e021cc0ef6204173b7bd63fb43265795` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:21:22.830051 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fac483-6764-4fea-b5a1-7fa9f0ebc3a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e021cc0ef6204173b7bd63fb43265795)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:21:22.831083 dv-cinder-837356-2-smb devstack@keystone.service[80874]: WARNING py.warnings [None req-c7fac483-6764-4fea-b5a1-7fa9f0ebc3a7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 16 17:21:22.831083 dv-cinder-837356-2-smb devstack@keystone.service[80874]: warnings.warn(msg) Jun 16 17:21:22.831083 dv-cinder-837356-2-smb devstack@keystone.service[80874]: Jun 16 17:21:22.832265 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fac483-6764-4fea-b5a1-7fa9f0ebc3a7 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:21:22.949475 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-c7fac483-6764-4fea-b5a1-7fa9f0ebc3a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e021cc0ef6204173b7bd63fb43265795', 'request_id': 'req-c7fac483-6764-4fea-b5a1-7fa9f0ebc3a7'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:21:22.955538 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-c7fac483-6764-4fea-b5a1-7fa9f0ebc3a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e021cc0ef6204173b7bd63fb43265795', 'request_id': 'req-c7fac483-6764-4fea-b5a1-7fa9f0ebc3a7'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:21:23.011237 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-c7fac483-6764-4fea-b5a1-7fa9f0ebc3a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e021cc0ef6204173b7bd63fb43265795', 'request_id': 'req-c7fac483-6764-4fea-b5a1-7fa9f0ebc3a7'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:21:23.030377 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-c7fac483-6764-4fea-b5a1-7fa9f0ebc3a7 admin admin] The token cache is being invalidate because project e021cc0ef6204173b7bd63fb43265795 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80874) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 17:21:23.030675 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-c7fac483-6764-4fea-b5a1-7fa9f0ebc3a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:21:23.031376 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-c7fac483-6764-4fea-b5a1-7fa9f0ebc3a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:21:23.033052 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 758/1510] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 16 17:21:22 2022] DELETE /identity/v3/projects/e021cc0ef6204173b7bd63fb43265795 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:21:32.287511 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:DELETE=1,keystone:SELECT=28 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:21:33.027285 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:23:10.289100 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f576de07-0177-497a-8062-cfc7222d46bc None None] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:23:10.289670 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f576de07-0177-497a-8062-cfc7222d46bc None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:23:10.289670 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f576de07-0177-497a-8062-cfc7222d46bc None None] PATH_INFO: `/` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:23:10.291020 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 753/1511] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 16 17:23:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:23:10.295896 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d845bde5-6cac-4f21-aae8-abd3571b920b None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:23:10.296348 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d845bde5-6cac-4f21-aae8-abd3571b920b None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:23:10.296479 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d845bde5-6cac-4f21-aae8-abd3571b920b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:23:10.314909 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-d845bde5-6cac-4f21-aae8-abd3571b920b None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:23:10.316140 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-d845bde5-6cac-4f21-aae8-abd3571b920b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:23:10.376254 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 759/1512] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 16 17:23:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 17:23:10.547327 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f576de07-0177-497a-8062-cfc7222d46bc None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:23:10.553358 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-f576de07-0177-497a-8062-cfc7222d46bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:23:10.633658 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f576de07-0177-497a-8062-cfc7222d46bc None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:23:10.639178 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247b48ad-0b77-4da7-be18-b146fa8c3ba2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d381bb41dea4f1e90c3cf3815ac88dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:23:10.639821 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247b48ad-0b77-4da7-be18-b146fa8c3ba2 service nova] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:23:10.640107 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247b48ad-0b77-4da7-be18-b146fa8c3ba2 service nova] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:23:10.640380 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247b48ad-0b77-4da7-be18-b146fa8c3ba2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:23:10.648877 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247b48ad-0b77-4da7-be18-b146fa8c3ba2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:23:10.650643 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247b48ad-0b77-4da7-be18-b146fa8c3ba2 service nova] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:23:10.661388 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 754/1513] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:23:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:23:11.442803 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c61a17-072d-402e-88b6-ada15aefdf41 None None] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:23:11.443366 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c61a17-072d-402e-88b6-ada15aefdf41 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:23:11.443459 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c61a17-072d-402e-88b6-ada15aefdf41 None None] PATH_INFO: `/v3` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:23:11.444723 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 760/1514] 10.222.0.86 () {54 vars in 925 bytes} [Thu Jun 16 17:23:11 2022] GET /identity/v3 => generated 255 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:23:11.451230 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24f9d6a-70a1-40db-acbb-bfa6ca301a71 None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:23:11.451665 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24f9d6a-70a1-40db-acbb-bfa6ca301a71 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:23:11.451830 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24f9d6a-70a1-40db-acbb-bfa6ca301a71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:23:11.470991 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-f24f9d6a-70a1-40db-acbb-bfa6ca301a71 None None] MFA Rules not processed for user `2882f26811094d8e88c03701c94296fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:23:11.472208 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-f24f9d6a-70a1-40db-acbb-bfa6ca301a71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:23:11.537621 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 755/1515] 10.222.0.86 () {58 vars in 1015 bytes} [Thu Jun 16 17:23:11 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:23:11.539578 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc3b523-9d7d-403b-9fb3-3b3ef9d57f02 None None] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:23:11.539872 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc3b523-9d7d-403b-9fb3-3b3ef9d57f02 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:23:11.540154 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc3b523-9d7d-403b-9fb3-3b3ef9d57f02 None None] PATH_INFO: `/` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:23:11.541505 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 761/1516] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 16 17:23:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:23:11.546680 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bb760f-d233-4f27-a803-6503db0dece8 None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:23:11.546976 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bb760f-d233-4f27-a803-6503db0dece8 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:23:11.547256 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bb760f-d233-4f27-a803-6503db0dece8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:23:11.565400 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-01bb760f-d233-4f27-a803-6503db0dece8 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:23:11.566624 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-01bb760f-d233-4f27-a803-6503db0dece8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:23:11.574459 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 756/1517] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 16 17:23:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 17:23:11.727404 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc3b523-9d7d-403b-9fb3-3b3ef9d57f02 None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:23:11.741747 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc3b523-9d7d-403b-9fb3-3b3ef9d57f02 None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:23:11.747207 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e971ef9-ab61-4685-917a-b4eee8c5fae3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d381bb41dea4f1e90c3cf3815ac88dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:23:11.748380 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e971ef9-ab61-4685-917a-b4eee8c5fae3 service nova] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:23:11.748673 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e971ef9-ab61-4685-917a-b4eee8c5fae3 service nova] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:23:11.748948 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e971ef9-ab61-4685-917a-b4eee8c5fae3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:23:11.757020 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e971ef9-ab61-4685-917a-b4eee8c5fae3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:23:11.758652 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e971ef9-ab61-4685-917a-b4eee8c5fae3 service nova] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:23:11.768668 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 762/1518] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:23:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:23:15.459375 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d1b63c-4261-4fb6-a02a-fe0316d2dc0a None None] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:23:15.459950 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d1b63c-4261-4fb6-a02a-fe0316d2dc0a None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:23:15.460116 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d1b63c-4261-4fb6-a02a-fe0316d2dc0a None None] PATH_INFO: `/` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:23:15.461719 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 757/1519] 10.222.0.39 () {54 vars in 960 bytes} [Thu Jun 16 17:23:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:23:15.467427 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd89bd65-5861-44cc-966c-7e2daea73de7 None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:23:15.470364 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd89bd65-5861-44cc-966c-7e2daea73de7 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:23:15.470364 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd89bd65-5861-44cc-966c-7e2daea73de7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:23:15.487428 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-cd89bd65-5861-44cc-966c-7e2daea73de7 None None] MFA Rules not processed for user `2882f26811094d8e88c03701c94296fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:23:15.488638 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-cd89bd65-5861-44cc-966c-7e2daea73de7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:23:15.497272 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 763/1520] 10.222.0.39 () {58 vars in 1057 bytes} [Thu Jun 16 17:23:15 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:23:15.504802 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d1b63c-4261-4fb6-a02a-fe0316d2dc0a None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:23:15.519045 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d1b63c-4261-4fb6-a02a-fe0316d2dc0a None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:23:15.524048 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a182c32-de70-41fe-8501-807547e737f7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2882f26811094d8e88c03701c94296fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:23:15.524692 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a182c32-de70-41fe-8501-807547e737f7 service placement] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:23:15.524981 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a182c32-de70-41fe-8501-807547e737f7 service placement] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:23:15.525265 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a182c32-de70-41fe-8501-807547e737f7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:23:15.534224 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a182c32-de70-41fe-8501-807547e737f7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:23:15.535786 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a182c32-de70-41fe-8501-807547e737f7 service placement] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:23:15.546363 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 758/1521] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:23:15 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:23:23.069906 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96cdec2-a0ed-4f0d-88cc-aba59f1b7236 None None] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:23:23.070438 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96cdec2-a0ed-4f0d-88cc-aba59f1b7236 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:23:23.070438 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96cdec2-a0ed-4f0d-88cc-aba59f1b7236 None None] PATH_INFO: `/` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:23:23.071759 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 764/1522] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 16 17:23:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:23:23.076461 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4742cad-57fa-46c7-9f34-4adc2db1eb8b None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:23:23.076864 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4742cad-57fa-46c7-9f34-4adc2db1eb8b None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:23:23.077016 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4742cad-57fa-46c7-9f34-4adc2db1eb8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:23:23.095809 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-c4742cad-57fa-46c7-9f34-4adc2db1eb8b None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:23:23.096988 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-c4742cad-57fa-46c7-9f34-4adc2db1eb8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:23:23.104963 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 759/1523] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 16 17:23:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:23:23.259808 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96cdec2-a0ed-4f0d-88cc-aba59f1b7236 None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:23:23.275305 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96cdec2-a0ed-4f0d-88cc-aba59f1b7236 None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:23:23.280832 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446d99e4-f4ad-4304-a0f2-e93e706ac5a8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d381bb41dea4f1e90c3cf3815ac88dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:23:23.281470 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446d99e4-f4ad-4304-a0f2-e93e706ac5a8 service nova] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:23:23.281753 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446d99e4-f4ad-4304-a0f2-e93e706ac5a8 service nova] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:23:23.282056 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446d99e4-f4ad-4304-a0f2-e93e706ac5a8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:23:23.290576 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446d99e4-f4ad-4304-a0f2-e93e706ac5a8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:23:23.292207 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446d99e4-f4ad-4304-a0f2-e93e706ac5a8 service nova] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:23:23.301605 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 765/1524] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:23:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:23:24.168071 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60037bdb-9c1e-4bd0-97fa-953ff0521686 None None] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:23:24.168589 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60037bdb-9c1e-4bd0-97fa-953ff0521686 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:23:24.168589 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60037bdb-9c1e-4bd0-97fa-953ff0521686 None None] PATH_INFO: `/` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:23:24.169982 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 760/1525] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 16 17:23:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:23:24.175503 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73923e69-395a-4cdb-afde-674204e6da28 None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:23:24.175927 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73923e69-395a-4cdb-afde-674204e6da28 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:23:24.176084 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73923e69-395a-4cdb-afde-674204e6da28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:23:24.194413 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-73923e69-395a-4cdb-afde-674204e6da28 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:23:24.195663 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-73923e69-395a-4cdb-afde-674204e6da28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:23:24.204070 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 766/1526] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 16 17:23:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:23:24.358629 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60037bdb-9c1e-4bd0-97fa-953ff0521686 None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:23:24.372859 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60037bdb-9c1e-4bd0-97fa-953ff0521686 None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:23:24.378583 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f125e35-71c0-4730-bd25-d2351bf55d22 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d381bb41dea4f1e90c3cf3815ac88dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:23:24.379223 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f125e35-71c0-4730-bd25-d2351bf55d22 service nova] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:23:24.379509 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f125e35-71c0-4730-bd25-d2351bf55d22 service nova] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:23:24.379791 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f125e35-71c0-4730-bd25-d2351bf55d22 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:23:24.388084 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f125e35-71c0-4730-bd25-d2351bf55d22 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:23:24.389658 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f125e35-71c0-4730-bd25-d2351bf55d22 service nova] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:23:24.399600 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 761/1527] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:23:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:23:28.423045 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5a6c04-cfdd-4012-91af-6f72e4882f99 None None] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:23:28.423607 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5a6c04-cfdd-4012-91af-6f72e4882f99 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:23:28.423607 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5a6c04-cfdd-4012-91af-6f72e4882f99 None None] PATH_INFO: `/` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:23:28.424992 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 767/1528] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 17:23:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:23:28.430291 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a678e6-f0de-4f43-86d6-5adf4e8c9fed None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:23:28.430726 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a678e6-f0de-4f43-86d6-5adf4e8c9fed None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:23:28.430836 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a678e6-f0de-4f43-86d6-5adf4e8c9fed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:23:28.448339 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-90a678e6-f0de-4f43-86d6-5adf4e8c9fed None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:23:28.449522 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-90a678e6-f0de-4f43-86d6-5adf4e8c9fed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:23:28.457797 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 762/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 17:23:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:23:28.494476 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5a6c04-cfdd-4012-91af-6f72e4882f99 None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:23:28.496381 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-7c5a6c04-cfdd-4012-91af-6f72e4882f99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:23:28.554603 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5a6c04-cfdd-4012-91af-6f72e4882f99 None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:23:28.558363 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12786818-9e65-4cba-8aae-4110c307146e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5d25bfa8dc042329d57cd55fa7b7b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:23:28.559012 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12786818-9e65-4cba-8aae-4110c307146e service neutron] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:23:28.559347 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12786818-9e65-4cba-8aae-4110c307146e service neutron] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:23:28.559589 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12786818-9e65-4cba-8aae-4110c307146e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:23:28.568657 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12786818-9e65-4cba-8aae-4110c307146e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:23:28.570132 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12786818-9e65-4cba-8aae-4110c307146e service neutron] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:23:28.579595 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 768/1530] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:23:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:23:30.713324 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4261050d-aabf-487a-80fc-bf1c7263ec77 None None] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:23:30.713990 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4261050d-aabf-487a-80fc-bf1c7263ec77 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:23:30.713990 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4261050d-aabf-487a-80fc-bf1c7263ec77 None None] PATH_INFO: `/` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:23:30.715388 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 763/1531] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 17:23:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:23:30.720880 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1c4b9a-4070-4f79-8d6a-2c28a0ecf4ed None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:23:30.721274 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1c4b9a-4070-4f79-8d6a-2c28a0ecf4ed None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:23:30.721444 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1c4b9a-4070-4f79-8d6a-2c28a0ecf4ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:23:30.739277 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-4b1c4b9a-4070-4f79-8d6a-2c28a0ecf4ed None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:23:30.740473 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-4b1c4b9a-4070-4f79-8d6a-2c28a0ecf4ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:23:30.748482 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 769/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 17:23:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:23:30.785097 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4261050d-aabf-487a-80fc-bf1c7263ec77 None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:23:30.795883 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4261050d-aabf-487a-80fc-bf1c7263ec77 None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:23:30.799478 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6bbb21-dc68-4250-9397-31c9f31915d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5d25bfa8dc042329d57cd55fa7b7b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:23:30.800114 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6bbb21-dc68-4250-9397-31c9f31915d7 service neutron] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:23:30.800405 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6bbb21-dc68-4250-9397-31c9f31915d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:23:30.800688 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6bbb21-dc68-4250-9397-31c9f31915d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:23:30.809667 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6bbb21-dc68-4250-9397-31c9f31915d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:23:30.811136 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6bbb21-dc68-4250-9397-31c9f31915d7 service neutron] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:23:30.821004 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 764/1533] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:23:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:23:36.477953 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef802f3-8b43-4bee-931d-daab4f2c873c None None] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:23:36.478503 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef802f3-8b43-4bee-931d-daab4f2c873c None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:23:36.478503 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef802f3-8b43-4bee-931d-daab4f2c873c None None] PATH_INFO: `/` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:23:36.479874 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 770/1534] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 17:23:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:23:36.485083 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087242cd-e6a7-47dc-ba89-6fc9403707a4 None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:23:36.485537 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087242cd-e6a7-47dc-ba89-6fc9403707a4 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:23:36.485660 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087242cd-e6a7-47dc-ba89-6fc9403707a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:23:36.492593 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=91 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:23:36.504844 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-087242cd-e6a7-47dc-ba89-6fc9403707a4 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:23:36.506080 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-087242cd-e6a7-47dc-ba89-6fc9403707a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:23:36.514208 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 765/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 17:23:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:23:36.778510 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef802f3-8b43-4bee-931d-daab4f2c873c None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:23:36.780239 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-3ef802f3-8b43-4bee-931d-daab4f2c873c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:23:36.786688 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=75 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:23:36.843497 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef802f3-8b43-4bee-931d-daab4f2c873c None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:23:36.847801 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdffd8f-bc5b-404d-9253-9945268efe80 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef37136b89d34edc9cd94c7aa81b2095', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:23:36.848457 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdffd8f-bc5b-404d-9253-9945268efe80 service cinder] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:23:36.848748 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdffd8f-bc5b-404d-9253-9945268efe80 service cinder] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:23:36.849030 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdffd8f-bc5b-404d-9253-9945268efe80 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:23:36.858582 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdffd8f-bc5b-404d-9253-9945268efe80 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:23:36.860049 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdffd8f-bc5b-404d-9253-9945268efe80 service cinder] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:23:36.870908 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 771/1536] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:23:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:23:39.060372 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1df2c47-7a93-4ce7-97dc-43e5e02a7355 None None] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:23:39.060965 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1df2c47-7a93-4ce7-97dc-43e5e02a7355 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:23:39.060965 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1df2c47-7a93-4ce7-97dc-43e5e02a7355 None None] PATH_INFO: `/` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:23:39.062314 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 766/1537] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 17:23:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:23:39.067910 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9a0582-38c1-43bc-9dad-ce13f8df4446 None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:23:39.068331 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9a0582-38c1-43bc-9dad-ce13f8df4446 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:23:39.068485 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9a0582-38c1-43bc-9dad-ce13f8df4446 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:23:39.086804 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-3d9a0582-38c1-43bc-9dad-ce13f8df4446 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:23:39.088027 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-3d9a0582-38c1-43bc-9dad-ce13f8df4446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:23:39.096069 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 772/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 17:23:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:23:39.366322 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1df2c47-7a93-4ce7-97dc-43e5e02a7355 None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:23:39.368087 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-e1df2c47-7a93-4ce7-97dc-43e5e02a7355 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:23:39.381859 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1df2c47-7a93-4ce7-97dc-43e5e02a7355 None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:23:39.385523 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8d39f8-ea73-42d8-83f8-6e9937d0df83 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef37136b89d34edc9cd94c7aa81b2095', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:23:39.386203 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8d39f8-ea73-42d8-83f8-6e9937d0df83 service cinder] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:23:39.386495 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8d39f8-ea73-42d8-83f8-6e9937d0df83 service cinder] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:23:39.386781 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8d39f8-ea73-42d8-83f8-6e9937d0df83 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:23:39.396159 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8d39f8-ea73-42d8-83f8-6e9937d0df83 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:23:39.397580 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8d39f8-ea73-42d8-83f8-6e9937d0df83 service cinder] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:23:39.407127 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 767/1539] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:23:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:23:49.082217 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=28 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:23:49.402811 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=8 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:25:14.883214 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8195e37f-012d-4970-8280-4b1647b77930 None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:14.885084 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8195e37f-012d-4970-8280-4b1647b77930 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:14.885084 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8195e37f-012d-4970-8280-4b1647b77930 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:14.915351 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-8195e37f-012d-4970-8280-4b1647b77930 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:25:14.916958 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-8195e37f-012d-4970-8280-4b1647b77930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:25:14.930030 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 773/1540] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:25:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:25:14.940971 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc0c902-dee4-4726-82ac-d32ace1c1e8a None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:14.942012 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc0c902-dee4-4726-82ac-d32ace1c1e8a None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:14.942532 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc0c902-dee4-4726-82ac-d32ace1c1e8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:14.975198 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-acc0c902-dee4-4726-82ac-d32ace1c1e8a None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:25:14.977039 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-acc0c902-dee4-4726-82ac-d32ace1c1e8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:25:14.988451 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 768/1541] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:25:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:25:14.993561 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8195e37f-012d-4970-8280-4b1647b77930 None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:15.007507 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e7ebe3-2201-430e-a8ab-22828b89e5c2 None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:15.009295 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e7ebe3-2201-430e-a8ab-22828b89e5c2 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:15.010034 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e7ebe3-2201-430e-a8ab-22828b89e5c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:15.012453 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8195e37f-012d-4970-8280-4b1647b77930 None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:15.024585 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a99367a-e3dc-458e-8b6b-54ad03355d66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:15.025731 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a99367a-e3dc-458e-8b6b-54ad03355d66 admin admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:15.028026 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a99367a-e3dc-458e-8b6b-54ad03355d66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:15.028536 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a99367a-e3dc-458e-8b6b-54ad03355d66 admin admin] PATH_INFO: `/v3/domains` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:15.029519 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a99367a-e3dc-458e-8b6b-54ad03355d66 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:25:15.035615 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a99367a-e3dc-458e-8b6b-54ad03355d66 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:15.037548 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a99367a-e3dc-458e-8b6b-54ad03355d66 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:15.057212 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-a1e7ebe3-2201-430e-a8ab-22828b89e5c2 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:25:15.059709 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-a1e7ebe3-2201-430e-a8ab-22828b89e5c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:25:15.062927 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 774/1542] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 16 17:25:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:25:15.076047 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 769/1543] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:25:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:25:15.081116 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a99367a-e3dc-458e-8b6b-54ad03355d66 admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:15.088688 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635006f5-785f-4bd4-844b-37209e1648b7 None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:15.090728 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635006f5-785f-4bd4-844b-37209e1648b7 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:15.092336 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635006f5-785f-4bd4-844b-37209e1648b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:15.096562 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a99367a-e3dc-458e-8b6b-54ad03355d66 admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:15.115256 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9b05a7-2b5e-49a5-b180-a27f187e1268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:15.118619 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9b05a7-2b5e-49a5-b180-a27f187e1268 admin admin] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:15.119223 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9b05a7-2b5e-49a5-b180-a27f187e1268 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:15.119706 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9b05a7-2b5e-49a5-b180-a27f187e1268 admin admin] PATH_INFO: `/v3/projects` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:15.120657 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9b05a7-2b5e-49a5-b180-a27f187e1268 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:15.123354 dv-cinder-837356-2-smb devstack@keystone.service[80874]: WARNING py.warnings [None req-6e9b05a7-2b5e-49a5-b180-a27f187e1268 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 16 17:25:15.123354 dv-cinder-837356-2-smb devstack@keystone.service[80874]: warnings.warn(msg) Jun 16 17:25:15.123354 dv-cinder-837356-2-smb devstack@keystone.service[80874]: Jun 16 17:25:15.125118 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9b05a7-2b5e-49a5-b180-a27f187e1268 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:15.137800 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-635006f5-785f-4bd4-844b-37209e1648b7 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:25:15.143894 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-635006f5-785f-4bd4-844b-37209e1648b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:25:15.165347 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 770/1544] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:25:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:25:15.170443 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635006f5-785f-4bd4-844b-37209e1648b7 None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:15.186067 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635006f5-785f-4bd4-844b-37209e1648b7 None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:15.192200 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93751f4-7511-478f-9aee-fafa39980f02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:15.193104 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93751f4-7511-478f-9aee-fafa39980f02 admin admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:15.193650 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93751f4-7511-478f-9aee-fafa39980f02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:15.194122 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93751f4-7511-478f-9aee-fafa39980f02 admin admin] PATH_INFO: `/v3/domains` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:15.195211 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93751f4-7511-478f-9aee-fafa39980f02 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80873) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:25:15.195711 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93751f4-7511-478f-9aee-fafa39980f02 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:15.196951 dv-cinder-837356-2-smb devstack@keystone.service[80873]: WARNING py.warnings [None req-d93751f4-7511-478f-9aee-fafa39980f02 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 17:25:15.196951 dv-cinder-837356-2-smb devstack@keystone.service[80873]: warnings.warn(msg) Jun 16 17:25:15.196951 dv-cinder-837356-2-smb devstack@keystone.service[80873]: Jun 16 17:25:15.198322 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93751f4-7511-478f-9aee-fafa39980f02 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:15.218788 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 771/1545] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 16 17:25:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 17:25:15.227199 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93751f4-7511-478f-9aee-fafa39980f02 admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:15.239329 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93751f4-7511-478f-9aee-fafa39980f02 admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:15.253057 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a34e235-83c9-459c-b25e-186f8122f0b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:15.253805 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a34e235-83c9-459c-b25e-186f8122f0b3 admin admin] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:15.254156 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a34e235-83c9-459c-b25e-186f8122f0b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:15.254441 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a34e235-83c9-459c-b25e-186f8122f0b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:15.255164 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a34e235-83c9-459c-b25e-186f8122f0b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:15.257162 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a34e235-83c9-459c-b25e-186f8122f0b3 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:15.269523 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 775/1546] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 16 17:25:15 2022] POST /identity/v3/projects => generated 385 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:25:15.277451 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fa8ee5-e7fe-4bc1-90a9-28fef047c680 None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:15.279597 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fa8ee5-e7fe-4bc1-90a9-28fef047c680 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:15.279597 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fa8ee5-e7fe-4bc1-90a9-28fef047c680 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:15.309992 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-e1fa8ee5-e7fe-4bc1-90a9-28fef047c680 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:25:15.311219 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-e1fa8ee5-e7fe-4bc1-90a9-28fef047c680 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:25:15.399545 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 776/1547] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:25:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:25:15.400467 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fa8ee5-e7fe-4bc1-90a9-28fef047c680 None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:15.411451 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fa8ee5-e7fe-4bc1-90a9-28fef047c680 None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:15.424437 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3213d4f-d245-40cc-86f7-b0bfb0f46b72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:15.425134 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3213d4f-d245-40cc-86f7-b0bfb0f46b72 admin admin] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:15.425444 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3213d4f-d245-40cc-86f7-b0bfb0f46b72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:15.425725 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3213d4f-d245-40cc-86f7-b0bfb0f46b72 admin admin] PATH_INFO: `/v3/users` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:15.426461 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3213d4f-d245-40cc-86f7-b0bfb0f46b72 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:15.428400 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3213d4f-d245-40cc-86f7-b0bfb0f46b72 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:15.441684 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 772/1548] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 16 17:25:15 2022] POST /identity/v3/projects => generated 393 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 17:25:15.443028 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f294bfc-64ba-48c4-a893-91a8b0248af4 None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:15.443329 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f294bfc-64ba-48c4-a893-91a8b0248af4 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:15.443614 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f294bfc-64ba-48c4-a893-91a8b0248af4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:15.463629 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-2f294bfc-64ba-48c4-a893-91a8b0248af4 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:25:15.467438 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-2f294bfc-64ba-48c4-a893-91a8b0248af4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:25:15.516073 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 777/1549] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 16 17:25:15 2022] POST /identity/v3/users => generated 293 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:25:15.517197 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f4fbfe-0eaa-4cea-a075-b88f89e79fe6 None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:15.517500 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f4fbfe-0eaa-4cea-a075-b88f89e79fe6 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:15.517807 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f4fbfe-0eaa-4cea-a075-b88f89e79fe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:15.525479 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 773/1550] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:25:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:25:15.526704 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b9c077-0582-4a4a-877f-958de29c6068 None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:15.527002 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b9c077-0582-4a4a-877f-958de29c6068 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:15.527286 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b9c077-0582-4a4a-877f-958de29c6068 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:15.537582 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-d3f4fbfe-0eaa-4cea-a075-b88f89e79fe6 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:25:15.539022 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-d3f4fbfe-0eaa-4cea-a075-b88f89e79fe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:25:15.546444 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-c4b9c077-0582-4a4a-877f-958de29c6068 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:25:15.547260 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 778/1551] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:25:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:25:15.547641 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-c4b9c077-0582-4a4a-877f-958de29c6068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:25:15.548498 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dad042a-928a-4d39-bf03-715c3d2db916 None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:15.548896 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dad042a-928a-4d39-bf03-715c3d2db916 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:15.549508 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dad042a-928a-4d39-bf03-715c3d2db916 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:15.563747 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 774/1552] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:25:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:25:15.565060 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d05447b-bc90-4ded-b4a4-2a66bf51bf82 None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:15.565329 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d05447b-bc90-4ded-b4a4-2a66bf51bf82 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:15.565613 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d05447b-bc90-4ded-b4a4-2a66bf51bf82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:15.570866 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-0dad042a-928a-4d39-bf03-715c3d2db916 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:25:15.572086 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-0dad042a-928a-4d39-bf03-715c3d2db916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:25:15.581130 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 779/1553] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:25:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:25:15.582427 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cce2df4-a7b5-466b-b19f-3273ebbd51c2 None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:15.582719 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cce2df4-a7b5-466b-b19f-3273ebbd51c2 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:15.583001 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cce2df4-a7b5-466b-b19f-3273ebbd51c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:15.593061 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-7d05447b-bc90-4ded-b4a4-2a66bf51bf82 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:25:15.594342 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-7d05447b-bc90-4ded-b4a4-2a66bf51bf82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:25:15.601384 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-0cce2df4-a7b5-466b-b19f-3273ebbd51c2 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:25:15.602588 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-0cce2df4-a7b5-466b-b19f-3273ebbd51c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:25:15.603061 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 775/1554] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:25:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:25:15.603841 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d05447b-bc90-4ded-b4a4-2a66bf51bf82 None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:15.612949 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 780/1555] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:25:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:25:15.613410 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d05447b-bc90-4ded-b4a4-2a66bf51bf82 None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:15.613739 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cce2df4-a7b5-466b-b19f-3273ebbd51c2 None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:15.618171 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c8421a-66c0-436f-b59e-6e81e7bdfd4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:15.618837 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c8421a-66c0-436f-b59e-6e81e7bdfd4b admin admin] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:15.619125 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c8421a-66c0-436f-b59e-6e81e7bdfd4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:15.619411 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c8421a-66c0-436f-b59e-6e81e7bdfd4b admin admin] PATH_INFO: `/v3/users` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:15.620100 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c8421a-66c0-436f-b59e-6e81e7bdfd4b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:15.621152 dv-cinder-837356-2-smb devstack@keystone.service[80873]: WARNING py.warnings [None req-c3c8421a-66c0-436f-b59e-6e81e7bdfd4b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 16 17:25:15.621152 dv-cinder-837356-2-smb devstack@keystone.service[80873]: warnings.warn(msg) Jun 16 17:25:15.621152 dv-cinder-837356-2-smb devstack@keystone.service[80873]: Jun 16 17:25:15.622683 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c8421a-66c0-436f-b59e-6e81e7bdfd4b admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:15.626247 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cce2df4-a7b5-466b-b19f-3273ebbd51c2 None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:15.630787 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5de8fa-3587-4ddf-b57b-fb3b598668fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:15.631441 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5de8fa-3587-4ddf-b57b-fb3b598668fa admin admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:15.631729 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5de8fa-3587-4ddf-b57b-fb3b598668fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:15.632009 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5de8fa-3587-4ddf-b57b-fb3b598668fa admin admin] PATH_INFO: `/v3/roles` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:15.632732 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5de8fa-3587-4ddf-b57b-fb3b598668fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:15.634343 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5de8fa-3587-4ddf-b57b-fb3b598668fa admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:15.644321 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 781/1556] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 17:25:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:25:15.648204 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156aab0f-e563-4724-be69-7f4f8a7eacae None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:15.648204 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156aab0f-e563-4724-be69-7f4f8a7eacae None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:15.648204 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156aab0f-e563-4724-be69-7f4f8a7eacae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:15.663914 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-156aab0f-e563-4724-be69-7f4f8a7eacae None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:25:15.665115 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-156aab0f-e563-4724-be69-7f4f8a7eacae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:25:15.673550 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 782/1557] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:25:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:25:15.674759 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614015dd-23aa-4dbe-b1a1-43d7febf7a06 None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:15.675068 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614015dd-23aa-4dbe-b1a1-43d7febf7a06 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:15.675327 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614015dd-23aa-4dbe-b1a1-43d7febf7a06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:15.692987 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-614015dd-23aa-4dbe-b1a1-43d7febf7a06 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:25:15.696753 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-614015dd-23aa-4dbe-b1a1-43d7febf7a06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:25:15.702255 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 783/1558] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:25:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:25:15.706161 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7377c63-9588-4fd7-90e1-d251a0193d63 None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:15.706161 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7377c63-9588-4fd7-90e1-d251a0193d63 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:15.706161 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7377c63-9588-4fd7-90e1-d251a0193d63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:15.723509 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 776/1559] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 16 17:25:15 2022] POST /identity/v3/users => generated 297 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:25:15.723509 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31b88c1-4bc7-4eff-bc37-60640a783353 None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:15.723509 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31b88c1-4bc7-4eff-bc37-60640a783353 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:15.723883 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-a7377c63-9588-4fd7-90e1-d251a0193d63 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:25:15.723984 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31b88c1-4bc7-4eff-bc37-60640a783353 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:15.724087 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-a7377c63-9588-4fd7-90e1-d251a0193d63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:25:15.731831 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 784/1560] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:25:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:25:15.732627 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7377c63-9588-4fd7-90e1-d251a0193d63 None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:15.741870 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-b31b88c1-4bc7-4eff-bc37-60640a783353 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:25:15.742641 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7377c63-9588-4fd7-90e1-d251a0193d63 None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:15.743142 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-b31b88c1-4bc7-4eff-bc37-60640a783353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:25:15.747118 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72813f1-928d-45cd-a758-3528846485d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:15.747769 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72813f1-928d-45cd-a758-3528846485d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:15.748060 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72813f1-928d-45cd-a758-3528846485d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:15.748344 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72813f1-928d-45cd-a758-3528846485d0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:15.749067 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72813f1-928d-45cd-a758-3528846485d0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:25:15.749384 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72813f1-928d-45cd-a758-3528846485d0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:15.751033 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72813f1-928d-45cd-a758-3528846485d0 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:15.751242 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 777/1561] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:25:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:25:15.755140 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc06558b-5697-4fc2-a833-74bc3c53be6d None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:15.755140 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc06558b-5697-4fc2-a833-74bc3c53be6d None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:15.755140 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc06558b-5697-4fc2-a833-74bc3c53be6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:15.774501 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 785/1562] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 16 17:25:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:25:15.774501 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72813f1-928d-45cd-a758-3528846485d0 admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:15.774804 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-fc06558b-5697-4fc2-a833-74bc3c53be6d None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:25:15.774804 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-fc06558b-5697-4fc2-a833-74bc3c53be6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:25:15.779953 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72813f1-928d-45cd-a758-3528846485d0 admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:15.784422 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 778/1563] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:25:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:25:15.784422 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc06558b-5697-4fc2-a833-74bc3c53be6d None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:15.785845 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5021ad7c-61a1-4fa4-81e1-3ab46556383e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:15.786539 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5021ad7c-61a1-4fa4-81e1-3ab46556383e admin admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:15.786831 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5021ad7c-61a1-4fa4-81e1-3ab46556383e admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:15.787110 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5021ad7c-61a1-4fa4-81e1-3ab46556383e admin admin] PATH_INFO: `/v3/roles` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:15.787839 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5021ad7c-61a1-4fa4-81e1-3ab46556383e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:15.789432 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5021ad7c-61a1-4fa4-81e1-3ab46556383e admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:15.791625 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc06558b-5697-4fc2-a833-74bc3c53be6d None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:15.796279 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c32939-5ed7-48c5-a529-c605cfb38151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:15.797559 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c32939-5ed7-48c5-a529-c605cfb38151 admin admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:15.797953 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c32939-5ed7-48c5-a529-c605cfb38151 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:15.798301 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c32939-5ed7-48c5-a529-c605cfb38151 admin admin] PATH_INFO: `/v3/domains` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:15.799101 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c32939-5ed7-48c5-a529-c605cfb38151 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80873) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:25:15.799481 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c32939-5ed7-48c5-a529-c605cfb38151 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:15.803649 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 786/1564] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 17:25:15 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:25:15.803814 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c32939-5ed7-48c5-a529-c605cfb38151 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:15.803912 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5021ad7c-61a1-4fa4-81e1-3ab46556383e admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:15.810735 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5021ad7c-61a1-4fa4-81e1-3ab46556383e admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:15.820255 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 779/1565] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 16 17:25:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:25:15.820255 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c32939-5ed7-48c5-a529-c605cfb38151 admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:15.821952 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffeb904-85a2-44d1-be47-0cec7132a465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:15.822618 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffeb904-85a2-44d1-be47-0cec7132a465 admin admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:15.822906 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffeb904-85a2-44d1-be47-0cec7132a465 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:15.823195 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffeb904-85a2-44d1-be47-0cec7132a465 admin admin] PATH_INFO: `/v3/domains` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:15.823593 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c32939-5ed7-48c5-a529-c605cfb38151 admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:15.823925 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffeb904-85a2-44d1-be47-0cec7132a465 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:25:15.824241 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffeb904-85a2-44d1-be47-0cec7132a465 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:15.825958 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffeb904-85a2-44d1-be47-0cec7132a465 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:15.829136 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822c8d08-ff9f-42f9-93af-2f19f19646e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:15.829968 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822c8d08-ff9f-42f9-93af-2f19f19646e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:15.830261 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822c8d08-ff9f-42f9-93af-2f19f19646e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:15.830546 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822c8d08-ff9f-42f9-93af-2f19f19646e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:15.831275 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822c8d08-ff9f-42f9-93af-2f19f19646e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:15.832888 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822c8d08-ff9f-42f9-93af-2f19f19646e6 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:15.844563 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 787/1566] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 16 17:25:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:25:15.844563 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffeb904-85a2-44d1-be47-0cec7132a465 admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:15.849944 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffeb904-85a2-44d1-be47-0cec7132a465 admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:15.853937 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 780/1567] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 17:25:15 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:25:15.853937 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822c8d08-ff9f-42f9-93af-2f19f19646e6 admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:15.854688 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ef11be-dece-4511-99a5-91c257446822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:15.855376 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ef11be-dece-4511-99a5-91c257446822 admin admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:15.855664 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ef11be-dece-4511-99a5-91c257446822 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:15.855947 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ef11be-dece-4511-99a5-91c257446822 admin admin] PATH_INFO: `/v3/domains` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:15.856681 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ef11be-dece-4511-99a5-91c257446822 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:25:15.856990 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ef11be-dece-4511-99a5-91c257446822 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:15.858671 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ef11be-dece-4511-99a5-91c257446822 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:15.864164 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822c8d08-ff9f-42f9-93af-2f19f19646e6 admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:15.868228 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:25:15.868858 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e56648-4ae4-4519-8cce-359f3bcd42a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:15.869520 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e56648-4ae4-4519-8cce-359f3bcd42a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:15.869837 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e56648-4ae4-4519-8cce-359f3bcd42a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:15.870124 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e56648-4ae4-4519-8cce-359f3bcd42a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:15.870850 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e56648-4ae4-4519-8cce-359f3bcd42a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80873) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:25:15.871164 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e56648-4ae4-4519-8cce-359f3bcd42a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:15.871554 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 788/1568] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 16 17:25:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:25:15.872282 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ef11be-dece-4511-99a5-91c257446822 admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:15.872899 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e56648-4ae4-4519-8cce-359f3bcd42a8 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:15.888041 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 781/1569] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 16 17:25:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:25:15.891411 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e56648-4ae4-4519-8cce-359f3bcd42a8 admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:15.892574 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ef11be-dece-4511-99a5-91c257446822 admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:15.897467 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db50f774-3fc9-47f4-8347-4c59bd412e1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:15.898176 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db50f774-3fc9-47f4-8347-4c59bd412e1f admin admin] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:15.898464 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db50f774-3fc9-47f4-8347-4c59bd412e1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:15.898744 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db50f774-3fc9-47f4-8347-4c59bd412e1f admin admin] PATH_INFO: `/v3/projects` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:15.899448 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db50f774-3fc9-47f4-8347-4c59bd412e1f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:15.901722 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db50f774-3fc9-47f4-8347-4c59bd412e1f admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:15.904922 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e56648-4ae4-4519-8cce-359f3bcd42a8 admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:15.910106 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91f9b69-4ac6-46c1-b639-0217b67caa01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:15.910807 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91f9b69-4ac6-46c1-b639-0217b67caa01 admin admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:15.911100 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91f9b69-4ac6-46c1-b639-0217b67caa01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:15.911385 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91f9b69-4ac6-46c1-b639-0217b67caa01 admin admin] PATH_INFO: `/v3/domains` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:15.912172 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91f9b69-4ac6-46c1-b639-0217b67caa01 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80873) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:25:15.912430 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91f9b69-4ac6-46c1-b639-0217b67caa01 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:15.914049 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91f9b69-4ac6-46c1-b639-0217b67caa01 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:15.925978 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 782/1570] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 16 17:25:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:25:15.926933 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91f9b69-4ac6-46c1-b639-0217b67caa01 admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:15.938648 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91f9b69-4ac6-46c1-b639-0217b67caa01 admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:15.944975 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8631c43-0306-453c-8818-4fbf782a0939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:15.946010 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8631c43-0306-453c-8818-4fbf782a0939 admin admin] REQUEST_METHOD: `PUT` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:15.949700 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8631c43-0306-453c-8818-4fbf782a0939 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:15.949700 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8631c43-0306-453c-8818-4fbf782a0939 admin admin] PATH_INFO: `/v3/projects/5ccbcba2cdff4494a76d2943a94afa7c/users/eb9bfaa760984a83abe993eb2d8abd04/roles/896bff49c5d6464eb612a15f4aa9badc` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:15.960065 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:25:15.967023 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8631c43-0306-453c-8818-4fbf782a0939 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ccbcba2cdff4494a76d2943a94afa7c, user_id=eb9bfaa760984a83abe993eb2d8abd04, role_id=896bff49c5d6464eb612a15f4aa9badc)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:15.970474 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8631c43-0306-453c-8818-4fbf782a0939 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:15.978175 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 789/1571] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 16 17:25:15 2022] POST /identity/v3/projects => generated 383 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:25:15.979262 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db50f774-3fc9-47f4-8347-4c59bd412e1f admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:16.042799 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db50f774-3fc9-47f4-8347-4c59bd412e1f admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:16.047443 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ba4c49-97a5-448a-ae56-68d7427fd481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:16.048106 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ba4c49-97a5-448a-ae56-68d7427fd481 admin admin] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:16.048394 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ba4c49-97a5-448a-ae56-68d7427fd481 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:16.049008 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ba4c49-97a5-448a-ae56-68d7427fd481 admin admin] PATH_INFO: `/v3/projects` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:16.049378 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ba4c49-97a5-448a-ae56-68d7427fd481 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:16.051393 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ba4c49-97a5-448a-ae56-68d7427fd481 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:16.062264 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 783/1572] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 17:25:15 2022] PUT /identity/v3/projects/5ccbcba2cdff4494a76d2943a94afa7c/users/eb9bfaa760984a83abe993eb2d8abd04/roles/896bff49c5d6464eb612a15f4aa9badc => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:25:16.063079 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8631c43-0306-453c-8818-4fbf782a0939 admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:16.131951 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8631c43-0306-453c-8818-4fbf782a0939 admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:16.136682 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4d9d5a-930f-448d-9bfc-5cca7a293646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:16.137344 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4d9d5a-930f-448d-9bfc-5cca7a293646 admin admin] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:16.137629 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4d9d5a-930f-448d-9bfc-5cca7a293646 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:16.137935 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4d9d5a-930f-448d-9bfc-5cca7a293646 admin admin] PATH_INFO: `/v3/projects` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:16.138636 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4d9d5a-930f-448d-9bfc-5cca7a293646 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:16.141079 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4d9d5a-930f-448d-9bfc-5cca7a293646 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:16.159652 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 790/1573] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 16 17:25:15 2022] POST /identity/v3/projects => generated 375 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:25:16.161528 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ba4c49-97a5-448a-ae56-68d7427fd481 admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:16.221502 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ba4c49-97a5-448a-ae56-68d7427fd481 admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:16.227699 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6867b2f6-7eec-448a-bc1f-93ee6a09af63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:16.228374 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6867b2f6-7eec-448a-bc1f-93ee6a09af63 admin admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:16.228663 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6867b2f6-7eec-448a-bc1f-93ee6a09af63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:16.228944 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6867b2f6-7eec-448a-bc1f-93ee6a09af63 admin admin] PATH_INFO: `/v3/roles` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:16.229796 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6867b2f6-7eec-448a-bc1f-93ee6a09af63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:16.231393 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6867b2f6-7eec-448a-bc1f-93ee6a09af63 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:16.235333 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 784/1574] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 16 17:25:16 2022] POST /identity/v3/projects => generated 379 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:25:16.241902 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4d9d5a-930f-448d-9bfc-5cca7a293646 admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:16.248376 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 791/1575] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 17:25:16 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:25:16.248376 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6867b2f6-7eec-448a-bc1f-93ee6a09af63 admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:16.256512 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6867b2f6-7eec-448a-bc1f-93ee6a09af63 admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:16.302610 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4d9d5a-930f-448d-9bfc-5cca7a293646 admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:16.307446 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f9d849-89b8-496b-8673-bc10cdaee45a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:16.308111 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f9d849-89b8-496b-8673-bc10cdaee45a admin admin] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:16.308402 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f9d849-89b8-496b-8673-bc10cdaee45a admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:16.308715 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f9d849-89b8-496b-8673-bc10cdaee45a admin admin] PATH_INFO: `/v3/projects` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:16.309433 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f9d849-89b8-496b-8673-bc10cdaee45a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:16.311552 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f9d849-89b8-496b-8673-bc10cdaee45a admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:16.313561 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8204507c-fd60-40d9-b748-547301c4a7a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:16.314289 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8204507c-fd60-40d9-b748-547301c4a7a7 admin admin] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:16.314556 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8204507c-fd60-40d9-b748-547301c4a7a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:16.314846 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8204507c-fd60-40d9-b748-547301c4a7a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:16.315547 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8204507c-fd60-40d9-b748-547301c4a7a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:16.317473 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8204507c-fd60-40d9-b748-547301c4a7a7 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:16.320779 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:25:16.432974 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 785/1576] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 16 17:25:16 2022] POST /identity/v3/projects => generated 377 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:25:16.433885 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f9d849-89b8-496b-8673-bc10cdaee45a admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:16.447689 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 792/1577] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 16 17:25:16 2022] POST /identity/v3/projects => generated 385 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:25:16.448549 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8204507c-fd60-40d9-b748-547301c4a7a7 admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:16.495507 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:25:16.500248 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f9d849-89b8-496b-8673-bc10cdaee45a admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:16.511975 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8204507c-fd60-40d9-b748-547301c4a7a7 admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:16.517288 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc16433-7354-48f6-aac1-a6c30ab2b703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:16.517982 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc16433-7354-48f6-aac1-a6c30ab2b703 admin admin] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:16.518269 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc16433-7354-48f6-aac1-a6c30ab2b703 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:16.518550 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc16433-7354-48f6-aac1-a6c30ab2b703 admin admin] PATH_INFO: `/v3/users` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:16.519239 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc16433-7354-48f6-aac1-a6c30ab2b703 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:16.521181 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc16433-7354-48f6-aac1-a6c30ab2b703 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:16.556730 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a226e7-6345-4286-b112-0707e44467b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:16.557396 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a226e7-6345-4286-b112-0707e44467b4 admin admin] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:16.557687 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a226e7-6345-4286-b112-0707e44467b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:16.558004 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a226e7-6345-4286-b112-0707e44467b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:16.558842 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a226e7-6345-4286-b112-0707e44467b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:16.561278 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a226e7-6345-4286-b112-0707e44467b4 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:16.605508 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 793/1578] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 16 17:25:16 2022] POST /identity/v3/users => generated 292 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:25:16.606829 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbf3d56-b89c-4d77-845f-ddfa79c5e087 None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:16.607143 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbf3d56-b89c-4d77-845f-ddfa79c5e087 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:16.607422 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbf3d56-b89c-4d77-845f-ddfa79c5e087 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:16.633941 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-bfbf3d56-b89c-4d77-845f-ddfa79c5e087 None None] MFA Rules not processed for user `eb9bfaa760984a83abe993eb2d8abd04`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:25:16.635176 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-bfbf3d56-b89c-4d77-845f-ddfa79c5e087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:25:16.693948 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 786/1579] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 16 17:25:16 2022] POST /identity/v3/projects => generated 369 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:25:16.693948 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a226e7-6345-4286-b112-0707e44467b4 admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:16.699632 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 794/1580] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:25:16 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:25:16.700456 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbf3d56-b89c-4d77-845f-ddfa79c5e087 None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:16.711232 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbf3d56-b89c-4d77-845f-ddfa79c5e087 None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:16.758776 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a226e7-6345-4286-b112-0707e44467b4 admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:16.763291 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1033fb9-5291-4c99-b708-853413a6606d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:16.763960 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1033fb9-5291-4c99-b708-853413a6606d admin admin] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:16.764246 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1033fb9-5291-4c99-b708-853413a6606d admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:16.764522 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1033fb9-5291-4c99-b708-853413a6606d admin admin] PATH_INFO: `/v3/users` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:16.765721 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1033fb9-5291-4c99-b708-853413a6606d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:16.767862 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1033fb9-5291-4c99-b708-853413a6606d admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:16.768019 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868f9159-f863-43d3-8cbb-baedb0d49fc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:16.768555 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868f9159-f863-43d3-8cbb-baedb0d49fc1 admin admin] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:16.768945 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868f9159-f863-43d3-8cbb-baedb0d49fc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:16.769160 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868f9159-f863-43d3-8cbb-baedb0d49fc1 admin admin] PATH_INFO: `/v3/users` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:16.769899 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868f9159-f863-43d3-8cbb-baedb0d49fc1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:16.771841 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868f9159-f863-43d3-8cbb-baedb0d49fc1 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:16.780309 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:25:16.869031 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 787/1581] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 16 17:25:16 2022] POST /identity/v3/users => generated 288 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:25:16.870081 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1033fb9-5291-4c99-b708-853413a6606d admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:16.879855 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1033fb9-5291-4c99-b708-853413a6606d admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:16.884414 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e5b617-c9cf-43e3-86d8-833665cd0df7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:16.885297 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e5b617-c9cf-43e3-86d8-833665cd0df7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:16.885589 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e5b617-c9cf-43e3-86d8-833665cd0df7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:16.885918 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e5b617-c9cf-43e3-86d8-833665cd0df7 admin admin] PATH_INFO: `/v3/projects/62574e03c88b4fc8b9d2810e19a333ae/users/695942c4783a4d45874ff48f29ff9638/roles/896bff49c5d6464eb612a15f4aa9badc` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:16.902482 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e5b617-c9cf-43e3-86d8-833665cd0df7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=62574e03c88b4fc8b9d2810e19a333ae, user_id=695942c4783a4d45874ff48f29ff9638, role_id=896bff49c5d6464eb612a15f4aa9badc)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:16.905202 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e5b617-c9cf-43e3-86d8-833665cd0df7 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:16.907292 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 795/1582] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 16 17:25:16 2022] POST /identity/v3/users => generated 290 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:25:16.908094 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868f9159-f863-43d3-8cbb-baedb0d49fc1 admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:16.917852 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868f9159-f863-43d3-8cbb-baedb0d49fc1 admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:16.922568 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f8779f-80c1-4084-b98b-3a1dc16e8345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:16.923227 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f8779f-80c1-4084-b98b-3a1dc16e8345 admin admin] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:16.923519 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f8779f-80c1-4084-b98b-3a1dc16e8345 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:16.923799 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f8779f-80c1-4084-b98b-3a1dc16e8345 admin admin] PATH_INFO: `/v3/users` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:16.924564 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f8779f-80c1-4084-b98b-3a1dc16e8345 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:16.926507 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f8779f-80c1-4084-b98b-3a1dc16e8345 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:17.047308 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 788/1583] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 17:25:16 2022] PUT /identity/v3/projects/62574e03c88b4fc8b9d2810e19a333ae/users/695942c4783a4d45874ff48f29ff9638/roles/896bff49c5d6464eb612a15f4aa9badc => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:25:17.047837 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 796/1584] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 16 17:25:16 2022] POST /identity/v3/users => generated 289 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:25:17.047940 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e5b617-c9cf-43e3-86d8-833665cd0df7 admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:17.050531 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f8779f-80c1-4084-b98b-3a1dc16e8345 admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:17.056534 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f8779f-80c1-4084-b98b-3a1dc16e8345 admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:17.115142 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb044a7f-d1f2-49fc-b38b-6754605f443e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:17.115380 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:25:17.115825 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb044a7f-d1f2-49fc-b38b-6754605f443e admin admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:17.116118 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb044a7f-d1f2-49fc-b38b-6754605f443e admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:17.116404 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb044a7f-d1f2-49fc-b38b-6754605f443e admin admin] PATH_INFO: `/v3/roles` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:17.117144 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb044a7f-d1f2-49fc-b38b-6754605f443e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:17.118822 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb044a7f-d1f2-49fc-b38b-6754605f443e admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:17.120409 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e5b617-c9cf-43e3-86d8-833665cd0df7 admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:17.125509 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9c374d-7c29-4156-b0a7-35e807d764e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:17.126238 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9c374d-7c29-4156-b0a7-35e807d764e5 admin admin] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:17.126524 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9c374d-7c29-4156-b0a7-35e807d764e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:17.126865 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9c374d-7c29-4156-b0a7-35e807d764e5 admin admin] PATH_INFO: `/v3/users` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:17.127621 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9c374d-7c29-4156-b0a7-35e807d764e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:17.129514 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9c374d-7c29-4156-b0a7-35e807d764e5 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:17.129918 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 797/1585] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 17:25:17 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:25:17.130722 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb044a7f-d1f2-49fc-b38b-6754605f443e admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:17.141567 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb044a7f-d1f2-49fc-b38b-6754605f443e admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:17.146272 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1043d0f1-bcdc-4ed5-89ea-12623541fb0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:17.146941 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1043d0f1-bcdc-4ed5-89ea-12623541fb0f admin admin] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:17.147283 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1043d0f1-bcdc-4ed5-89ea-12623541fb0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:17.147673 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1043d0f1-bcdc-4ed5-89ea-12623541fb0f admin admin] PATH_INFO: `/v3/users` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:17.148447 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1043d0f1-bcdc-4ed5-89ea-12623541fb0f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:17.150415 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1043d0f1-bcdc-4ed5-89ea-12623541fb0f admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:17.239413 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 789/1586] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 16 17:25:17 2022] POST /identity/v3/users => generated 293 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:25:17.239413 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9c374d-7c29-4156-b0a7-35e807d764e5 admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:17.248974 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9c374d-7c29-4156-b0a7-35e807d764e5 admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:17.255188 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc33f674-d486-4ae5-b85c-c7a644d5b3aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:17.255829 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc33f674-d486-4ae5-b85c-c7a644d5b3aa admin admin] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:17.256123 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc33f674-d486-4ae5-b85c-c7a644d5b3aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:17.256408 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc33f674-d486-4ae5-b85c-c7a644d5b3aa admin admin] PATH_INFO: `/v3/projects` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:17.257127 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc33f674-d486-4ae5-b85c-c7a644d5b3aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:17.259522 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc33f674-d486-4ae5-b85c-c7a644d5b3aa admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:17.272793 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 798/1587] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 16 17:25:17 2022] POST /identity/v3/users => generated 285 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:25:17.277520 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1043d0f1-bcdc-4ed5-89ea-12623541fb0f admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:17.283138 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1043d0f1-bcdc-4ed5-89ea-12623541fb0f admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:17.287813 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836a5a41-1e16-444d-b40e-cc6feb76cc32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:17.288466 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836a5a41-1e16-444d-b40e-cc6feb76cc32 admin admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:17.288854 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836a5a41-1e16-444d-b40e-cc6feb76cc32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:17.289041 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836a5a41-1e16-444d-b40e-cc6feb76cc32 admin admin] PATH_INFO: `/v3/roles` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:17.289786 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836a5a41-1e16-444d-b40e-cc6feb76cc32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:17.291399 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836a5a41-1e16-444d-b40e-cc6feb76cc32 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:17.302691 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 799/1588] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 17:25:17 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:25:17.303531 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836a5a41-1e16-444d-b40e-cc6feb76cc32 admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:17.313647 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836a5a41-1e16-444d-b40e-cc6feb76cc32 admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:17.318426 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17eccfe4-de06-4f30-9d97-3dc1b10d994e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:17.319069 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17eccfe4-de06-4f30-9d97-3dc1b10d994e admin admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:17.319358 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17eccfe4-de06-4f30-9d97-3dc1b10d994e admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:17.319638 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17eccfe4-de06-4f30-9d97-3dc1b10d994e admin admin] PATH_INFO: `/v3/roles` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:17.320351 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17eccfe4-de06-4f30-9d97-3dc1b10d994e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:17.321951 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17eccfe4-de06-4f30-9d97-3dc1b10d994e admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:17.331962 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 800/1589] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 17:25:17 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:25:17.332738 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17eccfe4-de06-4f30-9d97-3dc1b10d994e admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:17.342167 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17eccfe4-de06-4f30-9d97-3dc1b10d994e admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:17.349267 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06732f60-bd9b-473f-9cbd-ddbe478ed752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:17.349949 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06732f60-bd9b-473f-9cbd-ddbe478ed752 admin admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:17.350242 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06732f60-bd9b-473f-9cbd-ddbe478ed752 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:17.350526 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06732f60-bd9b-473f-9cbd-ddbe478ed752 admin admin] PATH_INFO: `/v3/roles` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:17.351282 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06732f60-bd9b-473f-9cbd-ddbe478ed752 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:17.352869 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06732f60-bd9b-473f-9cbd-ddbe478ed752 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:17.363963 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 801/1590] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 17:25:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:25:17.365025 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4e8ca5-d01c-429e-8739-d9c2991240eb None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:17.365386 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4e8ca5-d01c-429e-8739-d9c2991240eb None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:17.365681 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4e8ca5-d01c-429e-8739-d9c2991240eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:17.372902 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 790/1591] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 16 17:25:17 2022] POST /identity/v3/projects => generated 387 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:25:17.373952 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc33f674-d486-4ae5-b85c-c7a644d5b3aa admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:17.384512 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-aa4e8ca5-d01c-429e-8739-d9c2991240eb None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:25:17.385740 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-aa4e8ca5-d01c-429e-8739-d9c2991240eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:25:17.439262 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc33f674-d486-4ae5-b85c-c7a644d5b3aa admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:17.443914 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1e4d7c-6281-41a2-89d1-4a4d7d06ee6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:17.444588 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1e4d7c-6281-41a2-89d1-4a4d7d06ee6b admin admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:17.444878 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1e4d7c-6281-41a2-89d1-4a4d7d06ee6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:17.445160 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1e4d7c-6281-41a2-89d1-4a4d7d06ee6b admin admin] PATH_INFO: `/v3/roles` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:17.445927 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1e4d7c-6281-41a2-89d1-4a4d7d06ee6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:17.447559 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1e4d7c-6281-41a2-89d1-4a4d7d06ee6b admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:17.448106 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 802/1592] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:25:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:25:17.448774 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4e8ca5-d01c-429e-8739-d9c2991240eb None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:17.458852 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4e8ca5-d01c-429e-8739-d9c2991240eb None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:17.459676 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 791/1593] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 17:25:17 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:25:17.460543 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1e4d7c-6281-41a2-89d1-4a4d7d06ee6b admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:17.467333 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29860372-7558-4ed8-b2dc-88bbb0970064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:17.467992 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29860372-7558-4ed8-b2dc-88bbb0970064 admin admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:17.468814 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29860372-7558-4ed8-b2dc-88bbb0970064 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:17.469099 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29860372-7558-4ed8-b2dc-88bbb0970064 admin admin] PATH_INFO: `/v3/roles` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:17.469862 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29860372-7558-4ed8-b2dc-88bbb0970064 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:17.471470 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29860372-7558-4ed8-b2dc-88bbb0970064 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:17.474021 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1e4d7c-6281-41a2-89d1-4a4d7d06ee6b admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:17.479002 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5029cfbb-371b-44eb-a656-98c3b615d55e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:17.479671 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5029cfbb-371b-44eb-a656-98c3b615d55e admin admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:17.479973 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5029cfbb-371b-44eb-a656-98c3b615d55e admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:17.480257 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5029cfbb-371b-44eb-a656-98c3b615d55e admin admin] PATH_INFO: `/v3/roles` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:17.480982 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5029cfbb-371b-44eb-a656-98c3b615d55e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:17.484312 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 803/1594] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 17:25:17 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:25:17.484312 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29860372-7558-4ed8-b2dc-88bbb0970064 admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:17.484544 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5029cfbb-371b-44eb-a656-98c3b615d55e admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:17.491916 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29860372-7558-4ed8-b2dc-88bbb0970064 admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:17.496304 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 792/1595] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 17:25:17 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:25:17.496304 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5029cfbb-371b-44eb-a656-98c3b615d55e admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:17.496553 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4422f149-7a1e-432f-ad8d-dc9d2daf57f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:17.497167 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4422f149-7a1e-432f-ad8d-dc9d2daf57f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:17.497449 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4422f149-7a1e-432f-ad8d-dc9d2daf57f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:17.497725 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4422f149-7a1e-432f-ad8d-dc9d2daf57f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:17.498470 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4422f149-7a1e-432f-ad8d-dc9d2daf57f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:17.500640 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4422f149-7a1e-432f-ad8d-dc9d2daf57f4 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:17.504697 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5029cfbb-371b-44eb-a656-98c3b615d55e admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:17.506606 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:INSERT=7,keystone:SELECT=93 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:25:17.509582 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb9283b-6f51-43bc-9e0e-530e5a26c0b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:17.510270 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb9283b-6f51-43bc-9e0e-530e5a26c0b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:17.510564 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb9283b-6f51-43bc-9e0e-530e5a26c0b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:17.510879 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb9283b-6f51-43bc-9e0e-530e5a26c0b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:17.511706 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb9283b-6f51-43bc-9e0e-530e5a26c0b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:17.511864 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 804/1596] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 17:25:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:25:17.512656 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4422f149-7a1e-432f-ad8d-dc9d2daf57f4 admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:17.513704 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb9283b-6f51-43bc-9e0e-530e5a26c0b7 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:17.523166 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4422f149-7a1e-432f-ad8d-dc9d2daf57f4 admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:17.525518 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 793/1597] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 17:25:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:25:17.526415 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb9283b-6f51-43bc-9e0e-530e5a26c0b7 admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:17.528692 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f120b1-5001-4c61-8ad4-d582dd667945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:17.529360 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f120b1-5001-4c61-8ad4-d582dd667945 admin admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:17.529656 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f120b1-5001-4c61-8ad4-d582dd667945 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:17.530045 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f120b1-5001-4c61-8ad4-d582dd667945 admin admin] PATH_INFO: `/v3/roles` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:17.531402 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f120b1-5001-4c61-8ad4-d582dd667945 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:17.533078 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f120b1-5001-4c61-8ad4-d582dd667945 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:17.537034 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb9283b-6f51-43bc-9e0e-530e5a26c0b7 admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:17.545344 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7343d7a-abfb-4cde-8210-75b268f2777c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:17.545344 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7343d7a-abfb-4cde-8210-75b268f2777c admin admin] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:17.545344 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7343d7a-abfb-4cde-8210-75b268f2777c admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:17.545344 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7343d7a-abfb-4cde-8210-75b268f2777c admin admin] PATH_INFO: `/v3/users` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:17.545746 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7343d7a-abfb-4cde-8210-75b268f2777c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:17.545860 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 805/1598] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 17:25:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:25:17.545860 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f120b1-5001-4c61-8ad4-d582dd667945 admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:17.546049 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7343d7a-abfb-4cde-8210-75b268f2777c admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:17.604521 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f120b1-5001-4c61-8ad4-d582dd667945 admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:17.608223 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b782c07-8e01-4c27-8657-02ac3ec3319e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5d25bfa8dc042329d57cd55fa7b7b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:17.608938 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b782c07-8e01-4c27-8657-02ac3ec3319e service neutron] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:17.609231 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b782c07-8e01-4c27-8657-02ac3ec3319e service neutron] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:17.609513 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b782c07-8e01-4c27-8657-02ac3ec3319e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:17.619173 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b782c07-8e01-4c27-8657-02ac3ec3319e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:17.620609 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b782c07-8e01-4c27-8657-02ac3ec3319e service neutron] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:17.630024 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 806/1599] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:25:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:25:17.630784 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b782c07-8e01-4c27-8657-02ac3ec3319e service neutron] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:17.640490 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b782c07-8e01-4c27-8657-02ac3ec3319e service neutron] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:17.643846 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 794/1600] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 16 17:25:17 2022] POST /identity/v3/users => generated 300 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:25:17.644741 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7343d7a-abfb-4cde-8210-75b268f2777c admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:17.645277 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31d0e62-771d-459f-a34c-a477a472acd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:17.646217 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31d0e62-771d-459f-a34c-a477a472acd2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:17.646494 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31d0e62-771d-459f-a34c-a477a472acd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:17.646779 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31d0e62-771d-459f-a34c-a477a472acd2 admin admin] PATH_INFO: `/v3/projects/dda7e219d9944e6eb1eda6744cfe1291/users/1ab72dc790a44d94a179b8fb1e4d04bd/roles/896bff49c5d6464eb612a15f4aa9badc` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:17.655488 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7343d7a-abfb-4cde-8210-75b268f2777c admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:17.660915 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d38875f-6a5d-4e22-bdd1-6fcd2e5a4d1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:17.661577 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d38875f-6a5d-4e22-bdd1-6fcd2e5a4d1a admin admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:17.661902 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d38875f-6a5d-4e22-bdd1-6fcd2e5a4d1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:17.662190 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d38875f-6a5d-4e22-bdd1-6fcd2e5a4d1a admin admin] PATH_INFO: `/v3/roles` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:17.662922 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d38875f-6a5d-4e22-bdd1-6fcd2e5a4d1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:17.663915 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31d0e62-771d-459f-a34c-a477a472acd2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dda7e219d9944e6eb1eda6744cfe1291, user_id=1ab72dc790a44d94a179b8fb1e4d04bd, role_id=896bff49c5d6464eb612a15f4aa9badc)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:17.664572 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d38875f-6a5d-4e22-bdd1-6fcd2e5a4d1a admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:17.664962 dv-cinder-837356-2-smb devstack@keystone.service[80874]: WARNING py.warnings [None req-c31d0e62-771d-459f-a34c-a477a472acd2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 16 17:25:17.664962 dv-cinder-837356-2-smb devstack@keystone.service[80874]: warnings.warn(msg) Jun 16 17:25:17.664962 dv-cinder-837356-2-smb devstack@keystone.service[80874]: Jun 16 17:25:17.667078 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31d0e62-771d-459f-a34c-a477a472acd2 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:17.675234 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 795/1601] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 17:25:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:25:17.676039 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d38875f-6a5d-4e22-bdd1-6fcd2e5a4d1a admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:17.685455 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d38875f-6a5d-4e22-bdd1-6fcd2e5a4d1a admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:17.690690 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b0a06b-b482-4763-b039-0c693f115677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:17.691325 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b0a06b-b482-4763-b039-0c693f115677 admin admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:17.691617 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b0a06b-b482-4763-b039-0c693f115677 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:17.691901 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b0a06b-b482-4763-b039-0c693f115677 admin admin] PATH_INFO: `/v3/roles` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:17.692617 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b0a06b-b482-4763-b039-0c693f115677 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:17.694244 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b0a06b-b482-4763-b039-0c693f115677 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:17.705394 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 796/1602] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 17:25:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:25:17.706183 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b0a06b-b482-4763-b039-0c693f115677 admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:17.715447 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b0a06b-b482-4763-b039-0c693f115677 admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:17.720097 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4178fe98-1890-4101-9fc7-cb88469c0dd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:17.720930 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4178fe98-1890-4101-9fc7-cb88469c0dd9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:17.721222 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4178fe98-1890-4101-9fc7-cb88469c0dd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:17.721494 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4178fe98-1890-4101-9fc7-cb88469c0dd9 admin admin] PATH_INFO: `/v3/projects/dfaa32b4384e4876b99b966c30c84226/users/1a502436185146d8a24dc8e226e0ed21/roles/896bff49c5d6464eb612a15f4aa9badc` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:17.735985 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4178fe98-1890-4101-9fc7-cb88469c0dd9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dfaa32b4384e4876b99b966c30c84226, user_id=1a502436185146d8a24dc8e226e0ed21, role_id=896bff49c5d6464eb612a15f4aa9badc)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:17.740682 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4178fe98-1890-4101-9fc7-cb88469c0dd9 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:17.803634 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 807/1603] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 17:25:17 2022] PUT /identity/v3/projects/dda7e219d9944e6eb1eda6744cfe1291/users/1ab72dc790a44d94a179b8fb1e4d04bd/roles/896bff49c5d6464eb612a15f4aa9badc => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:25:17.803634 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31d0e62-771d-459f-a34c-a477a472acd2 admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:17.860479 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 797/1604] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 17:25:17 2022] PUT /identity/v3/projects/dfaa32b4384e4876b99b966c30c84226/users/1a502436185146d8a24dc8e226e0ed21/roles/896bff49c5d6464eb612a15f4aa9badc => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:25:17.866024 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31d0e62-771d-459f-a34c-a477a472acd2 admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:17.868101 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4178fe98-1890-4101-9fc7-cb88469c0dd9 admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:17.922462 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:25:17.940464 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaa1eab-61e7-4e9a-bce0-1c84697b2748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:17.941281 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaa1eab-61e7-4e9a-bce0-1c84697b2748 admin admin] REQUEST_METHOD: `PUT` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:17.941563 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaa1eab-61e7-4e9a-bce0-1c84697b2748 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:17.942043 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaa1eab-61e7-4e9a-bce0-1c84697b2748 admin admin] PATH_INFO: `/v3/projects/7f8a1bf102df4dc3ae9c1fa94c5863a8/users/b2dcab3652474b53b88e9443c0458721/roles/896bff49c5d6464eb612a15f4aa9badc` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:17.955348 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4178fe98-1890-4101-9fc7-cb88469c0dd9 admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:17.959274 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efaa1eab-61e7-4e9a-bce0-1c84697b2748 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f8a1bf102df4dc3ae9c1fa94c5863a8, user_id=b2dcab3652474b53b88e9443c0458721, role_id=896bff49c5d6464eb612a15f4aa9badc)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:17.961368 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16008950-2661-4c48-95b2-70c26234c120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:17.962376 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16008950-2661-4c48-95b2-70c26234c120 admin admin] REQUEST_METHOD: `PUT` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:17.962490 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efaa1eab-61e7-4e9a-bce0-1c84697b2748 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:17.962722 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16008950-2661-4c48-95b2-70c26234c120 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:17.963080 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16008950-2661-4c48-95b2-70c26234c120 admin admin] PATH_INFO: `/v3/projects/0c7f641c33de487eb9f4a6c75734caaa/users/9497772835074d40b7f748507eb539b7/roles/896bff49c5d6464eb612a15f4aa9badc` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:17.981334 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16008950-2661-4c48-95b2-70c26234c120 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c7f641c33de487eb9f4a6c75734caaa, user_id=9497772835074d40b7f748507eb539b7, role_id=896bff49c5d6464eb612a15f4aa9badc)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:17.984168 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16008950-2661-4c48-95b2-70c26234c120 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:18.106962 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:25:18.112904 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 798/1605] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 17:25:17 2022] PUT /identity/v3/projects/0c7f641c33de487eb9f4a6c75734caaa/users/9497772835074d40b7f748507eb539b7/roles/896bff49c5d6464eb612a15f4aa9badc => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:25:18.113685 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16008950-2661-4c48-95b2-70c26234c120 admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:18.118101 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 808/1606] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 17:25:17 2022] PUT /identity/v3/projects/7f8a1bf102df4dc3ae9c1fa94c5863a8/users/b2dcab3652474b53b88e9443c0458721/roles/896bff49c5d6464eb612a15f4aa9badc => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:25:18.118101 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaa1eab-61e7-4e9a-bce0-1c84697b2748 admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:18.181334 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16008950-2661-4c48-95b2-70c26234c120 admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:18.186375 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593fc7f2-3c05-44a3-96bc-8e7d509104ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:18.187651 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593fc7f2-3c05-44a3-96bc-8e7d509104ec admin admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:18.187985 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593fc7f2-3c05-44a3-96bc-8e7d509104ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:18.188223 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593fc7f2-3c05-44a3-96bc-8e7d509104ec admin admin] PATH_INFO: `/v3/roles` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:18.188967 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593fc7f2-3c05-44a3-96bc-8e7d509104ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:18.190601 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaa1eab-61e7-4e9a-bce0-1c84697b2748 admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:18.190746 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593fc7f2-3c05-44a3-96bc-8e7d509104ec admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:18.197155 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbe3b21-9984-41b3-a735-10ea537a9968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:18.198597 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbe3b21-9984-41b3-a735-10ea537a9968 admin admin] REQUEST_METHOD: `PUT` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:18.199497 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbe3b21-9984-41b3-a735-10ea537a9968 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:18.199497 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbe3b21-9984-41b3-a735-10ea537a9968 admin admin] PATH_INFO: `/v3/projects/1ccbc44615794a719bb36d6718f83762/users/40257d052ad341bfb3264b1f94e59361/roles/896bff49c5d6464eb612a15f4aa9badc` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:18.202479 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 799/1607] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 17:25:18 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:25:18.203191 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593fc7f2-3c05-44a3-96bc-8e7d509104ec admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:18.216983 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593fc7f2-3c05-44a3-96bc-8e7d509104ec admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:18.220070 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbe3b21-9984-41b3-a735-10ea537a9968 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ccbc44615794a719bb36d6718f83762, user_id=40257d052ad341bfb3264b1f94e59361, role_id=896bff49c5d6464eb612a15f4aa9badc)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:18.222816 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ab2318-8559-4717-861b-c4c9bfaf9fcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:18.223002 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbe3b21-9984-41b3-a735-10ea537a9968 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:18.223728 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ab2318-8559-4717-861b-c4c9bfaf9fcc admin admin] REQUEST_METHOD: `PUT` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:18.224017 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ab2318-8559-4717-861b-c4c9bfaf9fcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:18.224304 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ab2318-8559-4717-861b-c4c9bfaf9fcc admin admin] PATH_INFO: `/v3/projects/9528fb759d864bd7a813d5e5dad4daf2/users/b14933ea29194b88bb6a0595add3beb6/roles/896bff49c5d6464eb612a15f4aa9badc` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:18.241087 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ab2318-8559-4717-861b-c4c9bfaf9fcc admin admin] RBAC: Authorizing `identity:create_grant(project_id=9528fb759d864bd7a813d5e5dad4daf2, user_id=b14933ea29194b88bb6a0595add3beb6, role_id=896bff49c5d6464eb612a15f4aa9badc)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:18.243834 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ab2318-8559-4717-861b-c4c9bfaf9fcc admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:18.327269 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 809/1608] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 17:25:18 2022] PUT /identity/v3/projects/1ccbc44615794a719bb36d6718f83762/users/40257d052ad341bfb3264b1f94e59361/roles/896bff49c5d6464eb612a15f4aa9badc => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:25:18.328641 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e58a4aa-8dd5-46c1-b25b-50e903d07b0d None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:18.328932 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e58a4aa-8dd5-46c1-b25b-50e903d07b0d None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:18.329214 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e58a4aa-8dd5-46c1-b25b-50e903d07b0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:18.360726 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-7e58a4aa-8dd5-46c1-b25b-50e903d07b0d None None] MFA Rules not processed for user `1ab72dc790a44d94a179b8fb1e4d04bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:25:18.361992 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-7e58a4aa-8dd5-46c1-b25b-50e903d07b0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:25:18.365606 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 800/1609] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 17:25:18 2022] PUT /identity/v3/projects/9528fb759d864bd7a813d5e5dad4daf2/users/b14933ea29194b88bb6a0595add3beb6/roles/896bff49c5d6464eb612a15f4aa9badc => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:25:18.367232 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890307dd-b5d0-4b5a-93a0-f03e475a7e5d None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:18.367942 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890307dd-b5d0-4b5a-93a0-f03e475a7e5d None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:18.368426 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890307dd-b5d0-4b5a-93a0-f03e475a7e5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:18.410927 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-890307dd-b5d0-4b5a-93a0-f03e475a7e5d None None] MFA Rules not processed for user `1a502436185146d8a24dc8e226e0ed21`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:25:18.412258 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-890307dd-b5d0-4b5a-93a0-f03e475a7e5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:25:18.446854 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 810/1610] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:25:18 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:25:18.448251 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b9a6db-a6d5-4515-9d36-ab070c3cd3a6 None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:18.448552 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b9a6db-a6d5-4515-9d36-ab070c3cd3a6 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:18.448866 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b9a6db-a6d5-4515-9d36-ab070c3cd3a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:18.467251 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-a8b9a6db-a6d5-4515-9d36-ab070c3cd3a6 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:25:18.469164 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-a8b9a6db-a6d5-4515-9d36-ab070c3cd3a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:25:18.478083 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 801/1611] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:25:18 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:25:18.479544 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aded09c3-1499-4de7-b85d-3f16d8093d53 None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:18.479891 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aded09c3-1499-4de7-b85d-3f16d8093d53 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:18.480231 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aded09c3-1499-4de7-b85d-3f16d8093d53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:18.499200 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-aded09c3-1499-4de7-b85d-3f16d8093d53 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:25:18.500497 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-aded09c3-1499-4de7-b85d-3f16d8093d53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:25:18.524429 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:25:18.537059 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 811/1612] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:25:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:25:18.537878 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b9a6db-a6d5-4515-9d36-ab070c3cd3a6 None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:18.547887 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b9a6db-a6d5-4515-9d36-ab070c3cd3a6 None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:18.555388 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b005c7-a05b-431b-81d8-943ea0d4def9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:18.556303 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b005c7-a05b-431b-81d8-943ea0d4def9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:18.556722 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b005c7-a05b-431b-81d8-943ea0d4def9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:18.557006 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b005c7-a05b-431b-81d8-943ea0d4def9 admin admin] PATH_INFO: `/v3/projects/5cdb4b9ba19a4ddb96a643723d8745f2/users/a24ce7c0d550419ca422b9349c699427/roles/dba744f8ab2a4c45b9d3212f8d203aba` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:18.567157 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:25:18.574923 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b005c7-a05b-431b-81d8-943ea0d4def9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5cdb4b9ba19a4ddb96a643723d8745f2, user_id=a24ce7c0d550419ca422b9349c699427, role_id=dba744f8ab2a4c45b9d3212f8d203aba)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:18.579397 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b005c7-a05b-431b-81d8-943ea0d4def9 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:18.585561 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 802/1613] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:25:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:25:18.587008 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53736665-c739-471f-b3d4-15e87ec5e052 None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:18.587298 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53736665-c739-471f-b3d4-15e87ec5e052 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:18.587729 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53736665-c739-471f-b3d4-15e87ec5e052 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:18.615377 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-53736665-c739-471f-b3d4-15e87ec5e052 None None] MFA Rules not processed for user `40257d052ad341bfb3264b1f94e59361`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:25:18.616502 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-53736665-c739-471f-b3d4-15e87ec5e052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:25:18.680743 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 803/1614] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:25:18 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:25:18.682107 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f7e47e-8ed0-4572-b6d4-6e82779a4292 None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:18.682433 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f7e47e-8ed0-4572-b6d4-6e82779a4292 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:18.682714 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f7e47e-8ed0-4572-b6d4-6e82779a4292 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:18.696341 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 812/1615] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 17:25:18 2022] PUT /identity/v3/projects/5cdb4b9ba19a4ddb96a643723d8745f2/users/a24ce7c0d550419ca422b9349c699427/roles/dba744f8ab2a4c45b9d3212f8d203aba => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:25:18.701591 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b005c7-a05b-431b-81d8-943ea0d4def9 admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:18.715746 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-e3f7e47e-8ed0-4572-b6d4-6e82779a4292 None None] MFA Rules not processed for user `b14933ea29194b88bb6a0595add3beb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:25:18.716966 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-e3f7e47e-8ed0-4572-b6d4-6e82779a4292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:25:18.768382 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b005c7-a05b-431b-81d8-943ea0d4def9 admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:18.773015 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a170a2-fbc3-45bb-a0cb-e50138068b17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:18.773676 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a170a2-fbc3-45bb-a0cb-e50138068b17 admin admin] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:18.773993 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a170a2-fbc3-45bb-a0cb-e50138068b17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:18.774272 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a170a2-fbc3-45bb-a0cb-e50138068b17 admin admin] PATH_INFO: `/v3/projects` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:18.774965 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a170a2-fbc3-45bb-a0cb-e50138068b17 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:18.776879 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a170a2-fbc3-45bb-a0cb-e50138068b17 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:18.783480 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 804/1616] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:25:18 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:25:18.784966 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b5ec69-67e5-4204-9394-f4b89329c5f6 None None] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:18.785262 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b5ec69-67e5-4204-9394-f4b89329c5f6 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:18.785553 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b5ec69-67e5-4204-9394-f4b89329c5f6 None None] PATH_INFO: `/` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:18.787209 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 805/1617] 10.222.0.39 () {54 vars in 961 bytes} [Thu Jun 16 17:25:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:25:18.790748 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b5ec69-67e5-4204-9394-f4b89329c5f6 None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:18.793798 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-64b5ec69-67e5-4204-9394-f4b89329c5f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:25:18.855641 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b5ec69-67e5-4204-9394-f4b89329c5f6 None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:18.859800 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0c21ad-fefa-4961-b3c5-acb7e9d07adf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5d25bfa8dc042329d57cd55fa7b7b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:18.860462 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0c21ad-fefa-4961-b3c5-acb7e9d07adf service neutron] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:18.860754 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0c21ad-fefa-4961-b3c5-acb7e9d07adf service neutron] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:18.861036 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0c21ad-fefa-4961-b3c5-acb7e9d07adf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:18.870965 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0c21ad-fefa-4961-b3c5-acb7e9d07adf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:18.871930 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0c21ad-fefa-4961-b3c5-acb7e9d07adf service neutron] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:18.883753 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 806/1618] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:25:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:25:18.883753 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0c21ad-fefa-4961-b3c5-acb7e9d07adf service neutron] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:18.894579 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0c21ad-fefa-4961-b3c5-acb7e9d07adf service neutron] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:18.898666 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab671ea-66ef-481b-a6b9-131bd7437b19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5d25bfa8dc042329d57cd55fa7b7b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:18.899326 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab671ea-66ef-481b-a6b9-131bd7437b19 service neutron] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:18.899617 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab671ea-66ef-481b-a6b9-131bd7437b19 service neutron] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:18.899902 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab671ea-66ef-481b-a6b9-131bd7437b19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:18.909150 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 813/1619] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 16 17:25:18 2022] POST /identity/v3/projects => generated 381 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:25:18.910577 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab671ea-66ef-481b-a6b9-131bd7437b19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:18.912171 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab671ea-66ef-481b-a6b9-131bd7437b19 service neutron] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:18.913280 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a170a2-fbc3-45bb-a0cb-e50138068b17 admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:18.922800 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 807/1620] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:25:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:25:18.924444 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97114d1c-0cd4-4530-beec-bcef0123cb1e None None] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:18.924750 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97114d1c-0cd4-4530-beec-bcef0123cb1e None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:18.925157 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97114d1c-0cd4-4530-beec-bcef0123cb1e None None] PATH_INFO: `/` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:18.926743 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 808/1621] 10.222.0.39 () {54 vars in 961 bytes} [Thu Jun 16 17:25:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:25:18.929518 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97114d1c-0cd4-4530-beec-bcef0123cb1e None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:18.986811 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a170a2-fbc3-45bb-a0cb-e50138068b17 admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:18.988075 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5a9d52-6b30-48b2-8564-bf72ddb31bfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:18.988748 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5a9d52-6b30-48b2-8564-bf72ddb31bfe admin admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:18.989036 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5a9d52-6b30-48b2-8564-bf72ddb31bfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:18.989312 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5a9d52-6b30-48b2-8564-bf72ddb31bfe admin admin] PATH_INFO: `/v3/roles` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:18.990074 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5a9d52-6b30-48b2-8564-bf72ddb31bfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:18.991667 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5a9d52-6b30-48b2-8564-bf72ddb31bfe admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:18.995455 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97114d1c-0cd4-4530-beec-bcef0123cb1e None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:19.000752 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb68e20-d8c9-4c7f-8348-9942a2c2143d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:19.001408 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb68e20-d8c9-4c7f-8348-9942a2c2143d admin admin] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:19.001698 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb68e20-d8c9-4c7f-8348-9942a2c2143d admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:19.002011 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb68e20-d8c9-4c7f-8348-9942a2c2143d admin admin] PATH_INFO: `/v3/projects` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:19.002754 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 814/1622] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 17:25:18 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:25:19.002896 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb68e20-d8c9-4c7f-8348-9942a2c2143d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:19.003774 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d87895-6397-4931-b3b0-b56150d58a0d None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:19.004487 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d87895-6397-4931-b3b0-b56150d58a0d None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:19.004691 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb68e20-d8c9-4c7f-8348-9942a2c2143d admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:19.010160 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d87895-6397-4931-b3b0-b56150d58a0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:19.029198 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-71d87895-6397-4931-b3b0-b56150d58a0d None None] MFA Rules not processed for user `3d381bb41dea4f1e90c3cf3815ac88dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:25:19.030723 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-71d87895-6397-4931-b3b0-b56150d58a0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:25:19.098772 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 815/1623] 10.222.0.39 () {58 vars in 1058 bytes} [Thu Jun 16 17:25:19 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:25:19.100011 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d87895-6397-4931-b3b0-b56150d58a0d None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:19.123258 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 809/1624] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 16 17:25:18 2022] POST /identity/v3/projects => generated 367 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:25:19.123796 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d87895-6397-4931-b3b0-b56150d58a0d None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:19.123922 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fedc84e-62ce-4564-8db2-1fca9fd6e4a9 None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:19.123922 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fedc84e-62ce-4564-8db2-1fca9fd6e4a9 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:19.125328 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fedc84e-62ce-4564-8db2-1fca9fd6e4a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:19.149366 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-1fedc84e-62ce-4564-8db2-1fca9fd6e4a9 None None] MFA Rules not processed for user `3d381bb41dea4f1e90c3cf3815ac88dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:25:19.151388 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-1fedc84e-62ce-4564-8db2-1fca9fd6e4a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:25:19.198240 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e233580-3ee6-4d16-9694-8a1e84117e07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:19.199059 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e233580-3ee6-4d16-9694-8a1e84117e07 admin admin] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:19.200097 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e233580-3ee6-4d16-9694-8a1e84117e07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:19.200751 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e233580-3ee6-4d16-9694-8a1e84117e07 admin admin] PATH_INFO: `/v3/users` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:19.206589 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e233580-3ee6-4d16-9694-8a1e84117e07 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:19.209142 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e233580-3ee6-4d16-9694-8a1e84117e07 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:19.246202 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 810/1625] 10.222.0.39 () {58 vars in 1058 bytes} [Thu Jun 16 17:25:19 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:25:19.247259 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fedc84e-62ce-4564-8db2-1fca9fd6e4a9 None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:19.258548 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fedc84e-62ce-4564-8db2-1fca9fd6e4a9 None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:19.264511 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b6b5f2-5e78-4717-8a0b-6ba637ac1859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:19.266078 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b6b5f2-5e78-4717-8a0b-6ba637ac1859 admin admin] REQUEST_METHOD: `PUT` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:19.266932 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b6b5f2-5e78-4717-8a0b-6ba637ac1859 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:19.266932 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b6b5f2-5e78-4717-8a0b-6ba637ac1859 admin admin] PATH_INFO: `/v3/projects/5cdb4b9ba19a4ddb96a643723d8745f2/users/a24ce7c0d550419ca422b9349c699427/roles/dba744f8ab2a4c45b9d3212f8d203aba` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:19.271123 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b6b5f2-5e78-4717-8a0b-6ba637ac1859 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5cdb4b9ba19a4ddb96a643723d8745f2, user_id=a24ce7c0d550419ca422b9349c699427, role_id=dba744f8ab2a4c45b9d3212f8d203aba)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:19.274903 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b6b5f2-5e78-4717-8a0b-6ba637ac1859 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:19.300053 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 811/1626] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 17:25:19 2022] PUT /identity/v3/projects/5cdb4b9ba19a4ddb96a643723d8745f2/users/a24ce7c0d550419ca422b9349c699427/roles/dba744f8ab2a4c45b9d3212f8d203aba => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:25:19.300053 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b6b5f2-5e78-4717-8a0b-6ba637ac1859 admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:19.335939 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 816/1627] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 16 17:25:19 2022] POST /identity/v3/users => generated 297 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:25:19.336475 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e233580-3ee6-4d16-9694-8a1e84117e07 admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:19.347565 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e233580-3ee6-4d16-9694-8a1e84117e07 admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:19.395756 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:25:19.403387 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b6b5f2-5e78-4717-8a0b-6ba637ac1859 admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:19.411808 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9100af-1f29-45a7-bb16-e1afb452a7ab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d381bb41dea4f1e90c3cf3815ac88dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:19.412709 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9100af-1f29-45a7-bb16-e1afb452a7ab service nova] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:19.413200 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9100af-1f29-45a7-bb16-e1afb452a7ab service nova] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:19.413585 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9100af-1f29-45a7-bb16-e1afb452a7ab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:19.457251 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:25:19.476369 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70acbdd-f5f5-46c7-853c-cc894ff298e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:19.477126 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70acbdd-f5f5-46c7-853c-cc894ff298e8 admin admin] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:19.477419 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70acbdd-f5f5-46c7-853c-cc894ff298e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:19.477707 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70acbdd-f5f5-46c7-853c-cc894ff298e8 admin admin] PATH_INFO: `/v3/users` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:19.478456 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70acbdd-f5f5-46c7-853c-cc894ff298e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:19.481265 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70acbdd-f5f5-46c7-853c-cc894ff298e8 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:19.492921 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9100af-1f29-45a7-bb16-e1afb452a7ab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:19.494893 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9100af-1f29-45a7-bb16-e1afb452a7ab service nova] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:19.505793 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 812/1628] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:25:19 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:25:19.506882 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9100af-1f29-45a7-bb16-e1afb452a7ab service nova] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:19.519867 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9100af-1f29-45a7-bb16-e1afb452a7ab service nova] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:19.537546 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b558d9-3a1c-4ab2-a98b-d71a21a1fe62 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d381bb41dea4f1e90c3cf3815ac88dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:19.537546 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b558d9-3a1c-4ab2-a98b-d71a21a1fe62 service nova] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:19.537546 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b558d9-3a1c-4ab2-a98b-d71a21a1fe62 service nova] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:19.537546 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b558d9-3a1c-4ab2-a98b-d71a21a1fe62 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:19.590111 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:25:19.607797 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b558d9-3a1c-4ab2-a98b-d71a21a1fe62 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:19.610396 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b558d9-3a1c-4ab2-a98b-d71a21a1fe62 service nova] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:19.621202 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 813/1629] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:25:19 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:25:19.622831 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301400fd-e0d6-4b21-81dc-3aeb90416d4f None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:19.623280 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301400fd-e0d6-4b21-81dc-3aeb90416d4f None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:19.623803 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301400fd-e0d6-4b21-81dc-3aeb90416d4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:19.653255 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-301400fd-e0d6-4b21-81dc-3aeb90416d4f None None] MFA Rules not processed for user `a24ce7c0d550419ca422b9349c699427`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:25:19.654686 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-301400fd-e0d6-4b21-81dc-3aeb90416d4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:25:19.671719 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 817/1630] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 16 17:25:19 2022] POST /identity/v3/users => generated 290 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:25:19.672856 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70acbdd-f5f5-46c7-853c-cc894ff298e8 admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:19.693647 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70acbdd-f5f5-46c7-853c-cc894ff298e8 admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:19.707585 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022dbb73-d17a-4f33-91d4-b9f051699148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:19.709125 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022dbb73-d17a-4f33-91d4-b9f051699148 admin admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:19.709490 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022dbb73-d17a-4f33-91d4-b9f051699148 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:19.711891 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022dbb73-d17a-4f33-91d4-b9f051699148 admin admin] PATH_INFO: `/v3/roles` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:19.712742 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022dbb73-d17a-4f33-91d4-b9f051699148 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:19.717405 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022dbb73-d17a-4f33-91d4-b9f051699148 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:19.739375 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 818/1631] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 17:25:19 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:25:19.740322 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022dbb73-d17a-4f33-91d4-b9f051699148 admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:19.757253 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022dbb73-d17a-4f33-91d4-b9f051699148 admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:19.765750 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb07e9fd-832f-47f1-b917-9f962befdbfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:19.765750 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb07e9fd-832f-47f1-b917-9f962befdbfa admin admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:19.765750 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb07e9fd-832f-47f1-b917-9f962befdbfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:19.765750 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb07e9fd-832f-47f1-b917-9f962befdbfa admin admin] PATH_INFO: `/v3/roles` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:19.766131 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb07e9fd-832f-47f1-b917-9f962befdbfa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:19.767111 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb07e9fd-832f-47f1-b917-9f962befdbfa admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:19.799178 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 819/1632] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 17:25:19 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:25:19.799178 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb07e9fd-832f-47f1-b917-9f962befdbfa admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:19.819174 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 814/1633] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:25:19 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:25:19.828466 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301400fd-e0d6-4b21-81dc-3aeb90416d4f None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:19.830296 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb07e9fd-832f-47f1-b917-9f962befdbfa admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:19.845044 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51edd0a6-15f1-4c7e-8473-1a0838ce77e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:19.846501 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51edd0a6-15f1-4c7e-8473-1a0838ce77e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:19.846828 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301400fd-e0d6-4b21-81dc-3aeb90416d4f None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:19.846956 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51edd0a6-15f1-4c7e-8473-1a0838ce77e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:19.847215 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51edd0a6-15f1-4c7e-8473-1a0838ce77e8 admin admin] PATH_INFO: `/v3/projects/17257801660146e6a2bd18970a4b486f/users/2cd427e738fa4202a914d8e1dd4dbb31/roles/dba744f8ab2a4c45b9d3212f8d203aba` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:19.863240 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e42cbd-d341-4e46-9b71-19c7019c6165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:19.863240 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e42cbd-d341-4e46-9b71-19c7019c6165 admin admin] REQUEST_METHOD: `PUT` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:19.866253 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e42cbd-d341-4e46-9b71-19c7019c6165 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:19.866638 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e42cbd-d341-4e46-9b71-19c7019c6165 admin admin] PATH_INFO: `/v3/projects/6e5c17f9a55f4c7392b2744ae899cb61/users/f9247cda6f6f4072824c3764387208bf/roles/dba744f8ab2a4c45b9d3212f8d203aba` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:19.871118 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51edd0a6-15f1-4c7e-8473-1a0838ce77e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=17257801660146e6a2bd18970a4b486f, user_id=2cd427e738fa4202a914d8e1dd4dbb31, role_id=dba744f8ab2a4c45b9d3212f8d203aba)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:19.874131 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51edd0a6-15f1-4c7e-8473-1a0838ce77e8 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:19.902637 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e42cbd-d341-4e46-9b71-19c7019c6165 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e5c17f9a55f4c7392b2744ae899cb61, user_id=f9247cda6f6f4072824c3764387208bf, role_id=dba744f8ab2a4c45b9d3212f8d203aba)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:19.905510 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e42cbd-d341-4e46-9b71-19c7019c6165 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:19.969939 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 820/1634] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 17:25:19 2022] PUT /identity/v3/projects/17257801660146e6a2bd18970a4b486f/users/2cd427e738fa4202a914d8e1dd4dbb31/roles/dba744f8ab2a4c45b9d3212f8d203aba => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:25:19.972164 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51edd0a6-15f1-4c7e-8473-1a0838ce77e8 admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:19.998260 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 815/1635] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 17:25:19 2022] PUT /identity/v3/projects/6e5c17f9a55f4c7392b2744ae899cb61/users/f9247cda6f6f4072824c3764387208bf/roles/dba744f8ab2a4c45b9d3212f8d203aba => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:25:20.000037 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86935e2b-180d-4016-8bb5-1f5e17a38ee9 None None] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:20.000779 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86935e2b-180d-4016-8bb5-1f5e17a38ee9 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:20.000779 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86935e2b-180d-4016-8bb5-1f5e17a38ee9 None None] PATH_INFO: `/` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:20.006438 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 816/1636] 10.222.0.39 () {54 vars in 912 bytes} [Thu Jun 16 17:25:19 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:25:20.007298 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86935e2b-180d-4016-8bb5-1f5e17a38ee9 None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:20.076334 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:25:20.092693 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:25:20.110173 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51edd0a6-15f1-4c7e-8473-1a0838ce77e8 admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:20.136690 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86935e2b-180d-4016-8bb5-1f5e17a38ee9 None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:20.143795 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3130bc8-eed1-416e-b60d-88dd91a417e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:20.145234 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3130bc8-eed1-416e-b60d-88dd91a417e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:20.145815 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3130bc8-eed1-416e-b60d-88dd91a417e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:20.146332 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3130bc8-eed1-416e-b60d-88dd91a417e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:20.147308 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3130bc8-eed1-416e-b60d-88dd91a417e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:20.149269 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3130bc8-eed1-416e-b60d-88dd91a417e8 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:20.163068 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 817/1637] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 17:25:20 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:25:20.164404 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3130bc8-eed1-416e-b60d-88dd91a417e8 admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:20.176367 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3130bc8-eed1-416e-b60d-88dd91a417e8 admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:20.182361 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e2c5ff-c0ea-40fb-81a8-959cbb402892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:20.183770 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e2c5ff-c0ea-40fb-81a8-959cbb402892 admin admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:20.187321 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e2c5ff-c0ea-40fb-81a8-959cbb402892 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:20.187321 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e2c5ff-c0ea-40fb-81a8-959cbb402892 admin admin] PATH_INFO: `/v3/roles` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:20.187321 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e2c5ff-c0ea-40fb-81a8-959cbb402892 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:20.188504 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e2c5ff-c0ea-40fb-81a8-959cbb402892 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:20.195582 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a50dae-4728-4a62-b019-00a872d861bd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef37136b89d34edc9cd94c7aa81b2095', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:20.196641 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a50dae-4728-4a62-b019-00a872d861bd service cinder] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:20.196865 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a50dae-4728-4a62-b019-00a872d861bd service cinder] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:20.197160 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a50dae-4728-4a62-b019-00a872d861bd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:20.203970 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 818/1638] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 17:25:20 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:25:20.205874 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74d9d7c-d9ed-403a-89a7-1f6632a36eba None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:20.206383 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74d9d7c-d9ed-403a-89a7-1f6632a36eba None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:20.206894 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74d9d7c-d9ed-403a-89a7-1f6632a36eba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:20.227212 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-c74d9d7c-d9ed-403a-89a7-1f6632a36eba None None] MFA Rules not processed for user `3d381bb41dea4f1e90c3cf3815ac88dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:25:20.229303 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-c74d9d7c-d9ed-403a-89a7-1f6632a36eba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:25:20.313451 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 819/1639] 10.222.0.39 () {58 vars in 1009 bytes} [Thu Jun 16 17:25:20 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:25:20.314990 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa58c64-9140-49d3-9eba-6a58bb97838b None None] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:20.315290 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa58c64-9140-49d3-9eba-6a58bb97838b None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:20.315631 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa58c64-9140-49d3-9eba-6a58bb97838b None None] PATH_INFO: `/` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:20.317425 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 820/1640] 10.222.0.39 () {54 vars in 912 bytes} [Thu Jun 16 17:25:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:25:20.318080 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa58c64-9140-49d3-9eba-6a58bb97838b None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:20.340410 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa58c64-9140-49d3-9eba-6a58bb97838b None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:20.348219 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a56437-d2a6-4cab-9b28-efa0ae87b102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:20.349436 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a56437-d2a6-4cab-9b28-efa0ae87b102 admin admin] REQUEST_METHOD: `PUT` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:20.349968 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a56437-d2a6-4cab-9b28-efa0ae87b102 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:20.350626 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a56437-d2a6-4cab-9b28-efa0ae87b102 admin admin] PATH_INFO: `/v3/projects/17257801660146e6a2bd18970a4b486f/users/2cd427e738fa4202a914d8e1dd4dbb31/roles/dba744f8ab2a4c45b9d3212f8d203aba` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:20.353199 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a56437-d2a6-4cab-9b28-efa0ae87b102 admin admin] RBAC: Authorizing `identity:create_grant(project_id=17257801660146e6a2bd18970a4b486f, user_id=2cd427e738fa4202a914d8e1dd4dbb31, role_id=dba744f8ab2a4c45b9d3212f8d203aba)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:20.357196 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a56437-d2a6-4cab-9b28-efa0ae87b102 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:20.372682 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 821/1641] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 17:25:20 2022] PUT /identity/v3/projects/17257801660146e6a2bd18970a4b486f/users/2cd427e738fa4202a914d8e1dd4dbb31/roles/dba744f8ab2a4c45b9d3212f8d203aba => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:25:20.374040 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a56437-d2a6-4cab-9b28-efa0ae87b102 admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:20.378372 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a50dae-4728-4a62-b019-00a872d861bd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:20.379851 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a50dae-4728-4a62-b019-00a872d861bd service cinder] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:20.418222 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 821/1642] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:25:19 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:25:20.418999 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a50dae-4728-4a62-b019-00a872d861bd service cinder] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:20.442810 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a50dae-4728-4a62-b019-00a872d861bd service cinder] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:20.472506 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a56437-d2a6-4cab-9b28-efa0ae87b102 admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:20.479457 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40c1615-6a50-4bf4-88c8-e43a085ff265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:20.479965 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40c1615-6a50-4bf4-88c8-e43a085ff265 admin admin] REQUEST_METHOD: `PUT` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:20.480255 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40c1615-6a50-4bf4-88c8-e43a085ff265 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:20.480538 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40c1615-6a50-4bf4-88c8-e43a085ff265 admin admin] PATH_INFO: `/v3/projects/6e5c17f9a55f4c7392b2744ae899cb61/users/f9247cda6f6f4072824c3764387208bf/roles/dba744f8ab2a4c45b9d3212f8d203aba` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:20.483311 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40c1615-6a50-4bf4-88c8-e43a085ff265 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e5c17f9a55f4c7392b2744ae899cb61, user_id=f9247cda6f6f4072824c3764387208bf, role_id=dba744f8ab2a4c45b9d3212f8d203aba)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:20.487100 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40c1615-6a50-4bf4-88c8-e43a085ff265 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:20.499992 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 822/1643] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 17:25:20 2022] PUT /identity/v3/projects/6e5c17f9a55f4c7392b2744ae899cb61/users/f9247cda6f6f4072824c3764387208bf/roles/dba744f8ab2a4c45b9d3212f8d203aba => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:25:20.501342 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da79eb0e-a631-4a2f-b158-63e3ad58d417 None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:20.501794 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da79eb0e-a631-4a2f-b158-63e3ad58d417 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:20.502086 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da79eb0e-a631-4a2f-b158-63e3ad58d417 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:20.521074 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:25:20.523603 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7cc0ba-4215-44b6-90f7-5996412b1fe0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef37136b89d34edc9cd94c7aa81b2095', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:20.524419 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7cc0ba-4215-44b6-90f7-5996412b1fe0 service cinder] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:20.524823 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7cc0ba-4215-44b6-90f7-5996412b1fe0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:20.525189 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7cc0ba-4215-44b6-90f7-5996412b1fe0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:20.527893 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-da79eb0e-a631-4a2f-b158-63e3ad58d417 None None] MFA Rules not processed for user `3d381bb41dea4f1e90c3cf3815ac88dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:25:20.534314 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-da79eb0e-a631-4a2f-b158-63e3ad58d417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:25:20.625049 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7cc0ba-4215-44b6-90f7-5996412b1fe0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:20.626616 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7cc0ba-4215-44b6-90f7-5996412b1fe0 service cinder] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:20.634595 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 823/1644] 10.222.0.39 () {58 vars in 1009 bytes} [Thu Jun 16 17:25:20 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:25:20.636312 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f9ca84-28c3-40db-ad6f-51daee6cb5f8 None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:20.636709 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f9ca84-28c3-40db-ad6f-51daee6cb5f8 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:20.637196 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f9ca84-28c3-40db-ad6f-51daee6cb5f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:20.639458 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 822/1645] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:25:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:25:20.641100 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7cc0ba-4215-44b6-90f7-5996412b1fe0 service cinder] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:20.659780 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7cc0ba-4215-44b6-90f7-5996412b1fe0 service cinder] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:20.722229 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-44f9ca84-28c3-40db-ad6f-51daee6cb5f8 None None] MFA Rules not processed for user `2cd427e738fa4202a914d8e1dd4dbb31`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:25:20.723848 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-44f9ca84-28c3-40db-ad6f-51daee6cb5f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:25:20.758083 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8c49df-0f54-4bae-a567-b5d5bfe4e3f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:20.759032 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8c49df-0f54-4bae-a567-b5d5bfe4e3f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:20.759318 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8c49df-0f54-4bae-a567-b5d5bfe4e3f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:20.759596 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8c49df-0f54-4bae-a567-b5d5bfe4e3f0 admin admin] PATH_INFO: `/v3/users/eb9bfaa760984a83abe993eb2d8abd04` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:20.761051 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8c49df-0f54-4bae-a567-b5d5bfe4e3f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb9bfaa760984a83abe993eb2d8abd04)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:20.762632 dv-cinder-837356-2-smb devstack@keystone.service[80874]: WARNING py.warnings [None req-4b8c49df-0f54-4bae-a567-b5d5bfe4e3f0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 16 17:25:20.762632 dv-cinder-837356-2-smb devstack@keystone.service[80874]: warnings.warn(msg) Jun 16 17:25:20.762632 dv-cinder-837356-2-smb devstack@keystone.service[80874]: Jun 16 17:25:20.763564 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8c49df-0f54-4bae-a567-b5d5bfe4e3f0 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:20.867250 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 824/1646] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:25:20 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:25:20.870290 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f17fbe-a20f-462e-8f69-90ba4e0b99a7 None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:20.870739 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f17fbe-a20f-462e-8f69-90ba4e0b99a7 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:20.871248 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f17fbe-a20f-462e-8f69-90ba4e0b99a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:20.935194 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-d4f17fbe-a20f-462e-8f69-90ba4e0b99a7 None None] MFA Rules not processed for user `f9247cda6f6f4072824c3764387208bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:25:20.936733 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-d4f17fbe-a20f-462e-8f69-90ba4e0b99a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:25:21.070372 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 825/1647] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:25:20 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:25:21.071446 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f17fbe-a20f-462e-8f69-90ba4e0b99a7 None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:21.116427 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-4b8c49df-0f54-4bae-a567-b5d5bfe4e3f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb9bfaa760984a83abe993eb2d8abd04'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:25:21.132878 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-4b8c49df-0f54-4bae-a567-b5d5bfe4e3f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb9bfaa760984a83abe993eb2d8abd04'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:25:21.147890 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f17fbe-a20f-462e-8f69-90ba4e0b99a7 None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:21.152048 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:25:21.152847 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22cbaf8-f90f-4492-aaf3-792c033a0f15 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef37136b89d34edc9cd94c7aa81b2095', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:21.153552 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22cbaf8-f90f-4492-aaf3-792c033a0f15 service cinder] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:21.153949 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22cbaf8-f90f-4492-aaf3-792c033a0f15 service cinder] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:21.154749 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22cbaf8-f90f-4492-aaf3-792c033a0f15 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:21.169500 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22cbaf8-f90f-4492-aaf3-792c033a0f15 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:21.171373 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22cbaf8-f90f-4492-aaf3-792c033a0f15 service cinder] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:21.185396 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 826/1648] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:25:21 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:25:21.186752 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22cbaf8-f90f-4492-aaf3-792c033a0f15 service cinder] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:21.203202 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22cbaf8-f90f-4492-aaf3-792c033a0f15 service cinder] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:21.203603 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239d86c2-3a78-44aa-9f15-e45ac2e8cbd8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef37136b89d34edc9cd94c7aa81b2095', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:21.204359 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239d86c2-3a78-44aa-9f15-e45ac2e8cbd8 service cinder] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:21.205239 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239d86c2-3a78-44aa-9f15-e45ac2e8cbd8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:21.205629 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239d86c2-3a78-44aa-9f15-e45ac2e8cbd8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:21.216988 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239d86c2-3a78-44aa-9f15-e45ac2e8cbd8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:21.220302 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239d86c2-3a78-44aa-9f15-e45ac2e8cbd8 service cinder] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:21.220892 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-4b8c49df-0f54-4bae-a567-b5d5bfe4e3f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb9bfaa760984a83abe993eb2d8abd04'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:25:21.221977 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-4b8c49df-0f54-4bae-a567-b5d5bfe4e3f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb9bfaa760984a83abe993eb2d8abd04'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:25:21.232744 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 827/1649] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:25:21 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:25:21.260548 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-4b8c49df-0f54-4bae-a567-b5d5bfe4e3f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb9bfaa760984a83abe993eb2d8abd04'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:25:21.273530 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 823/1650] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 16 17:25:20 2022] DELETE /identity/v3/users/eb9bfaa760984a83abe993eb2d8abd04 => generated 0 bytes in 633 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:25:21.278292 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966ae15e-df79-4cbd-9843-17b9c561f996 None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:21.278292 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966ae15e-df79-4cbd-9843-17b9c561f996 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:21.278676 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966ae15e-df79-4cbd-9843-17b9c561f996 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:21.298786 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-966ae15e-df79-4cbd-9843-17b9c561f996 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:25:21.300278 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-966ae15e-df79-4cbd-9843-17b9c561f996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:25:21.318735 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8c49df-0f54-4bae-a567-b5d5bfe4e3f0 admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:21.318735 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-4b8c49df-0f54-4bae-a567-b5d5bfe4e3f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:25:21.417655 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 828/1651] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:25:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:25:21.418662 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966ae15e-df79-4cbd-9843-17b9c561f996 None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:21.422885 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-966ae15e-df79-4cbd-9843-17b9c561f996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:25:21.446418 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8c49df-0f54-4bae-a567-b5d5bfe4e3f0 admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:21.453383 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966ae15e-df79-4cbd-9843-17b9c561f996 None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:21.457440 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d111ff4-151c-4219-a943-33e3f31c14d3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef37136b89d34edc9cd94c7aa81b2095', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:21.458425 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d111ff4-151c-4219-a943-33e3f31c14d3 service cinder] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:21.459555 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d111ff4-151c-4219-a943-33e3f31c14d3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:21.460015 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d111ff4-151c-4219-a943-33e3f31c14d3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:21.466045 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8384df-2d5e-443c-b9ed-6acf3b4d37c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:21.466458 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-3d111ff4-151c-4219-a943-33e3f31c14d3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:25:21.466960 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8384df-2d5e-443c-b9ed-6acf3b4d37c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:21.467250 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8384df-2d5e-443c-b9ed-6acf3b4d37c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:21.467532 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8384df-2d5e-443c-b9ed-6acf3b4d37c8 admin admin] PATH_INFO: `/v3/users/1a502436185146d8a24dc8e226e0ed21` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:21.469032 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8384df-2d5e-443c-b9ed-6acf3b4d37c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a502436185146d8a24dc8e226e0ed21)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:21.472272 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8384df-2d5e-443c-b9ed-6acf3b4d37c8 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:21.866185 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d111ff4-151c-4219-a943-33e3f31c14d3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:21.866185 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d111ff4-151c-4219-a943-33e3f31c14d3 service cinder] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:21.866185 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 824/1652] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:25:21 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 17:25:21.866185 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d111ff4-151c-4219-a943-33e3f31c14d3 service cinder] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:21.866185 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-3d111ff4-151c-4219-a943-33e3f31c14d3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:25:21.866185 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d111ff4-151c-4219-a943-33e3f31c14d3 service cinder] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:21.875931 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c32af79-1a49-416f-b498-4691ccbc2e71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5d25bfa8dc042329d57cd55fa7b7b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:21.875931 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c32af79-1a49-416f-b498-4691ccbc2e71 service neutron] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:21.875931 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c32af79-1a49-416f-b498-4691ccbc2e71 service neutron] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:21.875931 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c32af79-1a49-416f-b498-4691ccbc2e71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:21.877582 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c32af79-1a49-416f-b498-4691ccbc2e71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:21.877582 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c32af79-1a49-416f-b498-4691ccbc2e71 service neutron] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:21.877582 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 825/1653] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:25:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:25:21.915766 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-6e8384df-2d5e-443c-b9ed-6acf3b4d37c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a502436185146d8a24dc8e226e0ed21'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:25:21.925329 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-6e8384df-2d5e-443c-b9ed-6acf3b4d37c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a502436185146d8a24dc8e226e0ed21'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:25:21.926068 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-6e8384df-2d5e-443c-b9ed-6acf3b4d37c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a502436185146d8a24dc8e226e0ed21'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:25:22.051101 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-6e8384df-2d5e-443c-b9ed-6acf3b4d37c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a502436185146d8a24dc8e226e0ed21'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:25:22.066731 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-6e8384df-2d5e-443c-b9ed-6acf3b4d37c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a502436185146d8a24dc8e226e0ed21'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:25:22.082426 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:25:22.110619 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 829/1654] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 16 17:25:21 2022] DELETE /identity/v3/users/1a502436185146d8a24dc8e226e0ed21 => generated 0 bytes in 692 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:25:22.115321 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74febd87-62f1-416b-87d0-757aee52d780 None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:22.115569 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74febd87-62f1-416b-87d0-757aee52d780 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:22.115828 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74febd87-62f1-416b-87d0-757aee52d780 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:22.162952 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-74febd87-62f1-416b-87d0-757aee52d780 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:25:22.169663 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-74febd87-62f1-416b-87d0-757aee52d780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:25:22.280156 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 826/1655] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:25:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:25:22.314210 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8384df-2d5e-443c-b9ed-6acf3b4d37c8 admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:22.318062 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:25:22.320505 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-6e8384df-2d5e-443c-b9ed-6acf3b4d37c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:25:22.399768 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8384df-2d5e-443c-b9ed-6acf3b4d37c8 admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:22.413188 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97bb750-a62a-48c8-b9da-d1024d799baa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5d25bfa8dc042329d57cd55fa7b7b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:22.414463 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97bb750-a62a-48c8-b9da-d1024d799baa service neutron] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:22.422213 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97bb750-a62a-48c8-b9da-d1024d799baa service neutron] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:22.429042 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97bb750-a62a-48c8-b9da-d1024d799baa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:22.440481 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97bb750-a62a-48c8-b9da-d1024d799baa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:22.442014 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97bb750-a62a-48c8-b9da-d1024d799baa service neutron] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:22.460289 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 830/1656] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:25:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:25:22.496273 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74febd87-62f1-416b-87d0-757aee52d780 None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:22.498330 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-74febd87-62f1-416b-87d0-757aee52d780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:25:22.582448 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74febd87-62f1-416b-87d0-757aee52d780 None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:22.590227 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5006b4bf-60a7-40e8-a2c3-31d8fb6f81f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef37136b89d34edc9cd94c7aa81b2095', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:22.590953 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5006b4bf-60a7-40e8-a2c3-31d8fb6f81f6 service cinder] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:22.591242 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5006b4bf-60a7-40e8-a2c3-31d8fb6f81f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:22.591521 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5006b4bf-60a7-40e8-a2c3-31d8fb6f81f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:22.595603 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-5006b4bf-60a7-40e8-a2c3-31d8fb6f81f6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:25:22.722537 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5006b4bf-60a7-40e8-a2c3-31d8fb6f81f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:22.722537 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5006b4bf-60a7-40e8-a2c3-31d8fb6f81f6 service cinder] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:22.732751 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 827/1657] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:25:22 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:25:23.475858 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97bb750-a62a-48c8-b9da-d1024d799baa service neutron] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:23.478812 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-f97bb750-a62a-48c8-b9da-d1024d799baa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:25:23.495922 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97bb750-a62a-48c8-b9da-d1024d799baa service neutron] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:23.503627 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1033d023-b57a-472f-8d9b-daa9e7b1ad2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:23.505055 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1033d023-b57a-472f-8d9b-daa9e7b1ad2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:23.505742 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1033d023-b57a-472f-8d9b-daa9e7b1ad2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:23.506269 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1033d023-b57a-472f-8d9b-daa9e7b1ad2e admin admin] PATH_INFO: `/v3/projects/5ccbcba2cdff4494a76d2943a94afa7c` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:23.508231 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1033d023-b57a-472f-8d9b-daa9e7b1ad2e admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ccbcba2cdff4494a76d2943a94afa7c)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:23.509499 dv-cinder-837356-2-smb devstack@keystone.service[80873]: WARNING py.warnings [None req-1033d023-b57a-472f-8d9b-daa9e7b1ad2e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 16 17:25:23.509499 dv-cinder-837356-2-smb devstack@keystone.service[80873]: warnings.warn(msg) Jun 16 17:25:23.509499 dv-cinder-837356-2-smb devstack@keystone.service[80873]: Jun 16 17:25:23.511134 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1033d023-b57a-472f-8d9b-daa9e7b1ad2e admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:23.586049 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5006b4bf-60a7-40e8-a2c3-31d8fb6f81f6 service cinder] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:23.590885 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-5006b4bf-60a7-40e8-a2c3-31d8fb6f81f6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:25:23.625719 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5006b4bf-60a7-40e8-a2c3-31d8fb6f81f6 service cinder] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:23.655898 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177abb24-f543-4048-bfcf-d3530eca3316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:23.657249 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177abb24-f543-4048-bfcf-d3530eca3316 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:23.657540 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177abb24-f543-4048-bfcf-d3530eca3316 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:23.657842 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177abb24-f543-4048-bfcf-d3530eca3316 admin admin] PATH_INFO: `/v3/projects/dfaa32b4384e4876b99b966c30c84226` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:23.662642 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177abb24-f543-4048-bfcf-d3530eca3316 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dfaa32b4384e4876b99b966c30c84226)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:23.670518 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177abb24-f543-4048-bfcf-d3530eca3316 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:23.706712 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-1033d023-b57a-472f-8d9b-daa9e7b1ad2e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ccbcba2cdff4494a76d2943a94afa7c', 'request_id': 'req-1033d023-b57a-472f-8d9b-daa9e7b1ad2e'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:25:23.743028 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-1033d023-b57a-472f-8d9b-daa9e7b1ad2e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ccbcba2cdff4494a76d2943a94afa7c', 'request_id': 'req-1033d023-b57a-472f-8d9b-daa9e7b1ad2e'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:25:23.758116 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-1033d023-b57a-472f-8d9b-daa9e7b1ad2e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ccbcba2cdff4494a76d2943a94afa7c', 'request_id': 'req-1033d023-b57a-472f-8d9b-daa9e7b1ad2e'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:25:23.834642 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:25:23.872252 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-177abb24-f543-4048-bfcf-d3530eca3316 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dfaa32b4384e4876b99b966c30c84226', 'request_id': 'req-177abb24-f543-4048-bfcf-d3530eca3316'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:25:23.887630 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-177abb24-f543-4048-bfcf-d3530eca3316 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dfaa32b4384e4876b99b966c30c84226', 'request_id': 'req-177abb24-f543-4048-bfcf-d3530eca3316'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:25:23.910860 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-1033d023-b57a-472f-8d9b-daa9e7b1ad2e admin admin] The token cache is being invalidate because project 5ccbcba2cdff4494a76d2943a94afa7c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80873) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 17:25:23.912481 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-1033d023-b57a-472f-8d9b-daa9e7b1ad2e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:25:23.916276 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-1033d023-b57a-472f-8d9b-daa9e7b1ad2e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:25:23.920315 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 831/1658] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 16 17:25:23 2022] DELETE /identity/v3/projects/5ccbcba2cdff4494a76d2943a94afa7c => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:25:23.925632 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1033d023-b57a-472f-8d9b-daa9e7b1ad2e admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:23.931603 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-1033d023-b57a-472f-8d9b-daa9e7b1ad2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:25:24.016075 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-177abb24-f543-4048-bfcf-d3530eca3316 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dfaa32b4384e4876b99b966c30c84226', 'request_id': 'req-177abb24-f543-4048-bfcf-d3530eca3316'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:25:24.038114 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-177abb24-f543-4048-bfcf-d3530eca3316 admin admin] The token cache is being invalidate because project dfaa32b4384e4876b99b966c30c84226 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80874) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 17:25:24.038626 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-177abb24-f543-4048-bfcf-d3530eca3316 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:25:24.039645 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-177abb24-f543-4048-bfcf-d3530eca3316 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:25:24.045530 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 828/1659] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 16 17:25:23 2022] DELETE /identity/v3/projects/dfaa32b4384e4876b99b966c30c84226 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 17:25:24.048908 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5b69c6-0ecc-4393-91a9-174151f23405 None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:24.049768 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5b69c6-0ecc-4393-91a9-174151f23405 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:24.050194 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5b69c6-0ecc-4393-91a9-174151f23405 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:24.120412 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1033d023-b57a-472f-8d9b-daa9e7b1ad2e admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:24.138325 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-ff5b69c6-0ecc-4393-91a9-174151f23405 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:25:24.138325 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-ff5b69c6-0ecc-4393-91a9-174151f23405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:25:24.253869 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 829/1660] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:25:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:25:24.255520 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8a3ab4-f56b-48a5-ad90-3c5fbd207093 None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:24.255813 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8a3ab4-f56b-48a5-ad90-3c5fbd207093 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:24.256097 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8a3ab4-f56b-48a5-ad90-3c5fbd207093 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:24.259648 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9e40a4-6812-4c23-920d-a2321ca19f56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:24.260656 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9e40a4-6812-4c23-920d-a2321ca19f56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:24.261052 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9e40a4-6812-4c23-920d-a2321ca19f56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:24.261652 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9e40a4-6812-4c23-920d-a2321ca19f56 admin admin] PATH_INFO: `/v3/users/a24ce7c0d550419ca422b9349c699427` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:24.265853 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9e40a4-6812-4c23-920d-a2321ca19f56 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a24ce7c0d550419ca422b9349c699427)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:24.275579 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9e40a4-6812-4c23-920d-a2321ca19f56 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:24.297182 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-3b8a3ab4-f56b-48a5-ad90-3c5fbd207093 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:25:24.299643 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-3b8a3ab4-f56b-48a5-ad90-3c5fbd207093 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:25:24.319232 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 830/1661] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:25:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:25:24.332895 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8a3ab4-f56b-48a5-ad90-3c5fbd207093 None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:24.356638 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8a3ab4-f56b-48a5-ad90-3c5fbd207093 None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:24.372651 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f417431-b809-490c-a7af-74a71882eeeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:24.374576 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f417431-b809-490c-a7af-74a71882eeeb admin admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:24.374576 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f417431-b809-490c-a7af-74a71882eeeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:24.375019 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f417431-b809-490c-a7af-74a71882eeeb admin admin] PATH_INFO: `/v3/domains` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:24.375887 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f417431-b809-490c-a7af-74a71882eeeb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:25:24.376313 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f417431-b809-490c-a7af-74a71882eeeb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:24.379087 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f417431-b809-490c-a7af-74a71882eeeb admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:24.397831 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 831/1662] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 16 17:25:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:25:24.401290 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f417431-b809-490c-a7af-74a71882eeeb admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:24.443767 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f417431-b809-490c-a7af-74a71882eeeb admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:24.458088 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:25:24.460431 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd96ed92-c31d-42bf-9919-74ca71956238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:24.461121 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd96ed92-c31d-42bf-9919-74ca71956238 admin admin] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:24.461410 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd96ed92-c31d-42bf-9919-74ca71956238 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:24.461689 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd96ed92-c31d-42bf-9919-74ca71956238 admin admin] PATH_INFO: `/v3/projects` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:24.466018 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd96ed92-c31d-42bf-9919-74ca71956238 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:24.466018 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd96ed92-c31d-42bf-9919-74ca71956238 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:24.634258 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-7e9e40a4-6812-4c23-920d-a2321ca19f56 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a24ce7c0d550419ca422b9349c699427'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:25:24.635878 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-7e9e40a4-6812-4c23-920d-a2321ca19f56 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a24ce7c0d550419ca422b9349c699427'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:25:24.639437 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-7e9e40a4-6812-4c23-920d-a2321ca19f56 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a24ce7c0d550419ca422b9349c699427'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:25:24.649770 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 832/1663] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 16 17:25:24 2022] POST /identity/v3/projects => generated 373 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:25:24.656134 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd96ed92-c31d-42bf-9919-74ca71956238 admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:24.661457 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-bd96ed92-c31d-42bf-9919-74ca71956238 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:25:24.742732 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-7e9e40a4-6812-4c23-920d-a2321ca19f56 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a24ce7c0d550419ca422b9349c699427'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:25:24.756187 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-7e9e40a4-6812-4c23-920d-a2321ca19f56 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a24ce7c0d550419ca422b9349c699427'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:25:24.824713 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 832/1664] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 16 17:25:23 2022] DELETE /identity/v3/users/a24ce7c0d550419ca422b9349c699427 => generated 0 bytes in 900 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:25:24.855937 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd96ed92-c31d-42bf-9919-74ca71956238 admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:25.018647 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cde925d-88c5-4c9e-8b79-6abad76f2fcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:25.021052 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cde925d-88c5-4c9e-8b79-6abad76f2fcc admin admin] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:25.021424 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cde925d-88c5-4c9e-8b79-6abad76f2fcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:25.022439 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cde925d-88c5-4c9e-8b79-6abad76f2fcc admin admin] PATH_INFO: `/v3/users` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:25.023269 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cde925d-88c5-4c9e-8b79-6abad76f2fcc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:25.028155 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cde925d-88c5-4c9e-8b79-6abad76f2fcc admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:25.142583 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 833/1665] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 16 17:25:24 2022] POST /identity/v3/users => generated 287 bytes in 487 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 17:25:25.146669 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9e40a4-6812-4c23-920d-a2321ca19f56 admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:25.162115 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9e40a4-6812-4c23-920d-a2321ca19f56 admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:25.193049 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6738d8ed-1bcd-411d-b5f2-04291febefe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:25.193049 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6738d8ed-1bcd-411d-b5f2-04291febefe5 admin admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:25.193049 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6738d8ed-1bcd-411d-b5f2-04291febefe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:25.193049 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6738d8ed-1bcd-411d-b5f2-04291febefe5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:25.193536 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6738d8ed-1bcd-411d-b5f2-04291febefe5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:25.197357 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6738d8ed-1bcd-411d-b5f2-04291febefe5 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:25.240162 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 833/1666] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 17:25:25 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:25:25.243575 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cde925d-88c5-4c9e-8b79-6abad76f2fcc admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:25.259492 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cde925d-88c5-4c9e-8b79-6abad76f2fcc admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:25.299686 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d8bf5d-8957-4f15-bf04-57eb6be2c235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:25.300401 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d8bf5d-8957-4f15-bf04-57eb6be2c235 admin admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:25.300694 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d8bf5d-8957-4f15-bf04-57eb6be2c235 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:25.307911 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d8bf5d-8957-4f15-bf04-57eb6be2c235 admin admin] PATH_INFO: `/v3/roles` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:25.311858 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d8bf5d-8957-4f15-bf04-57eb6be2c235 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:25.322571 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d8bf5d-8957-4f15-bf04-57eb6be2c235 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:25.360536 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 834/1667] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 17:25:25 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:25:25.364512 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6738d8ed-1bcd-411d-b5f2-04291febefe5 admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:25.381612 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6738d8ed-1bcd-411d-b5f2-04291febefe5 admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:25.402339 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214ad403-402a-495a-82e3-b5cc1bbd4bb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:25.403364 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214ad403-402a-495a-82e3-b5cc1bbd4bb8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:25.403732 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214ad403-402a-495a-82e3-b5cc1bbd4bb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:25.404093 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214ad403-402a-495a-82e3-b5cc1bbd4bb8 admin admin] PATH_INFO: `/v3/projects/84dfd5f5639249b5825a294f9b2a7a6e/users/bea3f0b966a743fb8de935883485ffa0/roles/896bff49c5d6464eb612a15f4aa9badc` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:25.439389 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214ad403-402a-495a-82e3-b5cc1bbd4bb8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84dfd5f5639249b5825a294f9b2a7a6e, user_id=bea3f0b966a743fb8de935883485ffa0, role_id=896bff49c5d6464eb612a15f4aa9badc)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:25.442303 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214ad403-402a-495a-82e3-b5cc1bbd4bb8 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:25.521992 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:25:25.577124 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 834/1668] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 17:25:25 2022] PUT /identity/v3/projects/84dfd5f5639249b5825a294f9b2a7a6e/users/bea3f0b966a743fb8de935883485ffa0/roles/896bff49c5d6464eb612a15f4aa9badc => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:25:25.578069 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce1a1e3-09c1-434d-a83b-acb04826284b None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:25.578699 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce1a1e3-09c1-434d-a83b-acb04826284b None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:25.579743 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce1a1e3-09c1-434d-a83b-acb04826284b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:25.644382 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-9ce1a1e3-09c1-434d-a83b-acb04826284b None None] MFA Rules not processed for user `bea3f0b966a743fb8de935883485ffa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:25:25.651864 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-9ce1a1e3-09c1-434d-a83b-acb04826284b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:25:25.864622 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 835/1669] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:25:25 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:25:25.875867 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214ad403-402a-495a-82e3-b5cc1bbd4bb8 admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:26.033520 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214ad403-402a-495a-82e3-b5cc1bbd4bb8 admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:26.040524 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8f5fd0-c0f2-4f0f-9e5b-23bf8f44a704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:26.042486 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8f5fd0-c0f2-4f0f-9e5b-23bf8f44a704 admin admin] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:26.042486 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8f5fd0-c0f2-4f0f-9e5b-23bf8f44a704 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:26.043157 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8f5fd0-c0f2-4f0f-9e5b-23bf8f44a704 admin admin] PATH_INFO: `/v3/projects` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:26.044127 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8f5fd0-c0f2-4f0f-9e5b-23bf8f44a704 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:26.048738 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8f5fd0-c0f2-4f0f-9e5b-23bf8f44a704 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:26.154627 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 835/1670] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 16 17:25:25 2022] POST /identity/v3/projects => generated 369 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:25:26.160138 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce1a1e3-09c1-434d-a83b-acb04826284b None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:26.175856 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce1a1e3-09c1-434d-a83b-acb04826284b None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:26.328774 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3f61f7-9dce-4f1d-94f4-e139c0768d1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:26.331247 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3f61f7-9dce-4f1d-94f4-e139c0768d1d admin admin] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:26.331616 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3f61f7-9dce-4f1d-94f4-e139c0768d1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:26.332038 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3f61f7-9dce-4f1d-94f4-e139c0768d1d admin admin] PATH_INFO: `/v3/users` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:26.333412 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3f61f7-9dce-4f1d-94f4-e139c0768d1d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:26.342222 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3f61f7-9dce-4f1d-94f4-e139c0768d1d admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:26.453288 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 836/1671] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 16 17:25:26 2022] POST /identity/v3/users => generated 291 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:25:26.453970 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8f5fd0-c0f2-4f0f-9e5b-23bf8f44a704 admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:26.455509 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3f61f7-9dce-4f1d-94f4-e139c0768d1d admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:26.457656 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-0c8f5fd0-c0f2-4f0f-9e5b-23bf8f44a704 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:25:26.491290 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3f61f7-9dce-4f1d-94f4-e139c0768d1d admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:26.504125 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42636258-f044-438c-bddb-a4cd0120f96c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:26.504948 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42636258-f044-438c-bddb-a4cd0120f96c admin admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:26.505394 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42636258-f044-438c-bddb-a4cd0120f96c admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:26.505799 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42636258-f044-438c-bddb-a4cd0120f96c admin admin] PATH_INFO: `/v3/roles` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:26.506661 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42636258-f044-438c-bddb-a4cd0120f96c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:26.508396 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42636258-f044-438c-bddb-a4cd0120f96c admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:26.514079 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8f5fd0-c0f2-4f0f-9e5b-23bf8f44a704 admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:26.537209 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dede0412-62f0-4814-840b-edaafd9e51c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:26.538992 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dede0412-62f0-4814-840b-edaafd9e51c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:26.540286 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dede0412-62f0-4814-840b-edaafd9e51c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:26.540918 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dede0412-62f0-4814-840b-edaafd9e51c5 admin admin] PATH_INFO: `/v3/projects/5cdb4b9ba19a4ddb96a643723d8745f2` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:26.541235 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 837/1672] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 17:25:26 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:25:26.542648 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dede0412-62f0-4814-840b-edaafd9e51c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5cdb4b9ba19a4ddb96a643723d8745f2)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:26.545320 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dede0412-62f0-4814-840b-edaafd9e51c5 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:26.547938 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42636258-f044-438c-bddb-a4cd0120f96c admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:26.565827 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42636258-f044-438c-bddb-a4cd0120f96c admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:26.578090 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f7ee79-9adf-413d-81c5-9469b478d60d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:26.582408 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f7ee79-9adf-413d-81c5-9469b478d60d admin admin] REQUEST_METHOD: `PUT` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:26.582829 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f7ee79-9adf-413d-81c5-9469b478d60d admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:26.583295 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f7ee79-9adf-413d-81c5-9469b478d60d admin admin] PATH_INFO: `/v3/projects/51b19dbc843940a09508793e3def85de/users/688e95edaf6a4564a41828e28a42c90c/roles/dba744f8ab2a4c45b9d3212f8d203aba` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:26.623464 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f7ee79-9adf-413d-81c5-9469b478d60d admin admin] RBAC: Authorizing `identity:create_grant(project_id=51b19dbc843940a09508793e3def85de, user_id=688e95edaf6a4564a41828e28a42c90c, role_id=dba744f8ab2a4c45b9d3212f8d203aba)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:26.633080 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f7ee79-9adf-413d-81c5-9469b478d60d admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:26.723363 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 838/1673] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 17:25:26 2022] PUT /identity/v3/projects/51b19dbc843940a09508793e3def85de/users/688e95edaf6a4564a41828e28a42c90c/roles/dba744f8ab2a4c45b9d3212f8d203aba => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 17:25:26.724078 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f7ee79-9adf-413d-81c5-9469b478d60d admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:26.770429 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-dede0412-62f0-4814-840b-edaafd9e51c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5cdb4b9ba19a4ddb96a643723d8745f2', 'request_id': 'req-dede0412-62f0-4814-840b-edaafd9e51c5'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:25:26.783271 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-dede0412-62f0-4814-840b-edaafd9e51c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5cdb4b9ba19a4ddb96a643723d8745f2', 'request_id': 'req-dede0412-62f0-4814-840b-edaafd9e51c5'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:25:26.791216 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-dede0412-62f0-4814-840b-edaafd9e51c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5cdb4b9ba19a4ddb96a643723d8745f2', 'request_id': 'req-dede0412-62f0-4814-840b-edaafd9e51c5'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:25:26.877932 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f7ee79-9adf-413d-81c5-9469b478d60d admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:26.886041 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-dede0412-62f0-4814-840b-edaafd9e51c5 admin admin] The token cache is being invalidate because project 5cdb4b9ba19a4ddb96a643723d8745f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80873) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 17:25:26.891198 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-dede0412-62f0-4814-840b-edaafd9e51c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:25:26.894815 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-dede0412-62f0-4814-840b-edaafd9e51c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:25:26.902855 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 836/1674] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 16 17:25:26 2022] DELETE /identity/v3/projects/5cdb4b9ba19a4ddb96a643723d8745f2 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:25:26.909510 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c567cfe-c623-468e-8335-66627e85e56b None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:26.909873 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c567cfe-c623-468e-8335-66627e85e56b None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:26.910310 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c567cfe-c623-468e-8335-66627e85e56b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:26.918274 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:25:26.960368 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-2c567cfe-c623-468e-8335-66627e85e56b None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:25:26.964584 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-2c567cfe-c623-468e-8335-66627e85e56b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:25:27.044923 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7e5245-8093-4323-b0ac-964b95b50850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:27.046167 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7e5245-8093-4323-b0ac-964b95b50850 admin admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:27.046471 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7e5245-8093-4323-b0ac-964b95b50850 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:27.046761 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7e5245-8093-4323-b0ac-964b95b50850 admin admin] PATH_INFO: `/v3/roles` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:27.047518 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7e5245-8093-4323-b0ac-964b95b50850 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:27.049174 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7e5245-8093-4323-b0ac-964b95b50850 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:27.080775 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 839/1675] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 17:25:26 2022] GET /identity/v3/roles => generated 1420 bytes in 357 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 17:25:27.081684 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7e5245-8093-4323-b0ac-964b95b50850 admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:27.086040 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-fb7e5245-8093-4323-b0ac-964b95b50850 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:25:27.104457 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 837/1676] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:25:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 17:25:27.107000 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7e5245-8093-4323-b0ac-964b95b50850 admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:27.112823 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7918f7e8-3e70-4c77-bcc3-6dcc304820a3 None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:27.113650 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7918f7e8-3e70-4c77-bcc3-6dcc304820a3 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:27.113650 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7918f7e8-3e70-4c77-bcc3-6dcc304820a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:27.131778 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab7130c-dfca-436e-baad-d4f2b0c7d46b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:27.132714 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab7130c-dfca-436e-baad-d4f2b0c7d46b admin admin] REQUEST_METHOD: `PUT` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:27.133009 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab7130c-dfca-436e-baad-d4f2b0c7d46b admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:27.133297 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab7130c-dfca-436e-baad-d4f2b0c7d46b admin admin] PATH_INFO: `/v3/projects/51b19dbc843940a09508793e3def85de/users/688e95edaf6a4564a41828e28a42c90c/roles/dba744f8ab2a4c45b9d3212f8d203aba` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:27.146034 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab7130c-dfca-436e-baad-d4f2b0c7d46b admin admin] RBAC: Authorizing `identity:create_grant(project_id=51b19dbc843940a09508793e3def85de, user_id=688e95edaf6a4564a41828e28a42c90c, role_id=dba744f8ab2a4c45b9d3212f8d203aba)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:27.155551 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab7130c-dfca-436e-baad-d4f2b0c7d46b admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:27.160348 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-7918f7e8-3e70-4c77-bcc3-6dcc304820a3 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:25:27.161608 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-7918f7e8-3e70-4c77-bcc3-6dcc304820a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:25:27.179592 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 840/1677] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 17:25:27 2022] PUT /identity/v3/projects/51b19dbc843940a09508793e3def85de/users/688e95edaf6a4564a41828e28a42c90c/roles/dba744f8ab2a4c45b9d3212f8d203aba => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:25:27.190410 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e279ab7e-c358-4edc-8d5a-299f9c94e794 None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:27.190708 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e279ab7e-c358-4edc-8d5a-299f9c94e794 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:27.191744 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e279ab7e-c358-4edc-8d5a-299f9c94e794 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:27.223552 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-e279ab7e-c358-4edc-8d5a-299f9c94e794 None None] MFA Rules not processed for user `688e95edaf6a4564a41828e28a42c90c`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:25:27.224740 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-e279ab7e-c358-4edc-8d5a-299f9c94e794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:25:27.343310 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 838/1678] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:25:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 17:25:27.350049 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7918f7e8-3e70-4c77-bcc3-6dcc304820a3 None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:27.381323 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7918f7e8-3e70-4c77-bcc3-6dcc304820a3 None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:27.402558 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d9af9f-b091-4a02-a77e-220fcba38a49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:27.403252 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d9af9f-b091-4a02-a77e-220fcba38a49 admin admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:27.403543 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d9af9f-b091-4a02-a77e-220fcba38a49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:27.403843 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d9af9f-b091-4a02-a77e-220fcba38a49 admin admin] PATH_INFO: `/v3/domains` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:27.404585 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d9af9f-b091-4a02-a77e-220fcba38a49 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80873) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:25:27.404902 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d9af9f-b091-4a02-a77e-220fcba38a49 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:27.412754 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d9af9f-b091-4a02-a77e-220fcba38a49 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:27.447175 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 839/1679] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 16 17:25:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:25:27.450629 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d9af9f-b091-4a02-a77e-220fcba38a49 admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:27.473054 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d9af9f-b091-4a02-a77e-220fcba38a49 admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:27.487997 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2bd8b8-ea31-4398-909f-d9877ec19522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:27.488595 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2bd8b8-ea31-4398-909f-d9877ec19522 admin admin] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:27.489039 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2bd8b8-ea31-4398-909f-d9877ec19522 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:27.489963 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2bd8b8-ea31-4398-909f-d9877ec19522 admin admin] PATH_INFO: `/v3/projects` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:27.490091 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2bd8b8-ea31-4398-909f-d9877ec19522 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:27.494753 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2bd8b8-ea31-4398-909f-d9877ec19522 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:27.546813 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 841/1680] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:25:27 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 356 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 17:25:27.548657 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e279ab7e-c358-4edc-8d5a-299f9c94e794 None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:27.554266 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-e279ab7e-c358-4edc-8d5a-299f9c94e794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:25:27.621392 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e279ab7e-c358-4edc-8d5a-299f9c94e794 None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:27.635090 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca024b8-079a-4e49-b4d4-8f05b412d45c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:27.635994 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca024b8-079a-4e49-b4d4-8f05b412d45c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:27.636284 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca024b8-079a-4e49-b4d4-8f05b412d45c admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:27.636569 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca024b8-079a-4e49-b4d4-8f05b412d45c admin admin] PATH_INFO: `/v3/users/1ab72dc790a44d94a179b8fb1e4d04bd` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:27.638437 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca024b8-079a-4e49-b4d4-8f05b412d45c admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ab72dc790a44d94a179b8fb1e4d04bd)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:27.646821 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca024b8-079a-4e49-b4d4-8f05b412d45c admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:27.657702 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 840/1681] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 16 17:25:27 2022] POST /identity/v3/projects => generated 379 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 17:25:27.657702 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2bd8b8-ea31-4398-909f-d9877ec19522 admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:27.663162 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-6f2bd8b8-ea31-4398-909f-d9877ec19522 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:25:27.785387 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2bd8b8-ea31-4398-909f-d9877ec19522 admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:27.792077 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56aacc29-8ad8-4c45-9825-b59791520a33 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef37136b89d34edc9cd94c7aa81b2095', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:27.793037 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aacc29-8ad8-4c45-9825-b59791520a33 service cinder] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:27.794007 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aacc29-8ad8-4c45-9825-b59791520a33 service cinder] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:27.794592 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aacc29-8ad8-4c45-9825-b59791520a33 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:27.929103 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-8ca024b8-079a-4e49-b4d4-8f05b412d45c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ab72dc790a44d94a179b8fb1e4d04bd'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:25:27.946907 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-8ca024b8-079a-4e49-b4d4-8f05b412d45c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ab72dc790a44d94a179b8fb1e4d04bd'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:25:27.958913 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56aacc29-8ad8-4c45-9825-b59791520a33 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:27.962325 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56aacc29-8ad8-4c45-9825-b59791520a33 service cinder] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:27.989926 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 841/1682] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:25:27 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:25:27.990896 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56aacc29-8ad8-4c45-9825-b59791520a33 service cinder] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:28.028592 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-8ca024b8-079a-4e49-b4d4-8f05b412d45c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ab72dc790a44d94a179b8fb1e4d04bd'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:25:28.029335 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-8ca024b8-079a-4e49-b4d4-8f05b412d45c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ab72dc790a44d94a179b8fb1e4d04bd'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:25:28.052627 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-8ca024b8-079a-4e49-b4d4-8f05b412d45c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ab72dc790a44d94a179b8fb1e4d04bd'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:25:28.068363 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 842/1683] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 16 17:25:27 2022] DELETE /identity/v3/users/1ab72dc790a44d94a179b8fb1e4d04bd => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:25:28.073008 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeff76ca-2c73-426c-9a2e-c85c3af1327f None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:28.073322 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeff76ca-2c73-426c-9a2e-c85c3af1327f None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:28.073595 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeff76ca-2c73-426c-9a2e-c85c3af1327f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:28.112587 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-eeff76ca-2c73-426c-9a2e-c85c3af1327f None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:25:28.115624 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-eeff76ca-2c73-426c-9a2e-c85c3af1327f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:25:28.162124 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56aacc29-8ad8-4c45-9825-b59791520a33 service cinder] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:28.235210 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:25:28.297405 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 843/1684] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:25:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:25:28.298930 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeff76ca-2c73-426c-9a2e-c85c3af1327f None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:28.301045 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-eeff76ca-2c73-426c-9a2e-c85c3af1327f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:25:28.329070 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cf3574-5793-40de-8704-876bcd8be633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:28.329898 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeff76ca-2c73-426c-9a2e-c85c3af1327f None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:28.335091 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cf3574-5793-40de-8704-876bcd8be633 admin admin] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:28.335091 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cf3574-5793-40de-8704-876bcd8be633 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:28.335091 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cf3574-5793-40de-8704-876bcd8be633 admin admin] PATH_INFO: `/v3/users` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:28.338146 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cf3574-5793-40de-8704-876bcd8be633 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:28.342358 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cf3574-5793-40de-8704-876bcd8be633 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:28.355598 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a869b12-f893-40ad-9bfe-e1bdcbb9a215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:28.356876 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a869b12-f893-40ad-9bfe-e1bdcbb9a215 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:28.357332 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a869b12-f893-40ad-9bfe-e1bdcbb9a215 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:28.357808 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a869b12-f893-40ad-9bfe-e1bdcbb9a215 admin admin] PATH_INFO: `/v3/users/b14933ea29194b88bb6a0595add3beb6` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:28.360196 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a869b12-f893-40ad-9bfe-e1bdcbb9a215 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b14933ea29194b88bb6a0595add3beb6)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:28.362406 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a869b12-f893-40ad-9bfe-e1bdcbb9a215 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:28.465185 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 842/1685] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 16 17:25:27 2022] POST /identity/v3/users => generated 290 bytes in 475 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:25:28.466856 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cf3574-5793-40de-8704-876bcd8be633 admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:28.471335 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-f1cf3574-5793-40de-8704-876bcd8be633 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:25:28.639390 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cf3574-5793-40de-8704-876bcd8be633 admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:28.649353 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8750442-e474-4275-b8bd-f1ff1462e1dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5d25bfa8dc042329d57cd55fa7b7b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:28.650067 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8750442-e474-4275-b8bd-f1ff1462e1dc service neutron] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:28.650366 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8750442-e474-4275-b8bd-f1ff1462e1dc service neutron] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:28.653877 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8750442-e474-4275-b8bd-f1ff1462e1dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:28.680255 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8750442-e474-4275-b8bd-f1ff1462e1dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:28.685175 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8750442-e474-4275-b8bd-f1ff1462e1dc service neutron] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:28.710310 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 843/1686] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:25:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:25:28.711245 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8750442-e474-4275-b8bd-f1ff1462e1dc service neutron] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:28.717552 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-c8750442-e474-4275-b8bd-f1ff1462e1dc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:25:28.736191 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-4a869b12-f893-40ad-9bfe-e1bdcbb9a215 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b14933ea29194b88bb6a0595add3beb6'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:25:28.747668 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8750442-e474-4275-b8bd-f1ff1462e1dc service neutron] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:28.768283 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8003c2-07be-4218-af43-a66d275f0911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:28.768877 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8003c2-07be-4218-af43-a66d275f0911 admin admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:28.769123 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8003c2-07be-4218-af43-a66d275f0911 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:28.769586 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8003c2-07be-4218-af43-a66d275f0911 admin admin] PATH_INFO: `/v3/roles` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:28.772478 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8003c2-07be-4218-af43-a66d275f0911 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:28.773609 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-4a869b12-f893-40ad-9bfe-e1bdcbb9a215 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b14933ea29194b88bb6a0595add3beb6'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:25:28.779804 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8003c2-07be-4218-af43-a66d275f0911 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:28.814316 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 844/1687] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 17:25:28 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:25:28.815332 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8003c2-07be-4218-af43-a66d275f0911 admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:28.858720 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8003c2-07be-4218-af43-a66d275f0911 admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:28.873261 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8d9a93-d522-421c-91f5-9523240708bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:28.876073 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8d9a93-d522-421c-91f5-9523240708bf admin admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:28.876073 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8d9a93-d522-421c-91f5-9523240708bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:28.876073 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8d9a93-d522-421c-91f5-9523240708bf admin admin] PATH_INFO: `/v3/roles` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:28.876073 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8d9a93-d522-421c-91f5-9523240708bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:28.877444 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8d9a93-d522-421c-91f5-9523240708bf admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:28.897134 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-4a869b12-f893-40ad-9bfe-e1bdcbb9a215 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b14933ea29194b88bb6a0595add3beb6'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:25:28.898187 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-4a869b12-f893-40ad-9bfe-e1bdcbb9a215 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b14933ea29194b88bb6a0595add3beb6'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:25:28.922765 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 845/1688] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 17:25:28 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:25:28.945277 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8d9a93-d522-421c-91f5-9523240708bf admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:28.950657 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-4a869b12-f893-40ad-9bfe-e1bdcbb9a215 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b14933ea29194b88bb6a0595add3beb6'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:25:28.964522 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-ce8d9a93-d522-421c-91f5-9523240708bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:25:28.978649 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 844/1689] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 16 17:25:28 2022] DELETE /identity/v3/users/b14933ea29194b88bb6a0595add3beb6 => generated 0 bytes in 678 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:25:28.980415 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf01008-a6ae-4ca6-8a7d-e8a7f9984106 None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:28.981338 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf01008-a6ae-4ca6-8a7d-e8a7f9984106 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:28.981338 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf01008-a6ae-4ca6-8a7d-e8a7f9984106 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:29.007231 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8d9a93-d522-421c-91f5-9523240708bf admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:29.049844 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-2cf01008-a6ae-4ca6-8a7d-e8a7f9984106 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:25:29.055552 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-2cf01008-a6ae-4ca6-8a7d-e8a7f9984106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:25:29.206238 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61038314-ab5e-4d67-999c-49f6918bc3b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:29.207370 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61038314-ab5e-4d67-999c-49f6918bc3b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:29.207704 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61038314-ab5e-4d67-999c-49f6918bc3b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:29.208117 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61038314-ab5e-4d67-999c-49f6918bc3b7 admin admin] PATH_INFO: `/v3/projects/e8ed5a4c99424bfda8102da1dabde57e/users/b3873e69b8544aa4b75444253687c879/roles/896bff49c5d6464eb612a15f4aa9badc` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:29.244768 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61038314-ab5e-4d67-999c-49f6918bc3b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8ed5a4c99424bfda8102da1dabde57e, user_id=b3873e69b8544aa4b75444253687c879, role_id=896bff49c5d6464eb612a15f4aa9badc)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:29.247901 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61038314-ab5e-4d67-999c-49f6918bc3b7 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:29.289527 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 845/1690] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:25:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:25:29.337290 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 846/1691] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 17:25:28 2022] PUT /identity/v3/projects/e8ed5a4c99424bfda8102da1dabde57e/users/b3873e69b8544aa4b75444253687c879/roles/896bff49c5d6464eb612a15f4aa9badc => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:25:29.351736 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108e0639-bf0a-402b-ad1b-dba6802cf44f None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:29.352032 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108e0639-bf0a-402b-ad1b-dba6802cf44f None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:29.352420 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108e0639-bf0a-402b-ad1b-dba6802cf44f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:29.358583 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61038314-ab5e-4d67-999c-49f6918bc3b7 admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:29.361437 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-61038314-ab5e-4d67-999c-49f6918bc3b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:25:29.421791 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-108e0639-bf0a-402b-ad1b-dba6802cf44f None None] MFA Rules not processed for user `b3873e69b8544aa4b75444253687c879`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:25:29.423357 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-108e0639-bf0a-402b-ad1b-dba6802cf44f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:25:29.538982 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61038314-ab5e-4d67-999c-49f6918bc3b7 admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:29.553527 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de28444a-c44d-4cf1-bc65-7345f5614323 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5d25bfa8dc042329d57cd55fa7b7b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:29.554468 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de28444a-c44d-4cf1-bc65-7345f5614323 service neutron] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:29.554966 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de28444a-c44d-4cf1-bc65-7345f5614323 service neutron] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:29.555473 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de28444a-c44d-4cf1-bc65-7345f5614323 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:29.578223 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:25:29.637239 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 846/1692] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:25:29 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:25:29.643428 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108e0639-bf0a-402b-ad1b-dba6802cf44f None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:29.699506 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de28444a-c44d-4cf1-bc65-7345f5614323 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:29.704138 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de28444a-c44d-4cf1-bc65-7345f5614323 service neutron] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:29.736860 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 847/1693] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:25:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:25:29.739875 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de28444a-c44d-4cf1-bc65-7345f5614323 service neutron] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:29.743469 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-de28444a-c44d-4cf1-bc65-7345f5614323 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:25:29.789561 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de28444a-c44d-4cf1-bc65-7345f5614323 service neutron] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:29.808689 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a70fb1-6c7a-44cf-9032-125ab389f266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:29.809623 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a70fb1-6c7a-44cf-9032-125ab389f266 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:29.809941 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a70fb1-6c7a-44cf-9032-125ab389f266 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:29.810232 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a70fb1-6c7a-44cf-9032-125ab389f266 admin admin] PATH_INFO: `/v3/users/bea3f0b966a743fb8de935883485ffa0` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:29.813355 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a70fb1-6c7a-44cf-9032-125ab389f266 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bea3f0b966a743fb8de935883485ffa0)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:29.815500 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a70fb1-6c7a-44cf-9032-125ab389f266 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:29.880016 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108e0639-bf0a-402b-ad1b-dba6802cf44f None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:29.891383 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55eb2ce8-529d-42e9-8ee5-7b33680a5dd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:29.892098 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eb2ce8-529d-42e9-8ee5-7b33680a5dd6 admin admin] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:29.895428 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eb2ce8-529d-42e9-8ee5-7b33680a5dd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:29.895899 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eb2ce8-529d-42e9-8ee5-7b33680a5dd6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:29.896770 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55eb2ce8-529d-42e9-8ee5-7b33680a5dd6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:29.919357 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55eb2ce8-529d-42e9-8ee5-7b33680a5dd6 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:30.017803 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-95a70fb1-6c7a-44cf-9032-125ab389f266 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bea3f0b966a743fb8de935883485ffa0'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:25:30.019144 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-95a70fb1-6c7a-44cf-9032-125ab389f266 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bea3f0b966a743fb8de935883485ffa0'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:25:30.020386 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-95a70fb1-6c7a-44cf-9032-125ab389f266 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bea3f0b966a743fb8de935883485ffa0'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:25:30.022728 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:25:30.085050 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 847/1694] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 16 17:25:29 2022] POST /identity/v3/projects => generated 379 bytes in 442 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:25:30.086219 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55eb2ce8-529d-42e9-8ee5-7b33680a5dd6 admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:30.096062 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-55eb2ce8-529d-42e9-8ee5-7b33680a5dd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:25:30.103812 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-95a70fb1-6c7a-44cf-9032-125ab389f266 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bea3f0b966a743fb8de935883485ffa0'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:25:30.117616 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-95a70fb1-6c7a-44cf-9032-125ab389f266 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bea3f0b966a743fb8de935883485ffa0'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:25:30.191588 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 848/1695] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 16 17:25:29 2022] DELETE /identity/v3/users/bea3f0b966a743fb8de935883485ffa0 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:25:30.193816 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d81cbb8-e8fd-42c3-a17c-08bdb68ed826 None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:30.194211 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d81cbb8-e8fd-42c3-a17c-08bdb68ed826 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:30.194599 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d81cbb8-e8fd-42c3-a17c-08bdb68ed826 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:30.244602 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-2d81cbb8-e8fd-42c3-a17c-08bdb68ed826 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:25:30.248048 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-2d81cbb8-e8fd-42c3-a17c-08bdb68ed826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:25:30.346469 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55eb2ce8-529d-42e9-8ee5-7b33680a5dd6 admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:30.465392 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 849/1696] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:25:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:25:30.514516 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e0eea4-6a12-4f91-8559-9f5f72b57703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:30.515338 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e0eea4-6a12-4f91-8559-9f5f72b57703 admin admin] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:30.515730 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e0eea4-6a12-4f91-8559-9f5f72b57703 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:30.516125 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e0eea4-6a12-4f91-8559-9f5f72b57703 admin admin] PATH_INFO: `/v3/users` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:30.517051 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e0eea4-6a12-4f91-8559-9f5f72b57703 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:30.519835 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e0eea4-6a12-4f91-8559-9f5f72b57703 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:30.538772 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d81cbb8-e8fd-42c3-a17c-08bdb68ed826 None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:30.540919 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-2d81cbb8-e8fd-42c3-a17c-08bdb68ed826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:25:30.560219 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d81cbb8-e8fd-42c3-a17c-08bdb68ed826 None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:30.585710 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c237e40e-abb0-4ce7-b6a6-3688bdfd47d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:30.585710 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c237e40e-abb0-4ce7-b6a6-3688bdfd47d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:30.604377 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c237e40e-abb0-4ce7-b6a6-3688bdfd47d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:30.604377 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c237e40e-abb0-4ce7-b6a6-3688bdfd47d5 admin admin] PATH_INFO: `/v3/users/40257d052ad341bfb3264b1f94e59361` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:30.604377 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c237e40e-abb0-4ce7-b6a6-3688bdfd47d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=40257d052ad341bfb3264b1f94e59361)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:30.604377 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c237e40e-abb0-4ce7-b6a6-3688bdfd47d5 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:30.629936 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 848/1697] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 16 17:25:30 2022] POST /identity/v3/users => generated 296 bytes in 544 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:25:30.629936 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e0eea4-6a12-4f91-8559-9f5f72b57703 admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:30.629936 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-c7e0eea4-6a12-4f91-8559-9f5f72b57703 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:25:30.847083 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e0eea4-6a12-4f91-8559-9f5f72b57703 admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:30.867669 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3cb197-af4a-4973-91eb-a48167068492 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5d25bfa8dc042329d57cd55fa7b7b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:30.868582 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3cb197-af4a-4973-91eb-a48167068492 service neutron] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:30.869057 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3cb197-af4a-4973-91eb-a48167068492 service neutron] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:30.870242 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3cb197-af4a-4973-91eb-a48167068492 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:30.907775 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3cb197-af4a-4973-91eb-a48167068492 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:30.910022 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3cb197-af4a-4973-91eb-a48167068492 service neutron] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:30.920690 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-c237e40e-abb0-4ce7-b6a6-3688bdfd47d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40257d052ad341bfb3264b1f94e59361'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:25:30.925147 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-c237e40e-abb0-4ce7-b6a6-3688bdfd47d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40257d052ad341bfb3264b1f94e59361'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:25:30.931354 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-c237e40e-abb0-4ce7-b6a6-3688bdfd47d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40257d052ad341bfb3264b1f94e59361'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:25:30.932010 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 849/1698] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:25:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:25:30.933116 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3cb197-af4a-4973-91eb-a48167068492 service neutron] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:30.969534 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-6d3cb197-af4a-4973-91eb-a48167068492 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:25:30.999071 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3cb197-af4a-4973-91eb-a48167068492 service neutron] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:31.006959 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5740356-a101-4427-8586-19d8c83004e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:31.007871 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5740356-a101-4427-8586-19d8c83004e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:31.008157 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5740356-a101-4427-8586-19d8c83004e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:31.008435 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5740356-a101-4427-8586-19d8c83004e7 admin admin] PATH_INFO: `/v3/projects/dda7e219d9944e6eb1eda6744cfe1291` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:31.010750 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-c237e40e-abb0-4ce7-b6a6-3688bdfd47d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40257d052ad341bfb3264b1f94e59361'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:25:31.020442 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-c237e40e-abb0-4ce7-b6a6-3688bdfd47d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40257d052ad341bfb3264b1f94e59361'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:25:31.022561 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5740356-a101-4427-8586-19d8c83004e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dda7e219d9944e6eb1eda6744cfe1291)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:31.024545 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5740356-a101-4427-8586-19d8c83004e7 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:31.093719 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 850/1699] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 16 17:25:30 2022] DELETE /identity/v3/users/40257d052ad341bfb3264b1f94e59361 => generated 0 bytes in 558 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:25:31.112873 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c237e40e-abb0-4ce7-b6a6-3688bdfd47d5 admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:31.113506 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-c237e40e-abb0-4ce7-b6a6-3688bdfd47d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:25:31.256031 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-a5740356-a101-4427-8586-19d8c83004e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dda7e219d9944e6eb1eda6744cfe1291', 'request_id': 'req-a5740356-a101-4427-8586-19d8c83004e7'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:25:31.278429 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-a5740356-a101-4427-8586-19d8c83004e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dda7e219d9944e6eb1eda6744cfe1291', 'request_id': 'req-a5740356-a101-4427-8586-19d8c83004e7'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:25:31.328628 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c237e40e-abb0-4ce7-b6a6-3688bdfd47d5 admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:31.380217 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-a5740356-a101-4427-8586-19d8c83004e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dda7e219d9944e6eb1eda6744cfe1291', 'request_id': 'req-a5740356-a101-4427-8586-19d8c83004e7'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:25:31.416304 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-a5740356-a101-4427-8586-19d8c83004e7 admin admin] The token cache is being invalidate because project dda7e219d9944e6eb1eda6744cfe1291 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80874) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 17:25:31.420346 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-a5740356-a101-4427-8586-19d8c83004e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:25:31.422257 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-a5740356-a101-4427-8586-19d8c83004e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:25:31.424749 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 850/1700] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 16 17:25:30 2022] DELETE /identity/v3/projects/dda7e219d9944e6eb1eda6744cfe1291 => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:25:31.427181 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35161c20-a60a-47f9-b5a5-c95329c2ba02 None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:31.429141 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35161c20-a60a-47f9-b5a5-c95329c2ba02 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:31.429141 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35161c20-a60a-47f9-b5a5-c95329c2ba02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:31.468140 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-35161c20-a60a-47f9-b5a5-c95329c2ba02 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:25:31.472572 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-35161c20-a60a-47f9-b5a5-c95329c2ba02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:25:31.493923 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999c8ab2-1448-49d4-98e1-8f0e381a9645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:31.493923 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999c8ab2-1448-49d4-98e1-8f0e381a9645 admin admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:31.494832 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999c8ab2-1448-49d4-98e1-8f0e381a9645 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:31.494832 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999c8ab2-1448-49d4-98e1-8f0e381a9645 admin admin] PATH_INFO: `/v3/roles` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:31.496436 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999c8ab2-1448-49d4-98e1-8f0e381a9645 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:31.498388 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999c8ab2-1448-49d4-98e1-8f0e381a9645 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:31.518746 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:25:31.531697 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 851/1701] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 17:25:31 2022] GET /identity/v3/roles => generated 1420 bytes in 437 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:25:31.533969 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999c8ab2-1448-49d4-98e1-8f0e381a9645 admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:31.541901 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-999c8ab2-1448-49d4-98e1-8f0e381a9645 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:25:31.566510 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999c8ab2-1448-49d4-98e1-8f0e381a9645 admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:31.590817 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfb170a-c519-4fbe-810d-cb69f344789a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:31.591945 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfb170a-c519-4fbe-810d-cb69f344789a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:31.594575 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfb170a-c519-4fbe-810d-cb69f344789a admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:31.595073 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfb170a-c519-4fbe-810d-cb69f344789a admin admin] PATH_INFO: `/v3/users/2cd427e738fa4202a914d8e1dd4dbb31` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:31.597467 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfb170a-c519-4fbe-810d-cb69f344789a admin admin] RBAC: Authorizing `identity:delete_user(user_id=2cd427e738fa4202a914d8e1dd4dbb31)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:31.604442 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfb170a-c519-4fbe-810d-cb69f344789a admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:31.649351 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 851/1702] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:25:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:25:31.652543 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35161c20-a60a-47f9-b5a5-c95329c2ba02 None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:31.655831 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-35161c20-a60a-47f9-b5a5-c95329c2ba02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:25:31.658138 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:25:31.687394 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35161c20-a60a-47f9-b5a5-c95329c2ba02 None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:31.703437 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faee1d71-1cd2-44b4-9744-e80566701b52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:31.703987 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faee1d71-1cd2-44b4-9744-e80566701b52 admin admin] REQUEST_METHOD: `PUT` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:31.704266 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faee1d71-1cd2-44b4-9744-e80566701b52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:31.704604 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faee1d71-1cd2-44b4-9744-e80566701b52 admin admin] PATH_INFO: `/v3/projects/221534f557f2456dae202733ada0293b/users/35125c3260104c57871daf4132e5ee12/roles/dba744f8ab2a4c45b9d3212f8d203aba` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:31.747456 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faee1d71-1cd2-44b4-9744-e80566701b52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=221534f557f2456dae202733ada0293b, user_id=35125c3260104c57871daf4132e5ee12, role_id=dba744f8ab2a4c45b9d3212f8d203aba)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:31.750365 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faee1d71-1cd2-44b4-9744-e80566701b52 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:31.861991 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-fbfb170a-c519-4fbe-810d-cb69f344789a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2cd427e738fa4202a914d8e1dd4dbb31'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:25:31.862802 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-fbfb170a-c519-4fbe-810d-cb69f344789a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2cd427e738fa4202a914d8e1dd4dbb31'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:25:31.863551 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-fbfb170a-c519-4fbe-810d-cb69f344789a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2cd427e738fa4202a914d8e1dd4dbb31'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:25:31.888022 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 852/1703] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 17:25:31 2022] PUT /identity/v3/projects/221534f557f2456dae202733ada0293b/users/35125c3260104c57871daf4132e5ee12/roles/dba744f8ab2a4c45b9d3212f8d203aba => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:25:31.891074 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faee1d71-1cd2-44b4-9744-e80566701b52 admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:31.894221 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-faee1d71-1cd2-44b4-9744-e80566701b52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:25:32.006075 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-fbfb170a-c519-4fbe-810d-cb69f344789a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2cd427e738fa4202a914d8e1dd4dbb31'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:25:32.028060 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-fbfb170a-c519-4fbe-810d-cb69f344789a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2cd427e738fa4202a914d8e1dd4dbb31'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:25:32.032012 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faee1d71-1cd2-44b4-9744-e80566701b52 admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:32.043284 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32c26c9-51d6-4f32-bfee-463d3d00b2e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5d25bfa8dc042329d57cd55fa7b7b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:32.043967 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32c26c9-51d6-4f32-bfee-463d3d00b2e1 service neutron] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:32.044260 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32c26c9-51d6-4f32-bfee-463d3d00b2e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:32.044586 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32c26c9-51d6-4f32-bfee-463d3d00b2e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:32.055611 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-f32c26c9-51d6-4f32-bfee-463d3d00b2e1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:25:32.088082 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 852/1704] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 16 17:25:31 2022] DELETE /identity/v3/users/2cd427e738fa4202a914d8e1dd4dbb31 => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:25:32.089114 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfb170a-c519-4fbe-810d-cb69f344789a admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:32.095112 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-fbfb170a-c519-4fbe-810d-cb69f344789a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:25:32.282457 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32c26c9-51d6-4f32-bfee-463d3d00b2e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:32.285502 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32c26c9-51d6-4f32-bfee-463d3d00b2e1 service neutron] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:32.298659 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfb170a-c519-4fbe-810d-cb69f344789a admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:32.306443 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc1ed22-fc70-42d5-b14b-03c052347549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:32.307266 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc1ed22-fc70-42d5-b14b-03c052347549 admin admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:32.308341 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc1ed22-fc70-42d5-b14b-03c052347549 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:32.308709 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc1ed22-fc70-42d5-b14b-03c052347549 admin admin] PATH_INFO: `/v3/roles` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:32.310168 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc1ed22-fc70-42d5-b14b-03c052347549 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:32.312643 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 853/1705] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:25:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:25:32.313606 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc1ed22-fc70-42d5-b14b-03c052347549 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:32.330806 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c6ddfe-48e0-4126-a307-c5fec12e8683 None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:32.330806 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c6ddfe-48e0-4126-a307-c5fec12e8683 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:32.330806 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c6ddfe-48e0-4126-a307-c5fec12e8683 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:32.366718 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 853/1706] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 17:25:32 2022] GET /identity/v3/roles => generated 1420 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:25:32.376424 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc1ed22-fc70-42d5-b14b-03c052347549 admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:32.386275 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-ccc1ed22-fc70-42d5-b14b-03c052347549 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:25:32.433424 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc1ed22-fc70-42d5-b14b-03c052347549 admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:32.435282 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-c4c6ddfe-48e0-4126-a307-c5fec12e8683 None None] MFA Rules not processed for user `695942c4783a4d45874ff48f29ff9638`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:25:32.441540 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-c4c6ddfe-48e0-4126-a307-c5fec12e8683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:25:32.449624 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d33be1e-2be7-453e-8065-68f1318f7c4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:32.450877 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d33be1e-2be7-453e-8065-68f1318f7c4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:32.452322 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d33be1e-2be7-453e-8065-68f1318f7c4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:32.452678 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d33be1e-2be7-453e-8065-68f1318f7c4b admin admin] PATH_INFO: `/v3/projects/84dfd5f5639249b5825a294f9b2a7a6e` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:32.459997 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d33be1e-2be7-453e-8065-68f1318f7c4b admin admin] RBAC: Authorizing `identity:delete_project(project_id=84dfd5f5639249b5825a294f9b2a7a6e)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:32.459997 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d33be1e-2be7-453e-8065-68f1318f7c4b admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:32.658274 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 854/1707] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:25:32 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:25:32.660026 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d757b19-408f-4510-bd24-ba2c6f3d83ce None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:32.660487 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d757b19-408f-4510-bd24-ba2c6f3d83ce None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:32.660902 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d757b19-408f-4510-bd24-ba2c6f3d83ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:32.693645 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-4d33be1e-2be7-453e-8065-68f1318f7c4b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84dfd5f5639249b5825a294f9b2a7a6e', 'request_id': 'req-4d33be1e-2be7-453e-8065-68f1318f7c4b'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:25:32.733286 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-4d33be1e-2be7-453e-8065-68f1318f7c4b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84dfd5f5639249b5825a294f9b2a7a6e', 'request_id': 'req-4d33be1e-2be7-453e-8065-68f1318f7c4b'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:25:32.745887 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-5d757b19-408f-4510-bd24-ba2c6f3d83ce None None] MFA Rules not processed for user `9497772835074d40b7f748507eb539b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:25:32.751147 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-5d757b19-408f-4510-bd24-ba2c6f3d83ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:25:32.758393 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-4d33be1e-2be7-453e-8065-68f1318f7c4b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84dfd5f5639249b5825a294f9b2a7a6e', 'request_id': 'req-4d33be1e-2be7-453e-8065-68f1318f7c4b'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:25:32.886737 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-4d33be1e-2be7-453e-8065-68f1318f7c4b admin admin] The token cache is being invalidate because project 84dfd5f5639249b5825a294f9b2a7a6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80873) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 17:25:32.887101 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-4d33be1e-2be7-453e-8065-68f1318f7c4b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:25:32.897834 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-4d33be1e-2be7-453e-8065-68f1318f7c4b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:25:32.897834 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 854/1708] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 16 17:25:32 2022] DELETE /identity/v3/projects/84dfd5f5639249b5825a294f9b2a7a6e => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:25:32.897834 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d33be1e-2be7-453e-8065-68f1318f7c4b admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:32.899180 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 855/1709] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:25:32 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:25:32.900348 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d757b19-408f-4510-bd24-ba2c6f3d83ce None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:32.902863 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-4d33be1e-2be7-453e-8065-68f1318f7c4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:25:33.035003 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d757b19-408f-4510-bd24-ba2c6f3d83ce None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:33.054657 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22e694c-6a5f-4659-af36-9e0000365387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:33.055554 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22e694c-6a5f-4659-af36-9e0000365387 admin admin] REQUEST_METHOD: `PUT` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:33.055849 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22e694c-6a5f-4659-af36-9e0000365387 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:33.056139 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22e694c-6a5f-4659-af36-9e0000365387 admin admin] PATH_INFO: `/v3/projects/221534f557f2456dae202733ada0293b/users/35125c3260104c57871daf4132e5ee12/roles/dba744f8ab2a4c45b9d3212f8d203aba` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:33.058921 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22e694c-6a5f-4659-af36-9e0000365387 admin admin] RBAC: Authorizing `identity:create_grant(project_id=221534f557f2456dae202733ada0293b, user_id=35125c3260104c57871daf4132e5ee12, role_id=dba744f8ab2a4c45b9d3212f8d203aba)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:33.062060 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22e694c-6a5f-4659-af36-9e0000365387 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:33.072181 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d33be1e-2be7-453e-8065-68f1318f7c4b admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:33.087891 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae69a6dd-36e8-48ca-9973-c65c56bf50b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:33.091738 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae69a6dd-36e8-48ca-9973-c65c56bf50b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:33.092243 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae69a6dd-36e8-48ca-9973-c65c56bf50b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:33.092672 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae69a6dd-36e8-48ca-9973-c65c56bf50b4 admin admin] PATH_INFO: `/v3/projects/9528fb759d864bd7a813d5e5dad4daf2` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:33.094209 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae69a6dd-36e8-48ca-9973-c65c56bf50b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9528fb759d864bd7a813d5e5dad4daf2)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:33.096590 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae69a6dd-36e8-48ca-9973-c65c56bf50b4 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:33.098095 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 856/1710] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 17:25:32 2022] PUT /identity/v3/projects/221534f557f2456dae202733ada0293b/users/35125c3260104c57871daf4132e5ee12/roles/dba744f8ab2a4c45b9d3212f8d203aba => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:25:33.099835 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c3fffd-fda6-4a26-bce1-e7c48672cd2a None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:33.099970 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c3fffd-fda6-4a26-bce1-e7c48672cd2a None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:33.100209 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c3fffd-fda6-4a26-bce1-e7c48672cd2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:33.142727 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-37c3fffd-fda6-4a26-bce1-e7c48672cd2a None None] MFA Rules not processed for user `695942c4783a4d45874ff48f29ff9638`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:25:33.144054 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-37c3fffd-fda6-4a26-bce1-e7c48672cd2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:25:33.225729 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 857/1711] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:25:33 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:25:33.226728 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c3fffd-fda6-4a26-bce1-e7c48672cd2a None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:33.231041 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-37c3fffd-fda6-4a26-bce1-e7c48672cd2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:25:33.296664 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-ae69a6dd-36e8-48ca-9973-c65c56bf50b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9528fb759d864bd7a813d5e5dad4daf2', 'request_id': 'req-ae69a6dd-36e8-48ca-9973-c65c56bf50b4'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:25:33.307555 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-ae69a6dd-36e8-48ca-9973-c65c56bf50b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9528fb759d864bd7a813d5e5dad4daf2', 'request_id': 'req-ae69a6dd-36e8-48ca-9973-c65c56bf50b4'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:25:33.315915 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-ae69a6dd-36e8-48ca-9973-c65c56bf50b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9528fb759d864bd7a813d5e5dad4daf2', 'request_id': 'req-ae69a6dd-36e8-48ca-9973-c65c56bf50b4'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:25:33.339789 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c3fffd-fda6-4a26-bce1-e7c48672cd2a None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:33.399041 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-ae69a6dd-36e8-48ca-9973-c65c56bf50b4 admin admin] The token cache is being invalidate because project 9528fb759d864bd7a813d5e5dad4daf2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80873) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 17:25:33.399339 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-ae69a6dd-36e8-48ca-9973-c65c56bf50b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:25:33.400087 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-ae69a6dd-36e8-48ca-9973-c65c56bf50b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:25:33.401928 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 855/1712] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 16 17:25:32 2022] DELETE /identity/v3/projects/9528fb759d864bd7a813d5e5dad4daf2 => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:25:33.405251 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae69a6dd-36e8-48ca-9973-c65c56bf50b4 admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:33.405251 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-ae69a6dd-36e8-48ca-9973-c65c56bf50b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:25:33.425586 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bf0041-9729-4ff7-9e0c-10fb0c5cc438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:33.426805 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bf0041-9729-4ff7-9e0c-10fb0c5cc438 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:33.432510 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bf0041-9729-4ff7-9e0c-10fb0c5cc438 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:33.432510 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bf0041-9729-4ff7-9e0c-10fb0c5cc438 admin admin] PATH_INFO: `/v3/users/688e95edaf6a4564a41828e28a42c90c` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:33.432510 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bf0041-9729-4ff7-9e0c-10fb0c5cc438 admin admin] RBAC: Authorizing `identity:delete_user(user_id=688e95edaf6a4564a41828e28a42c90c)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:33.434246 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bf0041-9729-4ff7-9e0c-10fb0c5cc438 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:33.486153 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:25:33.520085 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae69a6dd-36e8-48ca-9973-c65c56bf50b4 admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:33.525985 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5275c897-74a7-4dca-8b40-859e9140aee8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d381bb41dea4f1e90c3cf3815ac88dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:33.526652 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5275c897-74a7-4dca-8b40-859e9140aee8 service nova] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:33.526943 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5275c897-74a7-4dca-8b40-859e9140aee8 service nova] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:33.527220 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5275c897-74a7-4dca-8b40-859e9140aee8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:33.529141 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-5275c897-74a7-4dca-8b40-859e9140aee8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:25:33.593819 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5275c897-74a7-4dca-8b40-859e9140aee8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:33.595463 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5275c897-74a7-4dca-8b40-859e9140aee8 service nova] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:33.605323 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:25:33.612307 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 856/1713] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:25:33 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:25:33.614689 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1621dcd2-60dc-4970-86a5-27c4e7ac263a None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:33.614689 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1621dcd2-60dc-4970-86a5-27c4e7ac263a None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:33.614689 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1621dcd2-60dc-4970-86a5-27c4e7ac263a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:33.653919 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-1621dcd2-60dc-4970-86a5-27c4e7ac263a None None] MFA Rules not processed for user `b2dcab3652474b53b88e9443c0458721`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:25:33.657094 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-1621dcd2-60dc-4970-86a5-27c4e7ac263a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:25:33.714687 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-a2bf0041-9729-4ff7-9e0c-10fb0c5cc438 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '688e95edaf6a4564a41828e28a42c90c'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:25:33.727256 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-a2bf0041-9729-4ff7-9e0c-10fb0c5cc438 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '688e95edaf6a4564a41828e28a42c90c'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:25:33.761868 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 857/1714] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:25:33 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:25:33.762670 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5a8d2a-f957-4658-a5d6-e65ded013a7b None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:33.762962 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5a8d2a-f957-4658-a5d6-e65ded013a7b None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:33.763667 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5a8d2a-f957-4658-a5d6-e65ded013a7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:33.799888 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-1b5a8d2a-f957-4658-a5d6-e65ded013a7b None None] MFA Rules not processed for user `35125c3260104c57871daf4132e5ee12`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:25:33.801226 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-1b5a8d2a-f957-4658-a5d6-e65ded013a7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:25:33.839204 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-a2bf0041-9729-4ff7-9e0c-10fb0c5cc438 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '688e95edaf6a4564a41828e28a42c90c'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:25:33.840137 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-a2bf0041-9729-4ff7-9e0c-10fb0c5cc438 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '688e95edaf6a4564a41828e28a42c90c'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:25:33.868856 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-a2bf0041-9729-4ff7-9e0c-10fb0c5cc438 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '688e95edaf6a4564a41828e28a42c90c'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:25:33.880878 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 858/1715] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 16 17:25:33 2022] DELETE /identity/v3/users/688e95edaf6a4564a41828e28a42c90c => generated 0 bytes in 651 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:25:33.912386 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bf0041-9729-4ff7-9e0c-10fb0c5cc438 admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:33.912386 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-a2bf0041-9729-4ff7-9e0c-10fb0c5cc438 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:25:33.912540 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 858/1716] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:25:33 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:25:33.912540 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5a8d2a-f957-4658-a5d6-e65ded013a7b None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:33.912540 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-1b5a8d2a-f957-4658-a5d6-e65ded013a7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:25:33.941465 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5a8d2a-f957-4658-a5d6-e65ded013a7b None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:33.995947 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bf0041-9729-4ff7-9e0c-10fb0c5cc438 admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:34.005220 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d7795f-fe20-429c-8c2a-544ed0b65afd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:34.006301 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d7795f-fe20-429c-8c2a-544ed0b65afd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:34.006677 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d7795f-fe20-429c-8c2a-544ed0b65afd admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:34.012818 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d7795f-fe20-429c-8c2a-544ed0b65afd admin admin] PATH_INFO: `/v3/projects/1ccbc44615794a719bb36d6718f83762` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:34.015064 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d7795f-fe20-429c-8c2a-544ed0b65afd admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ccbc44615794a719bb36d6718f83762)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:34.017092 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d7795f-fe20-429c-8c2a-544ed0b65afd admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:34.064394 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9f482a-ed05-4ae0-860e-538bc4d33878 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d381bb41dea4f1e90c3cf3815ac88dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:34.065102 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9f482a-ed05-4ae0-860e-538bc4d33878 service nova] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:34.065389 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9f482a-ed05-4ae0-860e-538bc4d33878 service nova] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:34.065673 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9f482a-ed05-4ae0-860e-538bc4d33878 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:34.068650 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-5f9f482a-ed05-4ae0-860e-538bc4d33878 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:25:34.166003 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9f482a-ed05-4ae0-860e-538bc4d33878 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:34.173003 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9f482a-ed05-4ae0-860e-538bc4d33878 service nova] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:34.173092 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-a3d7795f-fe20-429c-8c2a-544ed0b65afd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ccbc44615794a719bb36d6718f83762', 'request_id': 'req-a3d7795f-fe20-429c-8c2a-544ed0b65afd'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:25:34.180820 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-a3d7795f-fe20-429c-8c2a-544ed0b65afd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ccbc44615794a719bb36d6718f83762', 'request_id': 'req-a3d7795f-fe20-429c-8c2a-544ed0b65afd'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:25:34.185319 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 859/1717] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:25:33 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:25:34.186713 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9f482a-ed05-4ae0-860e-538bc4d33878 service nova] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:34.188125 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-5f9f482a-ed05-4ae0-860e-538bc4d33878 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:25:34.224796 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9f482a-ed05-4ae0-860e-538bc4d33878 service nova] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:34.315267 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c78b2ce-8ffe-40b4-a391-265f8bf6d5aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:34.316263 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c78b2ce-8ffe-40b4-a391-265f8bf6d5aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:34.316556 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c78b2ce-8ffe-40b4-a391-265f8bf6d5aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:34.316898 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c78b2ce-8ffe-40b4-a391-265f8bf6d5aa admin admin] PATH_INFO: `/v3/projects/17257801660146e6a2bd18970a4b486f` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:34.317737 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-a3d7795f-fe20-429c-8c2a-544ed0b65afd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ccbc44615794a719bb36d6718f83762', 'request_id': 'req-a3d7795f-fe20-429c-8c2a-544ed0b65afd'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:25:34.318118 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c78b2ce-8ffe-40b4-a391-265f8bf6d5aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=17257801660146e6a2bd18970a4b486f)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:34.320782 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c78b2ce-8ffe-40b4-a391-265f8bf6d5aa admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:34.350779 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-a3d7795f-fe20-429c-8c2a-544ed0b65afd admin admin] The token cache is being invalidate because project 1ccbc44615794a719bb36d6718f83762 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80874) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 17:25:34.354156 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-a3d7795f-fe20-429c-8c2a-544ed0b65afd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:25:34.362399 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-a3d7795f-fe20-429c-8c2a-544ed0b65afd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:25:34.371953 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 859/1718] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 16 17:25:33 2022] DELETE /identity/v3/projects/1ccbc44615794a719bb36d6718f83762 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:25:34.373242 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d7795f-fe20-429c-8c2a-544ed0b65afd admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:34.388267 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-a3d7795f-fe20-429c-8c2a-544ed0b65afd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:25:34.407564 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d7795f-fe20-429c-8c2a-544ed0b65afd admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:34.425808 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22d7d66-b9ab-421c-bad1-726841f7862a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:34.427571 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22d7d66-b9ab-421c-bad1-726841f7862a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:34.427955 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22d7d66-b9ab-421c-bad1-726841f7862a admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:34.428428 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22d7d66-b9ab-421c-bad1-726841f7862a admin admin] PATH_INFO: `/v3/users/f9247cda6f6f4072824c3764387208bf` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:34.430146 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22d7d66-b9ab-421c-bad1-726841f7862a admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9247cda6f6f4072824c3764387208bf)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:34.433039 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22d7d66-b9ab-421c-bad1-726841f7862a admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:34.526562 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-0c78b2ce-8ffe-40b4-a391-265f8bf6d5aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17257801660146e6a2bd18970a4b486f', 'request_id': 'req-0c78b2ce-8ffe-40b4-a391-265f8bf6d5aa'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:25:34.533492 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-0c78b2ce-8ffe-40b4-a391-265f8bf6d5aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17257801660146e6a2bd18970a4b486f', 'request_id': 'req-0c78b2ce-8ffe-40b4-a391-265f8bf6d5aa'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:25:34.540358 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-0c78b2ce-8ffe-40b4-a391-265f8bf6d5aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17257801660146e6a2bd18970a4b486f', 'request_id': 'req-0c78b2ce-8ffe-40b4-a391-265f8bf6d5aa'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:25:34.631967 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-0c78b2ce-8ffe-40b4-a391-265f8bf6d5aa admin admin] The token cache is being invalidate because project 17257801660146e6a2bd18970a4b486f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80873) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 17:25:34.632433 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-0c78b2ce-8ffe-40b4-a391-265f8bf6d5aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:25:34.633656 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-0c78b2ce-8ffe-40b4-a391-265f8bf6d5aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:25:34.639367 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 860/1719] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 16 17:25:34 2022] DELETE /identity/v3/projects/17257801660146e6a2bd18970a4b486f => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:25:34.639367 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf606e48-e36c-405f-900c-f608eb63f667 None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:34.639367 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf606e48-e36c-405f-900c-f608eb63f667 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:34.639367 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf606e48-e36c-405f-900c-f608eb63f667 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:34.675785 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-cf606e48-e36c-405f-900c-f608eb63f667 None None] MFA Rules not processed for user `b2dcab3652474b53b88e9443c0458721`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:25:34.695690 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-cf606e48-e36c-405f-900c-f608eb63f667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:25:34.719150 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-b22d7d66-b9ab-421c-bad1-726841f7862a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9247cda6f6f4072824c3764387208bf'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:25:34.739312 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-b22d7d66-b9ab-421c-bad1-726841f7862a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9247cda6f6f4072824c3764387208bf'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:25:34.837584 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 861/1720] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:25:34 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:25:34.837584 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf606e48-e36c-405f-900c-f608eb63f667 None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:34.852839 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-cf606e48-e36c-405f-900c-f608eb63f667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:25:34.874001 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-b22d7d66-b9ab-421c-bad1-726841f7862a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9247cda6f6f4072824c3764387208bf'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:25:34.878533 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-b22d7d66-b9ab-421c-bad1-726841f7862a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9247cda6f6f4072824c3764387208bf'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:25:34.917407 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-b22d7d66-b9ab-421c-bad1-726841f7862a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9247cda6f6f4072824c3764387208bf'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:25:34.925615 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf606e48-e36c-405f-900c-f608eb63f667 None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:34.933576 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 860/1721] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 16 17:25:34 2022] DELETE /identity/v3/users/f9247cda6f6f4072824c3764387208bf => generated 0 bytes in 557 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:25:34.936993 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60935c59-46cb-4b76-a1df-7e673c0ba1e1 None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:34.937497 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60935c59-46cb-4b76-a1df-7e673c0ba1e1 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:34.938144 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60935c59-46cb-4b76-a1df-7e673c0ba1e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:34.963883 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-60935c59-46cb-4b76-a1df-7e673c0ba1e1 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:25:34.972385 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-60935c59-46cb-4b76-a1df-7e673c0ba1e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:25:35.048018 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e668bdc4-026e-443f-b416-671c84869ad3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef37136b89d34edc9cd94c7aa81b2095', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:35.048751 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e668bdc4-026e-443f-b416-671c84869ad3 service cinder] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:35.049553 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e668bdc4-026e-443f-b416-671c84869ad3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:35.049553 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e668bdc4-026e-443f-b416-671c84869ad3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:35.054816 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-e668bdc4-026e-443f-b416-671c84869ad3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:25:35.139477 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e668bdc4-026e-443f-b416-671c84869ad3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:35.140999 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e668bdc4-026e-443f-b416-671c84869ad3 service cinder] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:35.152056 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 862/1722] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:25:34 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:25:35.153573 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39d9462-91aa-43c6-be1e-8e4d6453e68a None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:35.154111 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39d9462-91aa-43c6-be1e-8e4d6453e68a None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:35.154430 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39d9462-91aa-43c6-be1e-8e4d6453e68a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:35.175039 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-b39d9462-91aa-43c6-be1e-8e4d6453e68a None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:25:35.175872 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-b39d9462-91aa-43c6-be1e-8e4d6453e68a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:25:35.279118 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:25:35.283311 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 863/1723] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:25:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:25:35.284294 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39d9462-91aa-43c6-be1e-8e4d6453e68a None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:35.285754 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-b39d9462-91aa-43c6-be1e-8e4d6453e68a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:25:35.299692 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39d9462-91aa-43c6-be1e-8e4d6453e68a None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:35.309957 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdc67c3-88ca-4ca6-9ee8-36c9275a3d17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:35.311003 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdc67c3-88ca-4ca6-9ee8-36c9275a3d17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:35.311298 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdc67c3-88ca-4ca6-9ee8-36c9275a3d17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:35.311809 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdc67c3-88ca-4ca6-9ee8-36c9275a3d17 admin admin] PATH_INFO: `/v3/projects/51b19dbc843940a09508793e3def85de` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:35.313417 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdc67c3-88ca-4ca6-9ee8-36c9275a3d17 admin admin] RBAC: Authorizing `identity:delete_project(project_id=51b19dbc843940a09508793e3def85de)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:35.316182 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdc67c3-88ca-4ca6-9ee8-36c9275a3d17 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:35.398777 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 861/1724] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:25:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 464 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:25:35.400268 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60935c59-46cb-4b76-a1df-7e673c0ba1e1 None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:35.402360 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-60935c59-46cb-4b76-a1df-7e673c0ba1e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:25:35.494981 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-4cdc67c3-88ca-4ca6-9ee8-36c9275a3d17 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51b19dbc843940a09508793e3def85de', 'request_id': 'req-4cdc67c3-88ca-4ca6-9ee8-36c9275a3d17'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:25:35.506418 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-4cdc67c3-88ca-4ca6-9ee8-36c9275a3d17 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51b19dbc843940a09508793e3def85de', 'request_id': 'req-4cdc67c3-88ca-4ca6-9ee8-36c9275a3d17'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:25:35.529248 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-4cdc67c3-88ca-4ca6-9ee8-36c9275a3d17 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51b19dbc843940a09508793e3def85de', 'request_id': 'req-4cdc67c3-88ca-4ca6-9ee8-36c9275a3d17'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:25:35.603020 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60935c59-46cb-4b76-a1df-7e673c0ba1e1 None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:35.654020 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-4cdc67c3-88ca-4ca6-9ee8-36c9275a3d17 admin admin] The token cache is being invalidate because project 51b19dbc843940a09508793e3def85de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80873) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 17:25:35.654020 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-4cdc67c3-88ca-4ca6-9ee8-36c9275a3d17 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:25:35.654020 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-4cdc67c3-88ca-4ca6-9ee8-36c9275a3d17 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:25:35.654020 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 864/1725] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 16 17:25:35 2022] DELETE /identity/v3/projects/51b19dbc843940a09508793e3def85de => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:25:35.661419 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdc4672-b305-4d89-a76e-c50bfdd9f60e None None] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:35.661718 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdc4672-b305-4d89-a76e-c50bfdd9f60e None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:35.662062 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdc4672-b305-4d89-a76e-c50bfdd9f60e None None] PATH_INFO: `/` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:35.677037 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 865/1726] 10.222.0.39 () {54 vars in 912 bytes} [Thu Jun 16 17:25:35 2022] GET /identity => generated 270 bytes in 22 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:25:35.680454 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a34476-f545-4f18-8729-1862ec4ed75d None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:35.684396 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a34476-f545-4f18-8729-1862ec4ed75d None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:35.690512 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a34476-f545-4f18-8729-1862ec4ed75d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:35.733183 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ac3a76-542d-4539-a8b9-63ee77b86777 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d381bb41dea4f1e90c3cf3815ac88dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:35.734204 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ac3a76-542d-4539-a8b9-63ee77b86777 service nova] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:35.735918 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ac3a76-542d-4539-a8b9-63ee77b86777 service nova] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:35.735918 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ac3a76-542d-4539-a8b9-63ee77b86777 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:35.743534 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-50ac3a76-542d-4539-a8b9-63ee77b86777 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:25:35.754099 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-d1a34476-f545-4f18-8729-1862ec4ed75d None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:25:35.758234 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-d1a34476-f545-4f18-8729-1862ec4ed75d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:25:35.864755 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ac3a76-542d-4539-a8b9-63ee77b86777 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:35.866630 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ac3a76-542d-4539-a8b9-63ee77b86777 service nova] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:35.879278 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 862/1727] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:25:35 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 480 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:25:35.880887 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb915cd-b34d-4829-a7ab-0e90d353c7be None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:35.881426 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb915cd-b34d-4829-a7ab-0e90d353c7be None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:35.881871 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb915cd-b34d-4829-a7ab-0e90d353c7be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:35.898039 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 866/1728] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:25:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:25:35.898293 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5041472-d382-4f7f-9644-a8d68ab21783 None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:35.903452 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5041472-d382-4f7f-9644-a8d68ab21783 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:35.903452 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5041472-d382-4f7f-9644-a8d68ab21783 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:35.930152 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-b5041472-d382-4f7f-9644-a8d68ab21783 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:25:35.930152 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-b5041472-d382-4f7f-9644-a8d68ab21783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:25:35.932783 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-3eb915cd-b34d-4829-a7ab-0e90d353c7be None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:25:35.934697 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-3eb915cd-b34d-4829-a7ab-0e90d353c7be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:25:35.946508 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 863/1729] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:25:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:25:35.946862 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 867/1730] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:25:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:25:35.948057 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5041472-d382-4f7f-9644-a8d68ab21783 None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:35.948400 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e24cb93-5c34-4bfd-a55e-1626f15e4477 None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:35.948857 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e24cb93-5c34-4bfd-a55e-1626f15e4477 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:35.949283 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e24cb93-5c34-4bfd-a55e-1626f15e4477 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:35.949819 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-b5041472-d382-4f7f-9644-a8d68ab21783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:25:35.986888 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5041472-d382-4f7f-9644-a8d68ab21783 None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:36.003955 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6081786a-aff1-411f-8cc9-df7eecf06dc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:36.006341 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6081786a-aff1-411f-8cc9-df7eecf06dc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:36.006341 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6081786a-aff1-411f-8cc9-df7eecf06dc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:36.006341 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6081786a-aff1-411f-8cc9-df7eecf06dc5 admin admin] PATH_INFO: `/v3/projects/6e5c17f9a55f4c7392b2744ae899cb61` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:36.007362 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6081786a-aff1-411f-8cc9-df7eecf06dc5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e5c17f9a55f4c7392b2744ae899cb61)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:36.009802 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6081786a-aff1-411f-8cc9-df7eecf06dc5 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:36.021137 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-1e24cb93-5c34-4bfd-a55e-1626f15e4477 None None] MFA Rules not processed for user `b5d25bfa8dc042329d57cd55fa7b7b23`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:25:36.023357 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-1e24cb93-5c34-4bfd-a55e-1626f15e4477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:25:36.184993 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 864/1731] 10.222.0.39 () {58 vars in 1009 bytes} [Thu Jun 16 17:25:35 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:25:36.186797 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e24cb93-5c34-4bfd-a55e-1626f15e4477 None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:36.277471 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e24cb93-5c34-4bfd-a55e-1626f15e4477 None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:36.288803 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509020d6-d543-4794-81d0-fb821eef5c41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:36.289649 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509020d6-d543-4794-81d0-fb821eef5c41 admin admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:36.290901 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509020d6-d543-4794-81d0-fb821eef5c41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:36.291285 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509020d6-d543-4794-81d0-fb821eef5c41 admin admin] PATH_INFO: `/v3/domains` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:36.293164 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509020d6-d543-4794-81d0-fb821eef5c41 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:25:36.293619 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509020d6-d543-4794-81d0-fb821eef5c41 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:36.296958 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509020d6-d543-4794-81d0-fb821eef5c41 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:36.301195 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:25:36.328096 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 865/1732] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 16 17:25:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:25:36.329321 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509020d6-d543-4794-81d0-fb821eef5c41 admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:36.338383 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-6081786a-aff1-411f-8cc9-df7eecf06dc5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e5c17f9a55f4c7392b2744ae899cb61', 'request_id': 'req-6081786a-aff1-411f-8cc9-df7eecf06dc5'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:25:36.349862 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509020d6-d543-4794-81d0-fb821eef5c41 admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:36.355284 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-6081786a-aff1-411f-8cc9-df7eecf06dc5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e5c17f9a55f4c7392b2744ae899cb61', 'request_id': 'req-6081786a-aff1-411f-8cc9-df7eecf06dc5'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:25:36.362539 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-6081786a-aff1-411f-8cc9-df7eecf06dc5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e5c17f9a55f4c7392b2744ae899cb61', 'request_id': 'req-6081786a-aff1-411f-8cc9-df7eecf06dc5'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:25:36.520257 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff8973c-2ef5-48ab-ae64-e500146b3fa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:36.523471 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff8973c-2ef5-48ab-ae64-e500146b3fa1 admin admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:36.523471 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff8973c-2ef5-48ab-ae64-e500146b3fa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:36.523471 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff8973c-2ef5-48ab-ae64-e500146b3fa1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:36.531139 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff8973c-2ef5-48ab-ae64-e500146b3fa1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:25:36.531866 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff8973c-2ef5-48ab-ae64-e500146b3fa1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:36.545181 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff8973c-2ef5-48ab-ae64-e500146b3fa1 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:36.582082 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 866/1733] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 16 17:25:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:25:36.588597 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83990904-d0b8-4989-8030-cd64020e3bf1 None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:36.589210 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83990904-d0b8-4989-8030-cd64020e3bf1 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:36.589818 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83990904-d0b8-4989-8030-cd64020e3bf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:36.591113 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-6081786a-aff1-411f-8cc9-df7eecf06dc5 admin admin] The token cache is being invalidate because project 6e5c17f9a55f4c7392b2744ae899cb61 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80873) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 17:25:36.591408 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-6081786a-aff1-411f-8cc9-df7eecf06dc5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:25:36.593107 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-6081786a-aff1-411f-8cc9-df7eecf06dc5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:25:36.595867 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 868/1734] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 16 17:25:35 2022] DELETE /identity/v3/projects/6e5c17f9a55f4c7392b2744ae899cb61 => generated 0 bytes in 648 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:25:36.596707 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6081786a-aff1-411f-8cc9-df7eecf06dc5 admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:36.601780 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-6081786a-aff1-411f-8cc9-df7eecf06dc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:25:36.640684 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-83990904-d0b8-4989-8030-cd64020e3bf1 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:25:36.642068 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-83990904-d0b8-4989-8030-cd64020e3bf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:25:36.664755 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 867/1735] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:25:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:25:36.665566 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83990904-d0b8-4989-8030-cd64020e3bf1 None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:36.667158 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-83990904-d0b8-4989-8030-cd64020e3bf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:25:36.708915 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83990904-d0b8-4989-8030-cd64020e3bf1 None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:36.721383 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd363516-864d-48e4-8a43-190b9628dd68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:36.722112 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd363516-864d-48e4-8a43-190b9628dd68 admin admin] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:36.722404 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd363516-864d-48e4-8a43-190b9628dd68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:36.722742 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd363516-864d-48e4-8a43-190b9628dd68 admin admin] PATH_INFO: `/v3/projects` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:36.724093 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd363516-864d-48e4-8a43-190b9628dd68 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:36.728961 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd363516-864d-48e4-8a43-190b9628dd68 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:36.742882 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6081786a-aff1-411f-8cc9-df7eecf06dc5 admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:36.749212 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fa906f-3fd7-419f-865e-ec5f67d9b819 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5d25bfa8dc042329d57cd55fa7b7b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:36.750079 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fa906f-3fd7-419f-865e-ec5f67d9b819 service neutron] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:36.750733 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fa906f-3fd7-419f-865e-ec5f67d9b819 service neutron] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:36.751251 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fa906f-3fd7-419f-865e-ec5f67d9b819 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:36.754162 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-e7fa906f-3fd7-419f-865e-ec5f67d9b819 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:25:36.771352 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fa906f-3fd7-419f-865e-ec5f67d9b819 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:36.778910 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fa906f-3fd7-419f-865e-ec5f67d9b819 service neutron] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:36.788369 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 869/1736] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:25:36 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:25:36.789231 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fa906f-3fd7-419f-865e-ec5f67d9b819 service neutron] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:36.790631 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-e7fa906f-3fd7-419f-865e-ec5f67d9b819 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:25:36.806349 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fa906f-3fd7-419f-865e-ec5f67d9b819 service neutron] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:36.817695 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058197d6-d613-4342-8e93-57816880a9e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:36.817695 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058197d6-d613-4342-8e93-57816880a9e7 admin admin] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:36.817695 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058197d6-d613-4342-8e93-57816880a9e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:36.817695 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058197d6-d613-4342-8e93-57816880a9e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:36.818104 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058197d6-d613-4342-8e93-57816880a9e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:36.818104 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058197d6-d613-4342-8e93-57816880a9e7 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:36.885358 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 868/1737] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 16 17:25:36 2022] POST /identity/v3/projects => generated 385 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:25:36.885358 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3e6815-6909-42b6-a948-0554e1a7f8c9 None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:36.885358 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3e6815-6909-42b6-a948-0554e1a7f8c9 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:36.885358 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3e6815-6909-42b6-a948-0554e1a7f8c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:36.924072 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-1f3e6815-6909-42b6-a948-0554e1a7f8c9 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:25:36.925877 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-1f3e6815-6909-42b6-a948-0554e1a7f8c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:25:36.959361 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 870/1738] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 16 17:25:36 2022] POST /identity/v3/projects => generated 369 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:25:36.960240 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058197d6-d613-4342-8e93-57816880a9e7 admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:37.016257 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 869/1739] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:25:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:25:37.018821 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306568b6-6df6-431f-a760-1f5001a5c403 None None] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:37.019335 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306568b6-6df6-431f-a760-1f5001a5c403 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:37.019812 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306568b6-6df6-431f-a760-1f5001a5c403 None None] PATH_INFO: `/` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:37.022066 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 870/1740] 10.222.0.39 () {54 vars in 912 bytes} [Thu Jun 16 17:25:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:25:37.023048 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306568b6-6df6-431f-a760-1f5001a5c403 None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:37.109094 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058197d6-d613-4342-8e93-57816880a9e7 admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:37.118538 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306568b6-6df6-431f-a760-1f5001a5c403 None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:37.122768 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b339751c-261c-4a1c-a856-ea8b43366dd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:37.123910 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b339751c-261c-4a1c-a856-ea8b43366dd1 admin admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:37.124204 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b339751c-261c-4a1c-a856-ea8b43366dd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:37.124486 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b339751c-261c-4a1c-a856-ea8b43366dd1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:37.125242 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b339751c-261c-4a1c-a856-ea8b43366dd1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80873) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:25:37.125558 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b339751c-261c-4a1c-a856-ea8b43366dd1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:37.127392 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b339751c-261c-4a1c-a856-ea8b43366dd1 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:37.128097 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ad250b-7aad-42cd-8ed7-1ed3b4e61b0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:37.128995 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ad250b-7aad-42cd-8ed7-1ed3b4e61b0a admin admin] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:37.129477 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ad250b-7aad-42cd-8ed7-1ed3b4e61b0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:37.130027 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ad250b-7aad-42cd-8ed7-1ed3b4e61b0a admin admin] PATH_INFO: `/v3/users` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:37.131982 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ad250b-7aad-42cd-8ed7-1ed3b4e61b0a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:37.148015 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ad250b-7aad-42cd-8ed7-1ed3b4e61b0a admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:37.152258 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 871/1741] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 16 17:25:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:25:37.152258 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b339751c-261c-4a1c-a856-ea8b43366dd1 admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:37.164818 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b339751c-261c-4a1c-a856-ea8b43366dd1 admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:37.172804 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88d8139-2cf5-4de5-b27e-d1c0196ee2fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:37.173707 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88d8139-2cf5-4de5-b27e-d1c0196ee2fb admin admin] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:37.174182 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88d8139-2cf5-4de5-b27e-d1c0196ee2fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:37.174613 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88d8139-2cf5-4de5-b27e-d1c0196ee2fb admin admin] PATH_INFO: `/v3/users` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:37.175497 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88d8139-2cf5-4de5-b27e-d1c0196ee2fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:37.177613 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88d8139-2cf5-4de5-b27e-d1c0196ee2fb admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:37.295913 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 871/1742] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 16 17:25:37 2022] POST /identity/v3/users => generated 293 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:25:37.295913 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0c80cb-b6ba-4e57-befd-af678c8920f6 None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:37.295913 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0c80cb-b6ba-4e57-befd-af678c8920f6 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:37.295913 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0c80cb-b6ba-4e57-befd-af678c8920f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:37.317035 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-6e0c80cb-b6ba-4e57-befd-af678c8920f6 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:25:37.318473 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-6e0c80cb-b6ba-4e57-befd-af678c8920f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:25:37.325255 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:25:37.345268 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 872/1743] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:25:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:25:37.346625 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e35e8c2-8359-4f49-ae01-24620b13bfd1 None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:37.346943 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e35e8c2-8359-4f49-ae01-24620b13bfd1 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:37.347349 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e35e8c2-8359-4f49-ae01-24620b13bfd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:37.351441 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 872/1744] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 16 17:25:37 2022] POST /identity/v3/users => generated 285 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:25:37.352917 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88d8139-2cf5-4de5-b27e-d1c0196ee2fb admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:37.375045 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88d8139-2cf5-4de5-b27e-d1c0196ee2fb admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:37.383429 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848ed5f7-0911-48d4-a6ad-368a5e6bf293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:37.384601 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848ed5f7-0911-48d4-a6ad-368a5e6bf293 admin admin] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:37.385070 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848ed5f7-0911-48d4-a6ad-368a5e6bf293 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:37.385325 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-5e35e8c2-8359-4f49-ae01-24620b13bfd1 None None] MFA Rules not processed for user `b5d25bfa8dc042329d57cd55fa7b7b23`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:25:37.385963 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848ed5f7-0911-48d4-a6ad-368a5e6bf293 admin admin] PATH_INFO: `/v3/projects` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:37.387803 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848ed5f7-0911-48d4-a6ad-368a5e6bf293 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:37.388109 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-5e35e8c2-8359-4f49-ae01-24620b13bfd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:25:37.393780 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848ed5f7-0911-48d4-a6ad-368a5e6bf293 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:37.515437 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 873/1745] 10.222.0.39 () {58 vars in 1009 bytes} [Thu Jun 16 17:25:37 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:25:37.522193 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e35e8c2-8359-4f49-ae01-24620b13bfd1 None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:37.563037 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e35e8c2-8359-4f49-ae01-24620b13bfd1 None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:37.571733 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2415d73e-8736-48a4-b5ce-94165955d593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:37.572747 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2415d73e-8736-48a4-b5ce-94165955d593 admin admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:37.573074 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2415d73e-8736-48a4-b5ce-94165955d593 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:37.573429 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2415d73e-8736-48a4-b5ce-94165955d593 admin admin] PATH_INFO: `/v3/roles` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:37.574291 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2415d73e-8736-48a4-b5ce-94165955d593 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:37.575996 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2415d73e-8736-48a4-b5ce-94165955d593 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:37.588977 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 873/1746] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 16 17:25:37 2022] POST /identity/v3/projects => generated 377 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:25:37.590223 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848ed5f7-0911-48d4-a6ad-368a5e6bf293 admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:37.600765 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 874/1747] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 17:25:37 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:25:37.600765 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2415d73e-8736-48a4-b5ce-94165955d593 admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:37.614882 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2415d73e-8736-48a4-b5ce-94165955d593 admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:37.762135 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ddf9f6-f80d-4816-95c2-f5211810e7e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:37.763122 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ddf9f6-f80d-4816-95c2-f5211810e7e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:37.763610 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ddf9f6-f80d-4816-95c2-f5211810e7e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:37.764610 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ddf9f6-f80d-4816-95c2-f5211810e7e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:37.765505 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ddf9f6-f80d-4816-95c2-f5211810e7e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:37.769191 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ddf9f6-f80d-4816-95c2-f5211810e7e7 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:37.795315 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 875/1748] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 17:25:37 2022] GET /identity/v3/roles => generated 1420 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:25:37.796526 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ddf9f6-f80d-4816-95c2-f5211810e7e7 admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:37.807868 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-77ddf9f6-f80d-4816-95c2-f5211810e7e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:25:37.831178 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848ed5f7-0911-48d4-a6ad-368a5e6bf293 admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:37.849982 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd31a0e-93f6-4372-9b02-4921b467b8e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:37.858501 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd31a0e-93f6-4372-9b02-4921b467b8e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:37.858501 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd31a0e-93f6-4372-9b02-4921b467b8e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:37.858501 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd31a0e-93f6-4372-9b02-4921b467b8e0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:37.858501 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd31a0e-93f6-4372-9b02-4921b467b8e0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80873) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:25:37.858501 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd31a0e-93f6-4372-9b02-4921b467b8e0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:37.878689 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd31a0e-93f6-4372-9b02-4921b467b8e0 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:37.937092 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ddf9f6-f80d-4816-95c2-f5211810e7e7 admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:37.939931 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:25:37.943645 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056dffc3-8b86-4fa1-bbe5-78ea7b2c5619 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef37136b89d34edc9cd94c7aa81b2095', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:37.944396 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 874/1749] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 16 17:25:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 355 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:25:37.944506 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056dffc3-8b86-4fa1-bbe5-78ea7b2c5619 service cinder] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:37.944675 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056dffc3-8b86-4fa1-bbe5-78ea7b2c5619 service cinder] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:37.950157 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056dffc3-8b86-4fa1-bbe5-78ea7b2c5619 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:37.950379 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd31a0e-93f6-4372-9b02-4921b467b8e0 admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:37.952109 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-056dffc3-8b86-4fa1-bbe5-78ea7b2c5619 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:25:37.953429 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-9fd31a0e-93f6-4372-9b02-4921b467b8e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:25:38.077334 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd31a0e-93f6-4372-9b02-4921b467b8e0 admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:38.081322 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bd55f4-f856-4c23-94b6-11d48a8e3c5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5d25bfa8dc042329d57cd55fa7b7b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:38.082111 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bd55f4-f856-4c23-94b6-11d48a8e3c5f service neutron] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:38.082478 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bd55f4-f856-4c23-94b6-11d48a8e3c5f service neutron] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:38.082841 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bd55f4-f856-4c23-94b6-11d48a8e3c5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:38.086309 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056dffc3-8b86-4fa1-bbe5-78ea7b2c5619 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:38.088076 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056dffc3-8b86-4fa1-bbe5-78ea7b2c5619 service cinder] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:38.091001 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bd55f4-f856-4c23-94b6-11d48a8e3c5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:38.092584 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bd55f4-f856-4c23-94b6-11d48a8e3c5f service neutron] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:38.102684 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 876/1750] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:25:37 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:25:38.103212 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 875/1751] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:25:37 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:25:38.103871 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056dffc3-8b86-4fa1-bbe5-78ea7b2c5619 service cinder] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:38.104637 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bd55f4-f856-4c23-94b6-11d48a8e3c5f service neutron] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:38.114815 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056dffc3-8b86-4fa1-bbe5-78ea7b2c5619 service cinder] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:38.121359 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c3fe1e-9e3c-4c23-9e04-260daf3e2421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:38.121625 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c3fe1e-9e3c-4c23-9e04-260daf3e2421 admin admin] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:38.121940 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c3fe1e-9e3c-4c23-9e04-260daf3e2421 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:38.122227 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c3fe1e-9e3c-4c23-9e04-260daf3e2421 admin admin] PATH_INFO: `/v3/users` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:38.124157 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c3fe1e-9e3c-4c23-9e04-260daf3e2421 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:38.126451 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c3fe1e-9e3c-4c23-9e04-260daf3e2421 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:38.127405 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bd55f4-f856-4c23-94b6-11d48a8e3c5f service neutron] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:38.133150 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cd069a-19fb-408b-b763-443861f3db68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:38.134117 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cd069a-19fb-408b-b763-443861f3db68 admin admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:38.134599 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cd069a-19fb-408b-b763-443861f3db68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:38.135070 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cd069a-19fb-408b-b763-443861f3db68 admin admin] PATH_INFO: `/v3/roles` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:38.135999 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cd069a-19fb-408b-b763-443861f3db68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:38.137878 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cd069a-19fb-408b-b763-443861f3db68 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:38.149972 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 876/1752] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 17:25:38 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:25:38.151451 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cd069a-19fb-408b-b763-443861f3db68 admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:38.164816 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cd069a-19fb-408b-b763-443861f3db68 admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:38.171471 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d09a9b-b723-4510-9476-d86076453d16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:38.172444 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d09a9b-b723-4510-9476-d86076453d16 admin admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:38.172942 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d09a9b-b723-4510-9476-d86076453d16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:38.173452 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d09a9b-b723-4510-9476-d86076453d16 admin admin] PATH_INFO: `/v3/roles` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:38.174601 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d09a9b-b723-4510-9476-d86076453d16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:38.176431 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d09a9b-b723-4510-9476-d86076453d16 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:38.189368 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 877/1753] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 17:25:38 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:25:38.190541 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d09a9b-b723-4510-9476-d86076453d16 admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:38.205814 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d09a9b-b723-4510-9476-d86076453d16 admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:38.212809 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2f2a5f-e0e9-4efd-8950-92214586b150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:38.213806 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2f2a5f-e0e9-4efd-8950-92214586b150 admin admin] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:38.214550 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2f2a5f-e0e9-4efd-8950-92214586b150 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:38.215057 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2f2a5f-e0e9-4efd-8950-92214586b150 admin admin] PATH_INFO: `/v3/projects` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:38.215977 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2f2a5f-e0e9-4efd-8950-92214586b150 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:38.218327 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2f2a5f-e0e9-4efd-8950-92214586b150 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:38.284801 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 877/1754] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 16 17:25:38 2022] POST /identity/v3/users => generated 289 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:25:38.285779 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c3fe1e-9e3c-4c23-9e04-260daf3e2421 admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:38.334379 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c3fe1e-9e3c-4c23-9e04-260daf3e2421 admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:38.339648 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 878/1755] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 16 17:25:38 2022] POST /identity/v3/projects => generated 383 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:25:38.340683 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2f2a5f-e0e9-4efd-8950-92214586b150 admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:38.354446 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fadce6f-172c-4c8f-81ad-beb443c68cd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:38.373040 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fadce6f-172c-4c8f-81ad-beb443c68cd2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:38.376687 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fadce6f-172c-4c8f-81ad-beb443c68cd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:38.377023 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fadce6f-172c-4c8f-81ad-beb443c68cd2 admin admin] PATH_INFO: `/v3/projects/e7ddfccf06624ec48632b21d99b466fb/users/cd6321ef23d44ce480d0c35596af604c/roles/896bff49c5d6464eb612a15f4aa9badc` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:38.433166 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fadce6f-172c-4c8f-81ad-beb443c68cd2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7ddfccf06624ec48632b21d99b466fb, user_id=cd6321ef23d44ce480d0c35596af604c, role_id=896bff49c5d6464eb612a15f4aa9badc)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:38.439829 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fadce6f-172c-4c8f-81ad-beb443c68cd2 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:38.521333 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2f2a5f-e0e9-4efd-8950-92214586b150 admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:38.533592 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd1f97f-ec70-4cc5-895c-2ea73c9bfb28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:38.534841 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd1f97f-ec70-4cc5-895c-2ea73c9bfb28 admin admin] REQUEST_METHOD: `PUT` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:38.535374 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd1f97f-ec70-4cc5-895c-2ea73c9bfb28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:38.535525 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd1f97f-ec70-4cc5-895c-2ea73c9bfb28 admin admin] PATH_INFO: `/v3/projects/6c73974eb21e4ee698783b70aac630d2/users/b4c96c065aa5432f83ba5692424df5b4/roles/896bff49c5d6464eb612a15f4aa9badc` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:38.560110 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 878/1756] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 17:25:38 2022] PUT /identity/v3/projects/e7ddfccf06624ec48632b21d99b466fb/users/cd6321ef23d44ce480d0c35596af604c/roles/896bff49c5d6464eb612a15f4aa9badc => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:25:38.561555 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fadce6f-172c-4c8f-81ad-beb443c68cd2 admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:38.586350 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd1f97f-ec70-4cc5-895c-2ea73c9bfb28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c73974eb21e4ee698783b70aac630d2, user_id=b4c96c065aa5432f83ba5692424df5b4, role_id=896bff49c5d6464eb612a15f4aa9badc)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:38.591049 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd1f97f-ec70-4cc5-895c-2ea73c9bfb28 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:38.700411 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fadce6f-172c-4c8f-81ad-beb443c68cd2 admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:38.704896 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 879/1757] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 17:25:38 2022] PUT /identity/v3/projects/6c73974eb21e4ee698783b70aac630d2/users/b4c96c065aa5432f83ba5692424df5b4/roles/896bff49c5d6464eb612a15f4aa9badc => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:25:38.704896 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd1f97f-ec70-4cc5-895c-2ea73c9bfb28 admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:38.801977 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f10cbb3-79d2-4eeb-8004-1e1f6305fdd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:38.802932 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f10cbb3-79d2-4eeb-8004-1e1f6305fdd8 admin admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:38.804292 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f10cbb3-79d2-4eeb-8004-1e1f6305fdd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:38.806015 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f10cbb3-79d2-4eeb-8004-1e1f6305fdd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:38.806015 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f10cbb3-79d2-4eeb-8004-1e1f6305fdd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:38.811570 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f10cbb3-79d2-4eeb-8004-1e1f6305fdd8 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:38.820596 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd1f97f-ec70-4cc5-895c-2ea73c9bfb28 admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:38.826612 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e7af66-f6c0-48e6-9fff-49ee2edfe29d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:38.827498 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e7af66-f6c0-48e6-9fff-49ee2edfe29d admin admin] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:38.828068 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e7af66-f6c0-48e6-9fff-49ee2edfe29d admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:38.828703 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e7af66-f6c0-48e6-9fff-49ee2edfe29d admin admin] PATH_INFO: `/v3/users` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:38.829489 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 879/1758] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 17:25:38 2022] GET /identity/v3/roles => generated 1420 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:25:38.831294 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499cbb63-157a-45d9-b9ff-9e8e678d79b2 None None] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:38.831863 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499cbb63-157a-45d9-b9ff-9e8e678d79b2 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:38.832312 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499cbb63-157a-45d9-b9ff-9e8e678d79b2 None None] PATH_INFO: `/` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:38.833053 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e7af66-f6c0-48e6-9fff-49ee2edfe29d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:38.835631 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e7af66-f6c0-48e6-9fff-49ee2edfe29d admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:38.862318 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 880/1759] 10.222.0.39 () {54 vars in 960 bytes} [Thu Jun 16 17:25:38 2022] GET /identity => generated 270 bytes in 32 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:25:38.865318 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0554c217-9b5f-492d-948a-182d2a99c1ca None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:38.866017 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0554c217-9b5f-492d-948a-182d2a99c1ca None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:38.866417 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0554c217-9b5f-492d-948a-182d2a99c1ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:38.902650 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-0554c217-9b5f-492d-948a-182d2a99c1ca None None] MFA Rules not processed for user `cd6321ef23d44ce480d0c35596af604c`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:25:38.904094 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-0554c217-9b5f-492d-948a-182d2a99c1ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:25:38.992003 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 880/1760] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 16 17:25:38 2022] POST /identity/v3/users => generated 292 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:25:38.993273 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60201889-3f7c-4437-9237-49464a2de7de None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:38.993675 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60201889-3f7c-4437-9237-49464a2de7de None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:38.994733 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60201889-3f7c-4437-9237-49464a2de7de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:38.998945 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 881/1761] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:25:38 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:25:39.000229 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e243d314-16db-40b4-8c3b-a70610bd665d None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:39.000527 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e243d314-16db-40b4-8c3b-a70610bd665d None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:39.000805 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e243d314-16db-40b4-8c3b-a70610bd665d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:39.014614 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-60201889-3f7c-4437-9237-49464a2de7de None None] MFA Rules not processed for user `695942c4783a4d45874ff48f29ff9638`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:25:39.015885 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-60201889-3f7c-4437-9237-49464a2de7de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:25:39.029984 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-e243d314-16db-40b4-8c3b-a70610bd665d None None] MFA Rules not processed for user `b4c96c065aa5432f83ba5692424df5b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:25:39.031307 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-e243d314-16db-40b4-8c3b-a70610bd665d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:25:39.090053 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 881/1762] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:25:38 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:25:39.090053 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60201889-3f7c-4437-9237-49464a2de7de None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:39.103848 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60201889-3f7c-4437-9237-49464a2de7de None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:39.111303 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8175fa7f-9541-4398-94f6-29c53d4ac69b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:39.112007 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8175fa7f-9541-4398-94f6-29c53d4ac69b admin admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:39.112551 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8175fa7f-9541-4398-94f6-29c53d4ac69b admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:39.112551 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8175fa7f-9541-4398-94f6-29c53d4ac69b admin admin] PATH_INFO: `/v3/roles` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:39.113304 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8175fa7f-9541-4398-94f6-29c53d4ac69b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:39.115527 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8175fa7f-9541-4398-94f6-29c53d4ac69b admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:39.130487 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 882/1763] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 17:25:39 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:25:39.131940 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaa2916-1e9f-46e8-a548-c10079a1661e None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:39.132239 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaa2916-1e9f-46e8-a548-c10079a1661e None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:39.132527 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaa2916-1e9f-46e8-a548-c10079a1661e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:39.138059 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 882/1764] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:25:38 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:25:39.139647 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e243d314-16db-40b4-8c3b-a70610bd665d None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:39.141647 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-e243d314-16db-40b4-8c3b-a70610bd665d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:25:39.160199 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-0aaa2916-1e9f-46e8-a548-c10079a1661e None None] MFA Rules not processed for user `2882f26811094d8e88c03701c94296fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:25:39.161454 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-0aaa2916-1e9f-46e8-a548-c10079a1661e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:25:39.233870 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 883/1765] 10.222.0.39 () {58 vars in 1057 bytes} [Thu Jun 16 17:25:39 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:25:39.235139 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaa2916-1e9f-46e8-a548-c10079a1661e None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:39.254687 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaa2916-1e9f-46e8-a548-c10079a1661e None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:39.259667 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da5768f-1037-4bb8-9b0a-5d7c6801e07e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:39.260431 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da5768f-1037-4bb8-9b0a-5d7c6801e07e admin admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:39.260722 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da5768f-1037-4bb8-9b0a-5d7c6801e07e admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:39.261006 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da5768f-1037-4bb8-9b0a-5d7c6801e07e admin admin] PATH_INFO: `/v3/roles` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:39.261974 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da5768f-1037-4bb8-9b0a-5d7c6801e07e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:39.264952 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da5768f-1037-4bb8-9b0a-5d7c6801e07e admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:39.269386 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:25:39.280354 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 884/1766] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 17:25:39 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:25:39.284159 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da5768f-1037-4bb8-9b0a-5d7c6801e07e admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:39.296528 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da5768f-1037-4bb8-9b0a-5d7c6801e07e admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:39.305047 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e243d314-16db-40b4-8c3b-a70610bd665d None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:39.307087 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49170cb9-222a-4d26-9a3b-6ff86d61f7ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:39.307781 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49170cb9-222a-4d26-9a3b-6ff86d61f7ff admin admin] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:39.308073 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49170cb9-222a-4d26-9a3b-6ff86d61f7ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:39.308358 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49170cb9-222a-4d26-9a3b-6ff86d61f7ff admin admin] PATH_INFO: `/v3/projects` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:39.311813 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49170cb9-222a-4d26-9a3b-6ff86d61f7ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:39.311813 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49170cb9-222a-4d26-9a3b-6ff86d61f7ff admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:39.311971 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8072fa6e-a922-46ef-be8e-850739b1e0ba service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2882f26811094d8e88c03701c94296fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:39.312472 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8072fa6e-a922-46ef-be8e-850739b1e0ba service placement] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:39.312954 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8072fa6e-a922-46ef-be8e-850739b1e0ba service placement] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:39.313249 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8072fa6e-a922-46ef-be8e-850739b1e0ba service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:39.315264 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-8072fa6e-a922-46ef-be8e-850739b1e0ba service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:25:39.331253 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8072fa6e-a922-46ef-be8e-850739b1e0ba service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:39.333149 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8072fa6e-a922-46ef-be8e-850739b1e0ba service placement] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:39.346153 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 883/1767] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:25:39 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:25:39.347741 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65cafcc-3828-4712-8323-26205d476dae None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:39.348044 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65cafcc-3828-4712-8323-26205d476dae None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:39.348330 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65cafcc-3828-4712-8323-26205d476dae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:39.370784 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-b65cafcc-3828-4712-8323-26205d476dae None None] MFA Rules not processed for user `9497772835074d40b7f748507eb539b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:25:39.372256 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-b65cafcc-3828-4712-8323-26205d476dae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:25:39.431094 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 885/1768] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 16 17:25:39 2022] POST /identity/v3/projects => generated 387 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:25:39.433590 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49170cb9-222a-4d26-9a3b-6ff86d61f7ff admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:39.485172 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 884/1769] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:25:39 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:25:39.486150 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65cafcc-3828-4712-8323-26205d476dae None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:39.487973 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-b65cafcc-3828-4712-8323-26205d476dae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:25:39.590162 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49170cb9-222a-4d26-9a3b-6ff86d61f7ff admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:39.606902 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bf290a-e4a3-4110-8962-42f3a6c0baf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:39.607966 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bf290a-e4a3-4110-8962-42f3a6c0baf5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:39.608258 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bf290a-e4a3-4110-8962-42f3a6c0baf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:39.616953 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bf290a-e4a3-4110-8962-42f3a6c0baf5 admin admin] PATH_INFO: `/v3/projects/dfc352900ae746f5839a412f4758cfd7/users/5e843498d18843bd89f8f7e33b6171f3/roles/896bff49c5d6464eb612a15f4aa9badc` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:39.631274 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65cafcc-3828-4712-8323-26205d476dae None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:39.668433 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bf290a-e4a3-4110-8962-42f3a6c0baf5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dfc352900ae746f5839a412f4758cfd7, user_id=5e843498d18843bd89f8f7e33b6171f3, role_id=896bff49c5d6464eb612a15f4aa9badc)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:39.672898 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bf290a-e4a3-4110-8962-42f3a6c0baf5 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:39.679245 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:25:39.783257 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1610dde7-19b3-4bfb-84ac-2293721abd19 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d381bb41dea4f1e90c3cf3815ac88dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:39.786210 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1610dde7-19b3-4bfb-84ac-2293721abd19 service nova] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:39.786630 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1610dde7-19b3-4bfb-84ac-2293721abd19 service nova] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:39.786924 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1610dde7-19b3-4bfb-84ac-2293721abd19 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:39.837898 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 886/1770] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 17:25:39 2022] PUT /identity/v3/projects/dfc352900ae746f5839a412f4758cfd7/users/5e843498d18843bd89f8f7e33b6171f3/roles/896bff49c5d6464eb612a15f4aa9badc => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:25:39.839545 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bf290a-e4a3-4110-8962-42f3a6c0baf5 admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:39.897951 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1610dde7-19b3-4bfb-84ac-2293721abd19 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:39.902850 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1610dde7-19b3-4bfb-84ac-2293721abd19 service nova] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:39.929889 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 885/1771] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:25:39 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:25:39.931041 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1610dde7-19b3-4bfb-84ac-2293721abd19 service nova] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:39.958561 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1610dde7-19b3-4bfb-84ac-2293721abd19 service nova] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:39.978568 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bf290a-e4a3-4110-8962-42f3a6c0baf5 admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:39.987249 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e474293-d6ad-4c97-b8f6-447f1e237d90 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2882f26811094d8e88c03701c94296fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:39.988789 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e474293-d6ad-4c97-b8f6-447f1e237d90 service placement] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:39.989083 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e474293-d6ad-4c97-b8f6-447f1e237d90 service placement] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:39.989368 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e474293-d6ad-4c97-b8f6-447f1e237d90 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:40.002779 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e474293-d6ad-4c97-b8f6-447f1e237d90 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:40.005723 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e474293-d6ad-4c97-b8f6-447f1e237d90 service placement] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:40.021318 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 887/1772] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:25:39 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:25:40.022328 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e474293-d6ad-4c97-b8f6-447f1e237d90 service placement] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:40.164735 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e474293-d6ad-4c97-b8f6-447f1e237d90 service placement] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:40.168244 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71d3457-2a29-4624-99c7-4caf1ff4c274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:40.171198 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093f43cb-7301-4b9c-a973-0a6a666886e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:40.171687 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71d3457-2a29-4624-99c7-4caf1ff4c274 admin admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:40.178736 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093f43cb-7301-4b9c-a973-0a6a666886e6 admin admin] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:40.178876 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71d3457-2a29-4624-99c7-4caf1ff4c274 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:40.178876 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71d3457-2a29-4624-99c7-4caf1ff4c274 admin admin] PATH_INFO: `/v3/roles` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:40.179037 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093f43cb-7301-4b9c-a973-0a6a666886e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:40.179037 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093f43cb-7301-4b9c-a973-0a6a666886e6 admin admin] PATH_INFO: `/v3/users` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:40.179037 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093f43cb-7301-4b9c-a973-0a6a666886e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:40.179301 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71d3457-2a29-4624-99c7-4caf1ff4c274 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:40.179383 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093f43cb-7301-4b9c-a973-0a6a666886e6 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:40.182008 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71d3457-2a29-4624-99c7-4caf1ff4c274 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:40.231436 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 886/1773] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 17:25:39 2022] GET /identity/v3/roles => generated 1420 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:25:40.232142 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02170a7d-2c68-487c-99a7-d05d8b540636 None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:40.236749 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02170a7d-2c68-487c-99a7-d05d8b540636 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:40.237274 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02170a7d-2c68-487c-99a7-d05d8b540636 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:40.308228 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-02170a7d-2c68-487c-99a7-d05d8b540636 None None] MFA Rules not processed for user `5e843498d18843bd89f8f7e33b6171f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:25:40.309472 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-02170a7d-2c68-487c-99a7-d05d8b540636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:25:40.313347 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 888/1774] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 16 17:25:40 2022] POST /identity/v3/users => generated 300 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:25:40.317555 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093f43cb-7301-4b9c-a973-0a6a666886e6 admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:40.319303 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:25:40.378326 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093f43cb-7301-4b9c-a973-0a6a666886e6 admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:40.392233 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3fa5a1-bcb9-4fa3-94aa-576608c16752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:40.394428 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3fa5a1-bcb9-4fa3-94aa-576608c16752 admin admin] REQUEST_METHOD: `PUT` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:40.395396 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3fa5a1-bcb9-4fa3-94aa-576608c16752 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:40.396373 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3fa5a1-bcb9-4fa3-94aa-576608c16752 admin admin] PATH_INFO: `/v3/projects/57584dc0f3574bf3be23b89e43e3fca6/users/936f41c258a8473f858ff8640e27ed6a/roles/896bff49c5d6464eb612a15f4aa9badc` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:40.468143 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3fa5a1-bcb9-4fa3-94aa-576608c16752 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57584dc0f3574bf3be23b89e43e3fca6, user_id=936f41c258a8473f858ff8640e27ed6a, role_id=896bff49c5d6464eb612a15f4aa9badc)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:40.471053 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3fa5a1-bcb9-4fa3-94aa-576608c16752 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:40.479981 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 887/1775] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:25:40 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:25:40.481027 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02170a7d-2c68-487c-99a7-d05d8b540636 None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:40.495732 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02170a7d-2c68-487c-99a7-d05d8b540636 None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:40.501092 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1905202c-351f-4cea-917a-f3753931abc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:40.501949 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1905202c-351f-4cea-917a-f3753931abc3 admin admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:40.502315 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1905202c-351f-4cea-917a-f3753931abc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:40.502673 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1905202c-351f-4cea-917a-f3753931abc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:40.503488 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1905202c-351f-4cea-917a-f3753931abc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:40.505418 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1905202c-351f-4cea-917a-f3753931abc3 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:40.520284 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 888/1776] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 17:25:40 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:25:40.521251 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1905202c-351f-4cea-917a-f3753931abc3 admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:40.532125 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1905202c-351f-4cea-917a-f3753931abc3 admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:40.537993 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c79d45-9583-490b-83df-c77e0f8dcf1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:40.538654 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c79d45-9583-490b-83df-c77e0f8dcf1f admin admin] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:40.538939 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c79d45-9583-490b-83df-c77e0f8dcf1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:40.539237 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c79d45-9583-490b-83df-c77e0f8dcf1f admin admin] PATH_INFO: `/v3/projects` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:40.539978 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c79d45-9583-490b-83df-c77e0f8dcf1f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:40.541862 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c79d45-9583-490b-83df-c77e0f8dcf1f admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:40.578170 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 889/1777] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 17:25:40 2022] PUT /identity/v3/projects/57584dc0f3574bf3be23b89e43e3fca6/users/936f41c258a8473f858ff8640e27ed6a/roles/896bff49c5d6464eb612a15f4aa9badc => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:25:40.579254 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3fa5a1-bcb9-4fa3-94aa-576608c16752 admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:40.680893 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 889/1778] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 16 17:25:40 2022] POST /identity/v3/projects => generated 375 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:25:40.682488 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3d57cf-54fe-49f4-b0c1-b5ddf5a8addf None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:40.682853 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3d57cf-54fe-49f4-b0c1-b5ddf5a8addf None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:40.683058 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3d57cf-54fe-49f4-b0c1-b5ddf5a8addf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:40.693375 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3fa5a1-bcb9-4fa3-94aa-576608c16752 admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:40.721329 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-0a3d57cf-54fe-49f4-b0c1-b5ddf5a8addf None None] MFA Rules not processed for user `936f41c258a8473f858ff8640e27ed6a`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:25:40.722701 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-0a3d57cf-54fe-49f4-b0c1-b5ddf5a8addf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:25:40.783398 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd9bf9e-373e-447d-a6b1-192b0feb4985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:40.784623 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd9bf9e-373e-447d-a6b1-192b0feb4985 admin admin] REQUEST_METHOD: `PUT` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:40.785093 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd9bf9e-373e-447d-a6b1-192b0feb4985 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:40.785585 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd9bf9e-373e-447d-a6b1-192b0feb4985 admin admin] PATH_INFO: `/v3/projects/337fb9ab2e7948a9a556ca45efe2e588/users/76da550c4da1433c844c0e3d6c9e7811/roles/dba744f8ab2a4c45b9d3212f8d203aba` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:40.805127 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd9bf9e-373e-447d-a6b1-192b0feb4985 admin admin] RBAC: Authorizing `identity:create_grant(project_id=337fb9ab2e7948a9a556ca45efe2e588, user_id=76da550c4da1433c844c0e3d6c9e7811, role_id=dba744f8ab2a4c45b9d3212f8d203aba)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:40.809283 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd9bf9e-373e-447d-a6b1-192b0feb4985 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:40.814295 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 890/1779] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:25:40 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:25:40.814295 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3d57cf-54fe-49f4-b0c1-b5ddf5a8addf None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:40.837577 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3d57cf-54fe-49f4-b0c1-b5ddf5a8addf None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:40.843203 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f584982-5bd4-4b19-8e4c-3d39cb954e34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:40.843999 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f584982-5bd4-4b19-8e4c-3d39cb954e34 admin admin] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:40.844360 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f584982-5bd4-4b19-8e4c-3d39cb954e34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:40.844909 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f584982-5bd4-4b19-8e4c-3d39cb954e34 admin admin] PATH_INFO: `/v3/users` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:40.845628 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f584982-5bd4-4b19-8e4c-3d39cb954e34 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:40.847615 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f584982-5bd4-4b19-8e4c-3d39cb954e34 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:40.935260 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 891/1780] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 16 17:25:40 2022] POST /identity/v3/users => generated 294 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:25:40.936465 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 890/1781] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 17:25:40 2022] PUT /identity/v3/projects/337fb9ab2e7948a9a556ca45efe2e588/users/76da550c4da1433c844c0e3d6c9e7811/roles/dba744f8ab2a4c45b9d3212f8d203aba => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:25:40.940124 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd9bf9e-373e-447d-a6b1-192b0feb4985 admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:40.941031 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f584982-5bd4-4b19-8e4c-3d39cb954e34 admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:40.966933 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f584982-5bd4-4b19-8e4c-3d39cb954e34 admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:41.037319 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:25:41.081459 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd9bf9e-373e-447d-a6b1-192b0feb4985 admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:41.092830 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05c5b38-d349-4006-af2d-23d9a005ea4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:41.093748 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05c5b38-d349-4006-af2d-23d9a005ea4d admin admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:41.093915 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fefa4f-3994-4920-9f8a-a243d9d76dc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:41.094396 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05c5b38-d349-4006-af2d-23d9a005ea4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:41.094833 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05c5b38-d349-4006-af2d-23d9a005ea4d admin admin] PATH_INFO: `/v3/roles` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:41.095273 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fefa4f-3994-4920-9f8a-a243d9d76dc9 admin admin] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:41.095646 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fefa4f-3994-4920-9f8a-a243d9d76dc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:41.096033 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fefa4f-3994-4920-9f8a-a243d9d76dc9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:41.097045 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fefa4f-3994-4920-9f8a-a243d9d76dc9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:41.101558 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fefa4f-3994-4920-9f8a-a243d9d76dc9 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:41.109085 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05c5b38-d349-4006-af2d-23d9a005ea4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:41.114904 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05c5b38-d349-4006-af2d-23d9a005ea4d admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:41.135174 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 891/1782] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 17:25:40 2022] GET /identity/v3/roles => generated 1420 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:25:41.135174 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05c5b38-d349-4006-af2d-23d9a005ea4d admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:41.147018 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05c5b38-d349-4006-af2d-23d9a005ea4d admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:41.152426 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833cff78-5727-46cd-8d94-c1c3c4559aff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:41.153212 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833cff78-5727-46cd-8d94-c1c3c4559aff admin admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:41.153581 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833cff78-5727-46cd-8d94-c1c3c4559aff admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:41.153979 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833cff78-5727-46cd-8d94-c1c3c4559aff admin admin] PATH_INFO: `/v3/roles` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:41.154827 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833cff78-5727-46cd-8d94-c1c3c4559aff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:41.156524 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833cff78-5727-46cd-8d94-c1c3c4559aff admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:41.173418 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 892/1783] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 17:25:41 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:25:41.173418 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833cff78-5727-46cd-8d94-c1c3c4559aff admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:41.182352 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833cff78-5727-46cd-8d94-c1c3c4559aff admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:41.205077 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba22bf9-01fa-4ccb-a500-ea01deb6f1d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:41.206213 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba22bf9-01fa-4ccb-a500-ea01deb6f1d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:41.206564 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba22bf9-01fa-4ccb-a500-ea01deb6f1d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:41.206857 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba22bf9-01fa-4ccb-a500-ea01deb6f1d1 admin admin] PATH_INFO: `/v3/projects/449133e6eed54cb6abb36b796f6a8302/users/b83e9e3946bd4fe6b14fa5d3eadd01e2/roles/dba744f8ab2a4c45b9d3212f8d203aba` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:41.224295 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba22bf9-01fa-4ccb-a500-ea01deb6f1d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=449133e6eed54cb6abb36b796f6a8302, user_id=b83e9e3946bd4fe6b14fa5d3eadd01e2, role_id=dba744f8ab2a4c45b9d3212f8d203aba)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:41.235724 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba22bf9-01fa-4ccb-a500-ea01deb6f1d1 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:41.237148 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 892/1784] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 16 17:25:40 2022] POST /identity/v3/projects => generated 385 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:25:41.238689 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fefa4f-3994-4920-9f8a-a243d9d76dc9 admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:41.315119 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fefa4f-3994-4920-9f8a-a243d9d76dc9 admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:41.320036 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21a5db9-94d0-48c9-b7db-b6caaa004220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:41.320894 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21a5db9-94d0-48c9-b7db-b6caaa004220 admin admin] REQUEST_METHOD: `PUT` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:41.321184 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21a5db9-94d0-48c9-b7db-b6caaa004220 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:41.321478 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21a5db9-94d0-48c9-b7db-b6caaa004220 admin admin] PATH_INFO: `/v3/projects/337fb9ab2e7948a9a556ca45efe2e588/users/76da550c4da1433c844c0e3d6c9e7811/roles/dba744f8ab2a4c45b9d3212f8d203aba` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:41.323642 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21a5db9-94d0-48c9-b7db-b6caaa004220 admin admin] RBAC: Authorizing `identity:create_grant(project_id=337fb9ab2e7948a9a556ca45efe2e588, user_id=76da550c4da1433c844c0e3d6c9e7811, role_id=dba744f8ab2a4c45b9d3212f8d203aba)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:41.326692 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21a5db9-94d0-48c9-b7db-b6caaa004220 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:41.356854 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 893/1785] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 17:25:41 2022] PUT /identity/v3/projects/449133e6eed54cb6abb36b796f6a8302/users/b83e9e3946bd4fe6b14fa5d3eadd01e2/roles/dba744f8ab2a4c45b9d3212f8d203aba => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:25:41.356854 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba22bf9-01fa-4ccb-a500-ea01deb6f1d1 admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:41.372105 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 893/1786] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 17:25:41 2022] PUT /identity/v3/projects/337fb9ab2e7948a9a556ca45efe2e588/users/76da550c4da1433c844c0e3d6c9e7811/roles/dba744f8ab2a4c45b9d3212f8d203aba => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:25:41.375405 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21a5db9-94d0-48c9-b7db-b6caaa004220 admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:41.456563 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21a5db9-94d0-48c9-b7db-b6caaa004220 admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:41.466445 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba22bf9-01fa-4ccb-a500-ea01deb6f1d1 admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:41.466758 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeab182a-60d6-4619-88b8-cb66e7fa899e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:41.467617 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeab182a-60d6-4619-88b8-cb66e7fa899e admin admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:41.468117 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeab182a-60d6-4619-88b8-cb66e7fa899e admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:41.468547 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeab182a-60d6-4619-88b8-cb66e7fa899e admin admin] PATH_INFO: `/v3/roles` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:41.469622 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeab182a-60d6-4619-88b8-cb66e7fa899e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:41.471574 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeab182a-60d6-4619-88b8-cb66e7fa899e admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:41.472927 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8e831b-ec90-47af-822b-a69f17858506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:41.474914 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8e831b-ec90-47af-822b-a69f17858506 admin admin] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:41.475328 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8e831b-ec90-47af-822b-a69f17858506 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:41.475794 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8e831b-ec90-47af-822b-a69f17858506 admin admin] PATH_INFO: `/v3/users` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:41.476607 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8e831b-ec90-47af-822b-a69f17858506 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:41.478736 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8e831b-ec90-47af-822b-a69f17858506 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:41.489043 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 894/1787] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 17:25:41 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:25:41.490728 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2553cb5-429e-4983-9d76-5d975adac983 None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:41.491343 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2553cb5-429e-4983-9d76-5d975adac983 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:41.491799 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2553cb5-429e-4983-9d76-5d975adac983 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:41.534844 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-a2553cb5-429e-4983-9d76-5d975adac983 None None] MFA Rules not processed for user `76da550c4da1433c844c0e3d6c9e7811`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:25:41.537115 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-a2553cb5-429e-4983-9d76-5d975adac983 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:25:41.645695 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 895/1788] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:25:41 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:25:41.646681 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2553cb5-429e-4983-9d76-5d975adac983 None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:41.666592 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2553cb5-429e-4983-9d76-5d975adac983 None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:41.671113 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc13b79a-e840-4f66-a84d-d49e3c4b7d7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:41.672101 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc13b79a-e840-4f66-a84d-d49e3c4b7d7c admin admin] REQUEST_METHOD: `PUT` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:41.672453 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc13b79a-e840-4f66-a84d-d49e3c4b7d7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:41.672807 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc13b79a-e840-4f66-a84d-d49e3c4b7d7c admin admin] PATH_INFO: `/v3/projects/449133e6eed54cb6abb36b796f6a8302/users/b83e9e3946bd4fe6b14fa5d3eadd01e2/roles/dba744f8ab2a4c45b9d3212f8d203aba` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:41.675464 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 894/1789] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 16 17:25:41 2022] POST /identity/v3/users => generated 299 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:25:41.676230 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8e831b-ec90-47af-822b-a69f17858506 admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:41.678534 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-8e8e831b-ec90-47af-822b-a69f17858506 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:25:41.684048 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc13b79a-e840-4f66-a84d-d49e3c4b7d7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=449133e6eed54cb6abb36b796f6a8302, user_id=b83e9e3946bd4fe6b14fa5d3eadd01e2, role_id=dba744f8ab2a4c45b9d3212f8d203aba)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:41.689888 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc13b79a-e840-4f66-a84d-d49e3c4b7d7c admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:41.721275 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 896/1790] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 17:25:41 2022] PUT /identity/v3/projects/449133e6eed54cb6abb36b796f6a8302/users/b83e9e3946bd4fe6b14fa5d3eadd01e2/roles/dba744f8ab2a4c45b9d3212f8d203aba => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:25:41.729272 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc13b79a-e840-4f66-a84d-d49e3c4b7d7c admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:41.798820 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8e831b-ec90-47af-822b-a69f17858506 admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:41.877002 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc13b79a-e840-4f66-a84d-d49e3c4b7d7c admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:41.894663 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7195a64-57c1-478a-b5df-b85cc14c4b92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:41.896777 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7195a64-57c1-478a-b5df-b85cc14c4b92 admin admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:41.899037 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7195a64-57c1-478a-b5df-b85cc14c4b92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:41.900390 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7195a64-57c1-478a-b5df-b85cc14c4b92 admin admin] PATH_INFO: `/v3/roles` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:41.903861 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7195a64-57c1-478a-b5df-b85cc14c4b92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:41.911440 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7195a64-57c1-478a-b5df-b85cc14c4b92 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:41.912909 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec6e624-e59f-4eb7-a3cc-f63f8d09db04 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef37136b89d34edc9cd94c7aa81b2095', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:41.913714 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec6e624-e59f-4eb7-a3cc-f63f8d09db04 service cinder] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:41.914044 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec6e624-e59f-4eb7-a3cc-f63f8d09db04 service cinder] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:41.914729 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec6e624-e59f-4eb7-a3cc-f63f8d09db04 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:41.954314 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 897/1791] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 17:25:41 2022] GET /identity/v3/roles => generated 1420 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:25:41.955936 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c194eaa9-4f08-4fe9-9c42-a1a3f2ec9c98 None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:41.956163 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c194eaa9-4f08-4fe9-9c42-a1a3f2ec9c98 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:41.956394 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c194eaa9-4f08-4fe9-9c42-a1a3f2ec9c98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:42.008265 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-c194eaa9-4f08-4fe9-9c42-a1a3f2ec9c98 None None] MFA Rules not processed for user `b83e9e3946bd4fe6b14fa5d3eadd01e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:25:42.009791 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-c194eaa9-4f08-4fe9-9c42-a1a3f2ec9c98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:25:42.088053 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec6e624-e59f-4eb7-a3cc-f63f8d09db04 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:42.089681 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec6e624-e59f-4eb7-a3cc-f63f8d09db04 service cinder] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:42.107898 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 895/1792] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:25:41 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:25:42.107898 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec6e624-e59f-4eb7-a3cc-f63f8d09db04 service cinder] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:42.120693 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 898/1793] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:25:41 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:25:42.121784 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec6e624-e59f-4eb7-a3cc-f63f8d09db04 service cinder] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:42.126712 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d28f02d-d347-48b7-9f62-27a5414a726a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:42.127688 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d28f02d-d347-48b7-9f62-27a5414a726a admin admin] REQUEST_METHOD: `PUT` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:42.127888 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d28f02d-d347-48b7-9f62-27a5414a726a admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:42.128174 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d28f02d-d347-48b7-9f62-27a5414a726a admin admin] PATH_INFO: `/v3/projects/92db484c6df7471caa4640cfc6f29bce/users/e29f5efba5714c85995cd80a479435e0/roles/dba744f8ab2a4c45b9d3212f8d203aba` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:42.146282 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d28f02d-d347-48b7-9f62-27a5414a726a admin admin] RBAC: Authorizing `identity:create_grant(project_id=92db484c6df7471caa4640cfc6f29bce, user_id=e29f5efba5714c85995cd80a479435e0, role_id=dba744f8ab2a4c45b9d3212f8d203aba)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:42.149021 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d28f02d-d347-48b7-9f62-27a5414a726a admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:42.272365 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 896/1794] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 17:25:42 2022] PUT /identity/v3/projects/92db484c6df7471caa4640cfc6f29bce/users/e29f5efba5714c85995cd80a479435e0/roles/dba744f8ab2a4c45b9d3212f8d203aba => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:25:42.284038 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c194eaa9-4f08-4fe9-9c42-a1a3f2ec9c98 None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:42.291149 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d28f02d-d347-48b7-9f62-27a5414a726a admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:42.309480 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c194eaa9-4f08-4fe9-9c42-a1a3f2ec9c98 None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:42.376664 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d28f02d-d347-48b7-9f62-27a5414a726a admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:42.381385 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6314f0ac-a1dd-4d0e-a83c-4de30ca4786d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:42.382122 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6314f0ac-a1dd-4d0e-a83c-4de30ca4786d admin admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:42.382420 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6314f0ac-a1dd-4d0e-a83c-4de30ca4786d admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:42.382697 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6314f0ac-a1dd-4d0e-a83c-4de30ca4786d admin admin] PATH_INFO: `/v3/roles` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:42.383292 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ba401e-985b-4e79-a237-54eed40918ce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef37136b89d34edc9cd94c7aa81b2095', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:42.383444 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6314f0ac-a1dd-4d0e-a83c-4de30ca4786d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:42.385051 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6314f0ac-a1dd-4d0e-a83c-4de30ca4786d admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:42.385162 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ba401e-985b-4e79-a237-54eed40918ce service cinder] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:42.385369 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ba401e-985b-4e79-a237-54eed40918ce service cinder] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:42.385839 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ba401e-985b-4e79-a237-54eed40918ce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:42.397936 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 899/1795] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 17:25:42 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:25:42.412030 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6314f0ac-a1dd-4d0e-a83c-4de30ca4786d admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:42.423770 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6314f0ac-a1dd-4d0e-a83c-4de30ca4786d admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:42.440212 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba164cc2-0019-4d4e-98e4-004e2b2ea6fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:42.441195 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba164cc2-0019-4d4e-98e4-004e2b2ea6fe admin admin] REQUEST_METHOD: `PUT` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:42.441480 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba164cc2-0019-4d4e-98e4-004e2b2ea6fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:42.441791 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba164cc2-0019-4d4e-98e4-004e2b2ea6fe admin admin] PATH_INFO: `/v3/projects/92db484c6df7471caa4640cfc6f29bce/users/e29f5efba5714c85995cd80a479435e0/roles/dba744f8ab2a4c45b9d3212f8d203aba` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:42.444182 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba164cc2-0019-4d4e-98e4-004e2b2ea6fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=92db484c6df7471caa4640cfc6f29bce, user_id=e29f5efba5714c85995cd80a479435e0, role_id=dba744f8ab2a4c45b9d3212f8d203aba)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:42.447399 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba164cc2-0019-4d4e-98e4-004e2b2ea6fe admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:42.452392 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ba401e-985b-4e79-a237-54eed40918ce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:42.453906 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ba401e-985b-4e79-a237-54eed40918ce service cinder] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:42.467457 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 900/1796] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 17:25:42 2022] PUT /identity/v3/projects/92db484c6df7471caa4640cfc6f29bce/users/e29f5efba5714c85995cd80a479435e0/roles/dba744f8ab2a4c45b9d3212f8d203aba => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:25:42.472329 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 897/1797] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:25:42 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:25:42.479644 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785a0daf-fdf4-4f60-8428-f3588a5b3ca3 None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:42.479871 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785a0daf-fdf4-4f60-8428-f3588a5b3ca3 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:42.480153 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785a0daf-fdf4-4f60-8428-f3588a5b3ca3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:42.520364 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-785a0daf-fdf4-4f60-8428-f3588a5b3ca3 None None] MFA Rules not processed for user `e29f5efba5714c85995cd80a479435e0`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:25:42.523795 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-785a0daf-fdf4-4f60-8428-f3588a5b3ca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:25:42.697036 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 901/1798] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:25:42 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 17:25:42.784559 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:25:42.814234 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ba401e-985b-4e79-a237-54eed40918ce service cinder] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:42.836948 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ba401e-985b-4e79-a237-54eed40918ce service cinder] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:42.921732 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0a3d35-cb80-42ed-9d48-9f80242df7c1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef37136b89d34edc9cd94c7aa81b2095', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:42.923159 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0a3d35-cb80-42ed-9d48-9f80242df7c1 service cinder] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:42.923817 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0a3d35-cb80-42ed-9d48-9f80242df7c1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:42.925536 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0a3d35-cb80-42ed-9d48-9f80242df7c1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:43.005963 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0a3d35-cb80-42ed-9d48-9f80242df7c1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:43.008386 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0a3d35-cb80-42ed-9d48-9f80242df7c1 service cinder] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:43.022764 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 898/1799] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:25:42 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:25:44.013524 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785a0daf-fdf4-4f60-8428-f3588a5b3ca3 None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:44.015008 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-785a0daf-fdf4-4f60-8428-f3588a5b3ca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:25:44.110404 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785a0daf-fdf4-4f60-8428-f3588a5b3ca3 None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:44.123293 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00c75b7-20ed-41d6-8ea0-2ea775610df3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:44.140903 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00c75b7-20ed-41d6-8ea0-2ea775610df3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:44.146201 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00c75b7-20ed-41d6-8ea0-2ea775610df3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:44.151000 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00c75b7-20ed-41d6-8ea0-2ea775610df3 admin admin] PATH_INFO: `/v3/users/b3873e69b8544aa4b75444253687c879` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:44.155758 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00c75b7-20ed-41d6-8ea0-2ea775610df3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3873e69b8544aa4b75444253687c879)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:44.164089 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00c75b7-20ed-41d6-8ea0-2ea775610df3 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:44.535220 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-b00c75b7-20ed-41d6-8ea0-2ea775610df3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3873e69b8544aa4b75444253687c879'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:25:44.580793 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-b00c75b7-20ed-41d6-8ea0-2ea775610df3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3873e69b8544aa4b75444253687c879'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:25:44.614107 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0490762a-7b9a-459f-b694-4501782b985f None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:44.614954 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0490762a-7b9a-459f-b694-4501782b985f None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:44.615536 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0490762a-7b9a-459f-b694-4501782b985f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:44.645041 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-0490762a-7b9a-459f-b694-4501782b985f None None] MFA Rules not processed for user `f7f35c1c15a84a92863d4f3f96d76830`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:25:44.646320 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-0490762a-7b9a-459f-b694-4501782b985f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:25:44.659153 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-b00c75b7-20ed-41d6-8ea0-2ea775610df3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3873e69b8544aa4b75444253687c879'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:25:44.659153 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-b00c75b7-20ed-41d6-8ea0-2ea775610df3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3873e69b8544aa4b75444253687c879'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:25:44.691756 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-b00c75b7-20ed-41d6-8ea0-2ea775610df3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3873e69b8544aa4b75444253687c879'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:25:44.714821 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 902/1800] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 16 17:25:44 2022] DELETE /identity/v3/users/b3873e69b8544aa4b75444253687c879 => generated 0 bytes in 702 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:25:44.719965 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eb8f0f-cbb9-4a69-940a-8ab9d90bcb2a None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:44.720265 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eb8f0f-cbb9-4a69-940a-8ab9d90bcb2a None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:44.720639 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eb8f0f-cbb9-4a69-940a-8ab9d90bcb2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:44.734453 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 899/1801] 10.222.0.39 () {58 vars in 1009 bytes} [Thu Jun 16 17:25:44 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:25:44.754216 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-42eb8f0f-cbb9-4a69-940a-8ab9d90bcb2a None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:25:44.755901 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-42eb8f0f-cbb9-4a69-940a-8ab9d90bcb2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:25:44.837083 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 903/1802] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:25:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:25:44.848231 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0490762a-7b9a-459f-b694-4501782b985f None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:44.849885 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-0490762a-7b9a-459f-b694-4501782b985f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:25:44.869042 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42eb8f0f-cbb9-4a69-940a-8ab9d90bcb2a None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:44.870579 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-42eb8f0f-cbb9-4a69-940a-8ab9d90bcb2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:25:44.892659 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42eb8f0f-cbb9-4a69-940a-8ab9d90bcb2a None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:44.904369 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc525574-cbe7-4a55-949d-5f49a669fa85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:44.905550 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc525574-cbe7-4a55-949d-5f49a669fa85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:44.906421 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc525574-cbe7-4a55-949d-5f49a669fa85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:44.906421 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc525574-cbe7-4a55-949d-5f49a669fa85 admin admin] PATH_INFO: `/v3/users/cd6321ef23d44ce480d0c35596af604c` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:44.907633 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc525574-cbe7-4a55-949d-5f49a669fa85 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd6321ef23d44ce480d0c35596af604c)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:44.911240 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc525574-cbe7-4a55-949d-5f49a669fa85 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:44.964192 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0490762a-7b9a-459f-b694-4501782b985f None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:45.096755 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cb8f74-6ddb-47d0-b8c4-76afc55ab56a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5d25bfa8dc042329d57cd55fa7b7b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:45.097429 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cb8f74-6ddb-47d0-b8c4-76afc55ab56a service neutron] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:45.097725 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cb8f74-6ddb-47d0-b8c4-76afc55ab56a service neutron] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:45.098050 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cb8f74-6ddb-47d0-b8c4-76afc55ab56a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:45.109254 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cb8f74-6ddb-47d0-b8c4-76afc55ab56a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:45.110764 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cb8f74-6ddb-47d0-b8c4-76afc55ab56a service neutron] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:45.121809 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 900/1803] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:25:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:25:45.323837 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cb8f74-6ddb-47d0-b8c4-76afc55ab56a service neutron] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:45.325349 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-f6cb8f74-6ddb-47d0-b8c4-76afc55ab56a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:25:45.400047 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-cc525574-cbe7-4a55-949d-5f49a669fa85 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd6321ef23d44ce480d0c35596af604c'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:25:45.424851 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-cc525574-cbe7-4a55-949d-5f49a669fa85 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd6321ef23d44ce480d0c35596af604c'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:25:45.512936 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:25:45.548874 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cb8f74-6ddb-47d0-b8c4-76afc55ab56a service neutron] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:45.561694 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bc818b-55cb-452b-89fd-d229eaf08b08 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbec2dfe63764ed88a23e172ead0afa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:45.562469 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bc818b-55cb-452b-89fd-d229eaf08b08 service swift] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:45.562762 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bc818b-55cb-452b-89fd-d229eaf08b08 service swift] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:45.563048 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bc818b-55cb-452b-89fd-d229eaf08b08 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:45.586633 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-cc525574-cbe7-4a55-949d-5f49a669fa85 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd6321ef23d44ce480d0c35596af604c'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:25:45.587491 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-cc525574-cbe7-4a55-949d-5f49a669fa85 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd6321ef23d44ce480d0c35596af604c'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:25:45.610731 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-cc525574-cbe7-4a55-949d-5f49a669fa85 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd6321ef23d44ce480d0c35596af604c'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:25:45.621560 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 904/1804] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 16 17:25:44 2022] DELETE /identity/v3/users/cd6321ef23d44ce480d0c35596af604c => generated 0 bytes in 753 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:25:45.622281 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc525574-cbe7-4a55-949d-5f49a669fa85 admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:45.625436 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-cc525574-cbe7-4a55-949d-5f49a669fa85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:25:45.662444 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bc818b-55cb-452b-89fd-d229eaf08b08 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:45.664778 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bc818b-55cb-452b-89fd-d229eaf08b08 service swift] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:45.690352 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 901/1805] 10.222.0.39 () {60 vars in 1384 bytes} [Thu Jun 16 17:25:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 17:25:45.690352 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec32e0b-9fbe-4d2f-8c34-2e12023b6a01 None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:45.690352 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec32e0b-9fbe-4d2f-8c34-2e12023b6a01 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:45.690352 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec32e0b-9fbe-4d2f-8c34-2e12023b6a01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:45.704168 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-6ec32e0b-9fbe-4d2f-8c34-2e12023b6a01 None None] MFA Rules not processed for user `b5d25bfa8dc042329d57cd55fa7b7b23`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:25:45.705923 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-6ec32e0b-9fbe-4d2f-8c34-2e12023b6a01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:25:45.867413 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc525574-cbe7-4a55-949d-5f49a669fa85 admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:45.902029 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482accdf-29e8-4699-99c2-5b532d538962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:45.904625 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482accdf-29e8-4699-99c2-5b532d538962 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:45.905086 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482accdf-29e8-4699-99c2-5b532d538962 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:45.905363 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 902/1806] 10.222.0.86 () {58 vars in 1015 bytes} [Thu Jun 16 17:25:45 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:25:45.905903 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482accdf-29e8-4699-99c2-5b532d538962 admin admin] PATH_INFO: `/v3/users/b4c96c065aa5432f83ba5692424df5b4` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:45.907089 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f444e71-018e-4915-a26e-fc4e7a1ffc07 None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:45.907494 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f444e71-018e-4915-a26e-fc4e7a1ffc07 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:45.907792 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f444e71-018e-4915-a26e-fc4e7a1ffc07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:45.908586 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482accdf-29e8-4699-99c2-5b532d538962 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4c96c065aa5432f83ba5692424df5b4)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:45.915603 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482accdf-29e8-4699-99c2-5b532d538962 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:46.179487 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-0f444e71-018e-4915-a26e-fc4e7a1ffc07 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:25:46.183364 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-0f444e71-018e-4915-a26e-fc4e7a1ffc07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:25:46.221849 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 903/1807] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:25:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:25:46.228148 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f444e71-018e-4915-a26e-fc4e7a1ffc07 None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:46.245153 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-0f444e71-018e-4915-a26e-fc4e7a1ffc07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:25:46.248064 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-482accdf-29e8-4699-99c2-5b532d538962 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4c96c065aa5432f83ba5692424df5b4'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:25:46.275323 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f444e71-018e-4915-a26e-fc4e7a1ffc07 None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:46.284248 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-482accdf-29e8-4699-99c2-5b532d538962 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4c96c065aa5432f83ba5692424df5b4'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:25:46.286491 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823081a4-89b8-4bac-bef7-985243c9b243 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5d25bfa8dc042329d57cd55fa7b7b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:46.287346 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823081a4-89b8-4bac-bef7-985243c9b243 service neutron] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:46.291065 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823081a4-89b8-4bac-bef7-985243c9b243 service neutron] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:46.291616 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823081a4-89b8-4bac-bef7-985243c9b243 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:46.308497 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823081a4-89b8-4bac-bef7-985243c9b243 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:46.320819 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823081a4-89b8-4bac-bef7-985243c9b243 service neutron] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:46.331333 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 904/1808] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:25:46 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:25:46.332258 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823081a4-89b8-4bac-bef7-985243c9b243 service neutron] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:46.337820 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-823081a4-89b8-4bac-bef7-985243c9b243 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:25:46.355348 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823081a4-89b8-4bac-bef7-985243c9b243 service neutron] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:46.368791 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4629086-079d-44f8-a762-83f76e52f15e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5d25bfa8dc042329d57cd55fa7b7b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:46.370397 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4629086-079d-44f8-a762-83f76e52f15e service neutron] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:46.373637 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4629086-079d-44f8-a762-83f76e52f15e service neutron] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:46.374593 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4629086-079d-44f8-a762-83f76e52f15e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:46.390595 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4629086-079d-44f8-a762-83f76e52f15e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:46.395941 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4629086-079d-44f8-a762-83f76e52f15e service neutron] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:46.426520 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 905/1809] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:25:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:25:46.428551 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-482accdf-29e8-4699-99c2-5b532d538962 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4c96c065aa5432f83ba5692424df5b4'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:25:46.431936 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-482accdf-29e8-4699-99c2-5b532d538962 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4c96c065aa5432f83ba5692424df5b4'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:25:46.456300 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-482accdf-29e8-4699-99c2-5b532d538962 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4c96c065aa5432f83ba5692424df5b4'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:25:46.473855 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 905/1810] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 16 17:25:45 2022] DELETE /identity/v3/users/b4c96c065aa5432f83ba5692424df5b4 => generated 0 bytes in 852 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:25:46.479315 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c342f493-6593-490b-b06a-a4a31e2ab3a8 None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:46.479833 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c342f493-6593-490b-b06a-a4a31e2ab3a8 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:46.480298 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c342f493-6593-490b-b06a-a4a31e2ab3a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:46.519308 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-c342f493-6593-490b-b06a-a4a31e2ab3a8 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:25:46.520716 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-c342f493-6593-490b-b06a-a4a31e2ab3a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:25:46.748326 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 906/1811] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:25:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:25:46.757100 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482accdf-29e8-4699-99c2-5b532d538962 admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:46.759452 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-482accdf-29e8-4699-99c2-5b532d538962 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:25:46.904105 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482accdf-29e8-4699-99c2-5b532d538962 admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:46.913947 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c934831-8e4d-4917-9b50-309fcc8a5dd6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5d25bfa8dc042329d57cd55fa7b7b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:46.914633 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c934831-8e4d-4917-9b50-309fcc8a5dd6 service neutron] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:46.914926 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c934831-8e4d-4917-9b50-309fcc8a5dd6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:46.915204 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c934831-8e4d-4917-9b50-309fcc8a5dd6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:46.942059 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c934831-8e4d-4917-9b50-309fcc8a5dd6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:46.944496 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c934831-8e4d-4917-9b50-309fcc8a5dd6 service neutron] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:47.270432 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 906/1812] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:25:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:25:47.274026 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c342f493-6593-490b-b06a-a4a31e2ab3a8 None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:47.274026 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-c342f493-6593-490b-b06a-a4a31e2ab3a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:25:47.358903 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c342f493-6593-490b-b06a-a4a31e2ab3a8 None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:47.363746 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663b784c-5641-42f8-83ea-852e6d44922c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef37136b89d34edc9cd94c7aa81b2095', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:47.365138 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663b784c-5641-42f8-83ea-852e6d44922c service cinder] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:47.378299 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663b784c-5641-42f8-83ea-852e6d44922c service cinder] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:47.378957 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663b784c-5641-42f8-83ea-852e6d44922c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:47.381877 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-663b784c-5641-42f8-83ea-852e6d44922c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:25:47.495240 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663b784c-5641-42f8-83ea-852e6d44922c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:47.498204 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663b784c-5641-42f8-83ea-852e6d44922c service cinder] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:47.538652 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 907/1813] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:25:47 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:25:50.312774 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:25:50.459266 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c934831-8e4d-4917-9b50-309fcc8a5dd6 service neutron] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:50.460815 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-2c934831-8e4d-4917-9b50-309fcc8a5dd6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:25:50.491747 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c934831-8e4d-4917-9b50-309fcc8a5dd6 service neutron] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:50.503607 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97439b7-5086-47e0-9b72-694bf9d226ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:50.510944 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97439b7-5086-47e0-9b72-694bf9d226ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:50.510944 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97439b7-5086-47e0-9b72-694bf9d226ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:50.510944 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97439b7-5086-47e0-9b72-694bf9d226ae admin admin] PATH_INFO: `/v3/projects/e8ed5a4c99424bfda8102da1dabde57e` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:50.510944 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97439b7-5086-47e0-9b72-694bf9d226ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8ed5a4c99424bfda8102da1dabde57e)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:50.510944 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97439b7-5086-47e0-9b72-694bf9d226ae admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:50.840918 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663b784c-5641-42f8-83ea-852e6d44922c service cinder] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:50.844673 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-d97439b7-5086-47e0-9b72-694bf9d226ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8ed5a4c99424bfda8102da1dabde57e', 'request_id': 'req-d97439b7-5086-47e0-9b72-694bf9d226ae'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:25:50.852978 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-663b784c-5641-42f8-83ea-852e6d44922c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:25:50.863073 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-d97439b7-5086-47e0-9b72-694bf9d226ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8ed5a4c99424bfda8102da1dabde57e', 'request_id': 'req-d97439b7-5086-47e0-9b72-694bf9d226ae'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:25:50.912421 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663b784c-5641-42f8-83ea-852e6d44922c service cinder] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:50.958487 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-d97439b7-5086-47e0-9b72-694bf9d226ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8ed5a4c99424bfda8102da1dabde57e', 'request_id': 'req-d97439b7-5086-47e0-9b72-694bf9d226ae'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:25:51.015762 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-d97439b7-5086-47e0-9b72-694bf9d226ae admin admin] The token cache is being invalidate because project e8ed5a4c99424bfda8102da1dabde57e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80874) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 17:25:51.016079 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-d97439b7-5086-47e0-9b72-694bf9d226ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:25:51.019369 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-d97439b7-5086-47e0-9b72-694bf9d226ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:25:51.032092 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 907/1814] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 16 17:25:50 2022] DELETE /identity/v3/projects/e8ed5a4c99424bfda8102da1dabde57e => generated 0 bytes in 568 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 17:25:51.033111 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97439b7-5086-47e0-9b72-694bf9d226ae admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:51.039427 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-d97439b7-5086-47e0-9b72-694bf9d226ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:25:51.107261 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd75d6eb-1aeb-4f39-89fa-f4767f863526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:51.124768 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd75d6eb-1aeb-4f39-89fa-f4767f863526 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:51.124768 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd75d6eb-1aeb-4f39-89fa-f4767f863526 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:51.124768 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd75d6eb-1aeb-4f39-89fa-f4767f863526 admin admin] PATH_INFO: `/v3/projects/e7ddfccf06624ec48632b21d99b466fb` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:51.124974 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd75d6eb-1aeb-4f39-89fa-f4767f863526 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7ddfccf06624ec48632b21d99b466fb)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:51.127254 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd75d6eb-1aeb-4f39-89fa-f4767f863526 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:51.314890 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97439b7-5086-47e0-9b72-694bf9d226ae admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:51.330803 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f90f666-3289-4ad7-9089-8883766526c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:51.333224 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f90f666-3289-4ad7-9089-8883766526c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:51.334169 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f90f666-3289-4ad7-9089-8883766526c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:51.334537 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f90f666-3289-4ad7-9089-8883766526c4 admin admin] PATH_INFO: `/v3/users/35125c3260104c57871daf4132e5ee12` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:51.336939 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f90f666-3289-4ad7-9089-8883766526c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=35125c3260104c57871daf4132e5ee12)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:51.345292 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f90f666-3289-4ad7-9089-8883766526c4 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:51.386608 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-bd75d6eb-1aeb-4f39-89fa-f4767f863526 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7ddfccf06624ec48632b21d99b466fb', 'request_id': 'req-bd75d6eb-1aeb-4f39-89fa-f4767f863526'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:25:51.402572 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-bd75d6eb-1aeb-4f39-89fa-f4767f863526 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7ddfccf06624ec48632b21d99b466fb', 'request_id': 'req-bd75d6eb-1aeb-4f39-89fa-f4767f863526'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:25:51.437831 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-bd75d6eb-1aeb-4f39-89fa-f4767f863526 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7ddfccf06624ec48632b21d99b466fb', 'request_id': 'req-bd75d6eb-1aeb-4f39-89fa-f4767f863526'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:25:51.595533 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-bd75d6eb-1aeb-4f39-89fa-f4767f863526 admin admin] The token cache is being invalidate because project e7ddfccf06624ec48632b21d99b466fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80873) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 17:25:51.596790 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-bd75d6eb-1aeb-4f39-89fa-f4767f863526 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:25:51.596790 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-bd75d6eb-1aeb-4f39-89fa-f4767f863526 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:25:51.602107 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 908/1815] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 16 17:25:50 2022] DELETE /identity/v3/projects/e7ddfccf06624ec48632b21d99b466fb => generated 0 bytes in 759 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:25:51.602107 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd75d6eb-1aeb-4f39-89fa-f4767f863526 admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:51.603517 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-bd75d6eb-1aeb-4f39-89fa-f4767f863526 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:25:51.678273 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-6f90f666-3289-4ad7-9089-8883766526c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35125c3260104c57871daf4132e5ee12'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:25:51.707611 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-6f90f666-3289-4ad7-9089-8883766526c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35125c3260104c57871daf4132e5ee12'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:25:51.769387 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd75d6eb-1aeb-4f39-89fa-f4767f863526 admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:51.774803 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747231c7-dba6-47a5-88ed-e62c1dcf13d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:51.775837 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747231c7-dba6-47a5-88ed-e62c1dcf13d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:51.776131 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747231c7-dba6-47a5-88ed-e62c1dcf13d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:51.776416 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747231c7-dba6-47a5-88ed-e62c1dcf13d8 admin admin] PATH_INFO: `/v3/projects/6c73974eb21e4ee698783b70aac630d2` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:51.777637 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747231c7-dba6-47a5-88ed-e62c1dcf13d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c73974eb21e4ee698783b70aac630d2)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:51.781495 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747231c7-dba6-47a5-88ed-e62c1dcf13d8 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:51.820813 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-6f90f666-3289-4ad7-9089-8883766526c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35125c3260104c57871daf4132e5ee12'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:25:51.832144 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-6f90f666-3289-4ad7-9089-8883766526c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35125c3260104c57871daf4132e5ee12'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:25:51.878669 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-6f90f666-3289-4ad7-9089-8883766526c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35125c3260104c57871daf4132e5ee12'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:25:51.921948 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 908/1816] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 16 17:25:51 2022] DELETE /identity/v3/users/35125c3260104c57871daf4132e5ee12 => generated 0 bytes in 885 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:25:51.924904 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f90f666-3289-4ad7-9089-8883766526c4 admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:51.929860 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-6f90f666-3289-4ad7-9089-8883766526c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:25:52.018660 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-747231c7-dba6-47a5-88ed-e62c1dcf13d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c73974eb21e4ee698783b70aac630d2', 'request_id': 'req-747231c7-dba6-47a5-88ed-e62c1dcf13d8'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:25:52.045534 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-747231c7-dba6-47a5-88ed-e62c1dcf13d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c73974eb21e4ee698783b70aac630d2', 'request_id': 'req-747231c7-dba6-47a5-88ed-e62c1dcf13d8'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:25:52.059292 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-747231c7-dba6-47a5-88ed-e62c1dcf13d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c73974eb21e4ee698783b70aac630d2', 'request_id': 'req-747231c7-dba6-47a5-88ed-e62c1dcf13d8'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:25:52.064821 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f90f666-3289-4ad7-9089-8883766526c4 admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:52.198993 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-747231c7-dba6-47a5-88ed-e62c1dcf13d8 admin admin] The token cache is being invalidate because project 6c73974eb21e4ee698783b70aac630d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80873) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 17:25:52.202256 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-747231c7-dba6-47a5-88ed-e62c1dcf13d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:25:52.202256 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-747231c7-dba6-47a5-88ed-e62c1dcf13d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:25:52.209321 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 909/1817] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 16 17:25:51 2022] DELETE /identity/v3/projects/6c73974eb21e4ee698783b70aac630d2 => generated 0 bytes in 606 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:25:52.209321 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c35a46-a2b4-4ae5-b057-1b9c6c60873a None None] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:52.209321 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c35a46-a2b4-4ae5-b057-1b9c6c60873a None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:52.209321 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c35a46-a2b4-4ae5-b057-1b9c6c60873a None None] PATH_INFO: `/` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:52.214373 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 910/1818] 10.222.0.39 () {54 vars in 921 bytes} [Thu Jun 16 17:25:52 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:25:52.216982 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d0a94f-220d-4cb3-ac8e-479987af8344 None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:52.217286 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d0a94f-220d-4cb3-ac8e-479987af8344 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:52.217585 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d0a94f-220d-4cb3-ac8e-479987af8344 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:52.237839 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c22d253-74b9-4cca-84f4-80ed4ce8e505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:52.239353 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c22d253-74b9-4cca-84f4-80ed4ce8e505 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:52.243480 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c22d253-74b9-4cca-84f4-80ed4ce8e505 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:52.243480 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c22d253-74b9-4cca-84f4-80ed4ce8e505 admin admin] PATH_INFO: `/v3/users/76da550c4da1433c844c0e3d6c9e7811` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:52.243480 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c22d253-74b9-4cca-84f4-80ed4ce8e505 admin admin] RBAC: Authorizing `identity:delete_user(user_id=76da550c4da1433c844c0e3d6c9e7811)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:52.246465 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c22d253-74b9-4cca-84f4-80ed4ce8e505 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:52.279003 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-62d0a94f-220d-4cb3-ac8e-479987af8344 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:25:52.280747 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-62d0a94f-220d-4cb3-ac8e-479987af8344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:25:52.299181 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 911/1819] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:25:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:25:52.306762 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7bed0b-d74d-4c8e-b3f4-2a5c00b17013 None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:52.307343 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7bed0b-d74d-4c8e-b3f4-2a5c00b17013 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:52.307873 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7bed0b-d74d-4c8e-b3f4-2a5c00b17013 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:52.343752 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-aa7bed0b-d74d-4c8e-b3f4-2a5c00b17013 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:25:52.345976 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-aa7bed0b-d74d-4c8e-b3f4-2a5c00b17013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:25:52.358435 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 912/1820] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:25:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 17:25:52.361468 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c2e2b1-7415-402d-ad5c-edaf708a639a None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:52.362029 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c2e2b1-7415-402d-ad5c-edaf708a639a None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:52.362685 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c2e2b1-7415-402d-ad5c-edaf708a639a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:52.385932 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-42c2e2b1-7415-402d-ad5c-edaf708a639a None None] MFA Rules not processed for user `3d381bb41dea4f1e90c3cf3815ac88dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:25:52.388005 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-42c2e2b1-7415-402d-ad5c-edaf708a639a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:25:52.543541 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 913/1821] 10.222.0.39 () {58 vars in 1018 bytes} [Thu Jun 16 17:25:52 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:25:52.545571 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c2e2b1-7415-402d-ad5c-edaf708a639a None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:52.559769 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c2e2b1-7415-402d-ad5c-edaf708a639a None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:52.571484 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c48cf7f-6060-4dca-ad49-f256becdb9d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:52.572475 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c48cf7f-6060-4dca-ad49-f256becdb9d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:52.573133 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c48cf7f-6060-4dca-ad49-f256becdb9d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:52.573926 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c48cf7f-6060-4dca-ad49-f256becdb9d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:52.574904 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c48cf7f-6060-4dca-ad49-f256becdb9d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80873) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:25:52.576314 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c48cf7f-6060-4dca-ad49-f256becdb9d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:52.579968 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-7c22d253-74b9-4cca-84f4-80ed4ce8e505 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76da550c4da1433c844c0e3d6c9e7811'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:25:52.580687 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c48cf7f-6060-4dca-ad49-f256becdb9d4 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:52.594573 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-7c22d253-74b9-4cca-84f4-80ed4ce8e505 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76da550c4da1433c844c0e3d6c9e7811'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:25:52.605477 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 914/1822] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 16 17:25:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:25:52.613298 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c48cf7f-6060-4dca-ad49-f256becdb9d4 admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:52.630945 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c48cf7f-6060-4dca-ad49-f256becdb9d4 admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:52.639311 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56daa647-1c71-44d8-9bb2-7f96330b3d96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:52.641045 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56daa647-1c71-44d8-9bb2-7f96330b3d96 admin admin] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:52.641675 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56daa647-1c71-44d8-9bb2-7f96330b3d96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:52.642355 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56daa647-1c71-44d8-9bb2-7f96330b3d96 admin admin] PATH_INFO: `/v3/projects` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:52.644035 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56daa647-1c71-44d8-9bb2-7f96330b3d96 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:52.647425 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56daa647-1c71-44d8-9bb2-7f96330b3d96 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:52.738734 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-7c22d253-74b9-4cca-84f4-80ed4ce8e505 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76da550c4da1433c844c0e3d6c9e7811'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:25:52.738734 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-7c22d253-74b9-4cca-84f4-80ed4ce8e505 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76da550c4da1433c844c0e3d6c9e7811'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:25:52.757305 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-7c22d253-74b9-4cca-84f4-80ed4ce8e505 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76da550c4da1433c844c0e3d6c9e7811'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:25:52.777147 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 909/1823] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 16 17:25:51 2022] DELETE /identity/v3/users/76da550c4da1433c844c0e3d6c9e7811 => generated 0 bytes in 854 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:25:52.799113 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 915/1824] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 16 17:25:52 2022] POST /identity/v3/projects => generated 363 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:25:52.807074 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c22d253-74b9-4cca-84f4-80ed4ce8e505 admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:52.813100 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-7c22d253-74b9-4cca-84f4-80ed4ce8e505 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:25:52.995446 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56daa647-1c71-44d8-9bb2-7f96330b3d96 admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:52.998877 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-56daa647-1c71-44d8-9bb2-7f96330b3d96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:25:53.048775 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c22d253-74b9-4cca-84f4-80ed4ce8e505 admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:53.187394 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac19009-b9b9-4d77-819a-d35904af7cb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:53.188156 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac19009-b9b9-4d77-819a-d35904af7cb6 admin admin] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:53.188449 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac19009-b9b9-4d77-819a-d35904af7cb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:53.188735 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac19009-b9b9-4d77-819a-d35904af7cb6 admin admin] PATH_INFO: `/v3/users` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:53.189653 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac19009-b9b9-4d77-819a-d35904af7cb6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:53.191962 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac19009-b9b9-4d77-819a-d35904af7cb6 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:53.237188 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56daa647-1c71-44d8-9bb2-7f96330b3d96 admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:53.261616 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3673a8-2f1c-4342-8a43-033a37d249c8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d381bb41dea4f1e90c3cf3815ac88dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:53.262647 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3673a8-2f1c-4342-8a43-033a37d249c8 service nova] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:53.263835 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3673a8-2f1c-4342-8a43-033a37d249c8 service nova] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:53.264803 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3673a8-2f1c-4342-8a43-033a37d249c8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:53.278011 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-5b3673a8-2f1c-4342-8a43-033a37d249c8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:25:53.280114 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:25:53.307511 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3673a8-2f1c-4342-8a43-033a37d249c8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:53.314020 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3673a8-2f1c-4342-8a43-033a37d249c8 service nova] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:53.343735 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 916/1825] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:25:52 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:25:53.344885 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3673a8-2f1c-4342-8a43-033a37d249c8 service nova] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:53.357914 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 910/1826] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 16 17:25:52 2022] POST /identity/v3/users => generated 282 bytes in 551 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:25:53.360839 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-5b3673a8-2f1c-4342-8a43-033a37d249c8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:25:53.362130 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac19009-b9b9-4d77-819a-d35904af7cb6 admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:53.397724 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac19009-b9b9-4d77-819a-d35904af7cb6 admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:53.410573 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88b7da2-8189-41e8-8d48-1205c1a3a98f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:53.411323 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88b7da2-8189-41e8-8d48-1205c1a3a98f admin admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:53.411616 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88b7da2-8189-41e8-8d48-1205c1a3a98f admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:53.411899 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88b7da2-8189-41e8-8d48-1205c1a3a98f admin admin] PATH_INFO: `/v3/roles` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:53.412832 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88b7da2-8189-41e8-8d48-1205c1a3a98f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:53.414657 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88b7da2-8189-41e8-8d48-1205c1a3a98f admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:53.432329 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 911/1827] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 17:25:53 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:25:53.436712 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88b7da2-8189-41e8-8d48-1205c1a3a98f admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:53.462839 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88b7da2-8189-41e8-8d48-1205c1a3a98f admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:53.476591 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c77699-2e16-4a80-b31c-b42490fe08a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:53.477366 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c77699-2e16-4a80-b31c-b42490fe08a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:53.478565 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c77699-2e16-4a80-b31c-b42490fe08a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:53.478870 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c77699-2e16-4a80-b31c-b42490fe08a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:53.482257 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c77699-2e16-4a80-b31c-b42490fe08a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:53.484487 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c77699-2e16-4a80-b31c-b42490fe08a3 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:53.509140 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 912/1828] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 17:25:53 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:25:53.510553 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c77699-2e16-4a80-b31c-b42490fe08a3 admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:53.526341 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c77699-2e16-4a80-b31c-b42490fe08a3 admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:53.534194 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3673a8-2f1c-4342-8a43-033a37d249c8 service nova] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:53.540203 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5851ace-af54-4b2c-aa6d-68082768a6be service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef37136b89d34edc9cd94c7aa81b2095', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:53.540989 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5851ace-af54-4b2c-aa6d-68082768a6be service cinder] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:53.543370 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5851ace-af54-4b2c-aa6d-68082768a6be service cinder] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:53.545448 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5851ace-af54-4b2c-aa6d-68082768a6be service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:53.550391 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831cd7e4-108e-4771-8b62-5b8967853695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:53.552083 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831cd7e4-108e-4771-8b62-5b8967853695 admin admin] REQUEST_METHOD: `PUT` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:53.553063 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831cd7e4-108e-4771-8b62-5b8967853695 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:53.554007 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831cd7e4-108e-4771-8b62-5b8967853695 admin admin] PATH_INFO: `/v3/projects/883aff4199f6432bb431c9ad14498d4e/users/143d68eb89ee4283ae82886ecb768992/roles/896bff49c5d6464eb612a15f4aa9badc` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:53.554297 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-d5851ace-af54-4b2c-aa6d-68082768a6be service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:25:53.618005 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831cd7e4-108e-4771-8b62-5b8967853695 admin admin] RBAC: Authorizing `identity:create_grant(project_id=883aff4199f6432bb431c9ad14498d4e, user_id=143d68eb89ee4283ae82886ecb768992, role_id=896bff49c5d6464eb612a15f4aa9badc)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:53.626100 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831cd7e4-108e-4771-8b62-5b8967853695 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:53.715183 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5851ace-af54-4b2c-aa6d-68082768a6be service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:53.717144 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5851ace-af54-4b2c-aa6d-68082768a6be service cinder] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:53.741244 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 917/1829] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:25:53 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:25:53.816200 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 913/1830] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 17:25:53 2022] PUT /identity/v3/projects/883aff4199f6432bb431c9ad14498d4e/users/143d68eb89ee4283ae82886ecb768992/roles/896bff49c5d6464eb612a15f4aa9badc => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:25:53.828319 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb23858-3315-4f57-ba31-6accd73ee61d None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:53.828652 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb23858-3315-4f57-ba31-6accd73ee61d None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:53.828892 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb23858-3315-4f57-ba31-6accd73ee61d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:53.906931 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-cdb23858-3315-4f57-ba31-6accd73ee61d None None] MFA Rules not processed for user `143d68eb89ee4283ae82886ecb768992`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:25:53.908371 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-cdb23858-3315-4f57-ba31-6accd73ee61d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:25:54.081876 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 918/1831] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:25:53 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:25:54.086184 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831cd7e4-108e-4771-8b62-5b8967853695 admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:54.156603 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb23858-3315-4f57-ba31-6accd73ee61d None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:54.158750 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-cdb23858-3315-4f57-ba31-6accd73ee61d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:25:54.326568 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831cd7e4-108e-4771-8b62-5b8967853695 admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:54.339827 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1250ed17-9cd3-4faa-9fa2-33c5c91afcdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:54.341415 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1250ed17-9cd3-4faa-9fa2-33c5c91afcdd admin admin] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:54.356142 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1250ed17-9cd3-4faa-9fa2-33c5c91afcdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:54.365977 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1250ed17-9cd3-4faa-9fa2-33c5c91afcdd admin admin] PATH_INFO: `/v3/projects` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:54.365977 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1250ed17-9cd3-4faa-9fa2-33c5c91afcdd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:54.365977 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1250ed17-9cd3-4faa-9fa2-33c5c91afcdd admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:54.376583 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb23858-3315-4f57-ba31-6accd73ee61d None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:54.384961 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d66d6a-96ad-4570-83ae-dc6de7df3b04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:54.386693 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d66d6a-96ad-4570-83ae-dc6de7df3b04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:54.387125 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d66d6a-96ad-4570-83ae-dc6de7df3b04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:54.387558 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d66d6a-96ad-4570-83ae-dc6de7df3b04 admin admin] PATH_INFO: `/v3/projects/221534f557f2456dae202733ada0293b` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:54.401972 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d66d6a-96ad-4570-83ae-dc6de7df3b04 admin admin] RBAC: Authorizing `identity:delete_project(project_id=221534f557f2456dae202733ada0293b)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:54.401972 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d66d6a-96ad-4570-83ae-dc6de7df3b04 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:54.534138 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 914/1832] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 16 17:25:54 2022] POST /identity/v3/projects => generated 363 bytes in 448 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:25:54.535794 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06af911-419a-419c-a326-b6a8904abca9 None None] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:54.536154 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06af911-419a-419c-a326-b6a8904abca9 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:54.536861 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06af911-419a-419c-a326-b6a8904abca9 None None] PATH_INFO: `/` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:54.539043 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 915/1833] 10.222.0.39 () {54 vars in 921 bytes} [Thu Jun 16 17:25:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:25:54.540296 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06af911-419a-419c-a326-b6a8904abca9 None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:54.605867 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-27d66d6a-96ad-4570-83ae-dc6de7df3b04 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '221534f557f2456dae202733ada0293b', 'request_id': 'req-27d66d6a-96ad-4570-83ae-dc6de7df3b04'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:25:54.643378 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-27d66d6a-96ad-4570-83ae-dc6de7df3b04 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '221534f557f2456dae202733ada0293b', 'request_id': 'req-27d66d6a-96ad-4570-83ae-dc6de7df3b04'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:25:54.654922 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-27d66d6a-96ad-4570-83ae-dc6de7df3b04 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '221534f557f2456dae202733ada0293b', 'request_id': 'req-27d66d6a-96ad-4570-83ae-dc6de7df3b04'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:25:54.783791 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06af911-419a-419c-a326-b6a8904abca9 None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:54.842967 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-27d66d6a-96ad-4570-83ae-dc6de7df3b04 admin admin] The token cache is being invalidate because project 221534f557f2456dae202733ada0293b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80873) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 17:25:54.843443 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-27d66d6a-96ad-4570-83ae-dc6de7df3b04 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:25:54.844381 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-27d66d6a-96ad-4570-83ae-dc6de7df3b04 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:25:54.852970 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 919/1834] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 16 17:25:54 2022] DELETE /identity/v3/projects/221534f557f2456dae202733ada0293b => generated 0 bytes in 693 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 17:25:54.853630 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab419049-20c9-45d2-9fb8-0c13835605b5 None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:54.854004 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab419049-20c9-45d2-9fb8-0c13835605b5 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:54.857850 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab419049-20c9-45d2-9fb8-0c13835605b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:54.955382 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-ab419049-20c9-45d2-9fb8-0c13835605b5 None None] MFA Rules not processed for user `3d381bb41dea4f1e90c3cf3815ac88dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:25:54.976192 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-ab419049-20c9-45d2-9fb8-0c13835605b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:25:55.055077 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bcd9a6-402c-4f45-818b-d8532f79aadd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:55.059899 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bcd9a6-402c-4f45-818b-d8532f79aadd admin admin] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:55.060201 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bcd9a6-402c-4f45-818b-d8532f79aadd admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:55.060484 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bcd9a6-402c-4f45-818b-d8532f79aadd admin admin] PATH_INFO: `/v3/users` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:55.061215 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bcd9a6-402c-4f45-818b-d8532f79aadd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:55.070106 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bcd9a6-402c-4f45-818b-d8532f79aadd admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:55.198630 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 920/1835] 10.222.0.39 () {58 vars in 1018 bytes} [Thu Jun 16 17:25:54 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 347 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:25:55.200535 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0015b4-6cf2-4e3e-9e8e-d3d80e08d13b None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:55.202682 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0015b4-6cf2-4e3e-9e8e-d3d80e08d13b None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:55.202682 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0015b4-6cf2-4e3e-9e8e-d3d80e08d13b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:55.250494 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-7d0015b4-6cf2-4e3e-9e8e-d3d80e08d13b None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:25:55.258640 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-7d0015b4-6cf2-4e3e-9e8e-d3d80e08d13b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:25:55.283886 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 921/1836] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:25:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:25:55.285737 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9386dc4-9eda-4213-ab1f-f0dc6f2dc0b3 None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:55.285870 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9386dc4-9eda-4213-ab1f-f0dc6f2dc0b3 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:55.286154 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9386dc4-9eda-4213-ab1f-f0dc6f2dc0b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:55.339335 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-c9386dc4-9eda-4213-ab1f-f0dc6f2dc0b3 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:25:55.339335 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-c9386dc4-9eda-4213-ab1f-f0dc6f2dc0b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:25:55.343674 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 916/1837] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 16 17:25:54 2022] POST /identity/v3/users => generated 288 bytes in 804 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:25:55.344737 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bcd9a6-402c-4f45-818b-d8532f79aadd admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:55.353533 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 922/1838] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:25:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 17:25:55.353736 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-57bcd9a6-402c-4f45-818b-d8532f79aadd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:25:55.356897 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9386dc4-9eda-4213-ab1f-f0dc6f2dc0b3 None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:55.379181 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9386dc4-9eda-4213-ab1f-f0dc6f2dc0b3 None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:55.383793 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4b5e4b-e9b1-404f-850a-da85ba49a4f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:55.384691 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4b5e4b-e9b1-404f-850a-da85ba49a4f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:55.384829 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bcd9a6-402c-4f45-818b-d8532f79aadd admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:55.385317 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4b5e4b-e9b1-404f-850a-da85ba49a4f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:55.386387 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4b5e4b-e9b1-404f-850a-da85ba49a4f1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:55.391081 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4b5e4b-e9b1-404f-850a-da85ba49a4f1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80873) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:25:55.391635 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4b5e4b-e9b1-404f-850a-da85ba49a4f1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:55.395430 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4b5e4b-e9b1-404f-850a-da85ba49a4f1 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:55.403065 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:25:55.410525 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b7382c-62d2-4e6c-bf6b-d5d30b0272d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:55.411223 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b7382c-62d2-4e6c-bf6b-d5d30b0272d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:55.414175 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b7382c-62d2-4e6c-bf6b-d5d30b0272d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:55.414702 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b7382c-62d2-4e6c-bf6b-d5d30b0272d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:55.415581 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 923/1839] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 16 17:25:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:25:55.419064 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b7382c-62d2-4e6c-bf6b-d5d30b0272d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:55.420792 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4b5e4b-e9b1-404f-850a-da85ba49a4f1 admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:55.424430 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b7382c-62d2-4e6c-bf6b-d5d30b0272d8 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:55.437445 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4b5e4b-e9b1-404f-850a-da85ba49a4f1 admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:55.441915 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 917/1840] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 17:25:55 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:25:55.448614 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7617e41-3a70-46c9-bd18-c3d58d82a785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:55.449615 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7617e41-3a70-46c9-bd18-c3d58d82a785 admin admin] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:55.449991 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7617e41-3a70-46c9-bd18-c3d58d82a785 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:55.451220 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7617e41-3a70-46c9-bd18-c3d58d82a785 admin admin] PATH_INFO: `/v3/projects` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:55.452833 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7617e41-3a70-46c9-bd18-c3d58d82a785 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:55.458647 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7617e41-3a70-46c9-bd18-c3d58d82a785 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:55.465863 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b7382c-62d2-4e6c-bf6b-d5d30b0272d8 admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:55.492014 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b7382c-62d2-4e6c-bf6b-d5d30b0272d8 admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:55.504431 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8fefa5-f76c-4a35-9dc9-a5f8411f1845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:55.505907 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8fefa5-f76c-4a35-9dc9-a5f8411f1845 admin admin] REQUEST_METHOD: `PUT` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:55.511552 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8fefa5-f76c-4a35-9dc9-a5f8411f1845 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:55.511552 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8fefa5-f76c-4a35-9dc9-a5f8411f1845 admin admin] PATH_INFO: `/v3/projects/ec862642f56a4dec939f2fa6438f8a9e/users/41223b2d7fd446d6b80dc82884a94e19/roles/dba744f8ab2a4c45b9d3212f8d203aba` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:55.559625 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8fefa5-f76c-4a35-9dc9-a5f8411f1845 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec862642f56a4dec939f2fa6438f8a9e, user_id=41223b2d7fd446d6b80dc82884a94e19, role_id=dba744f8ab2a4c45b9d3212f8d203aba)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:55.564504 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8fefa5-f76c-4a35-9dc9-a5f8411f1845 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:55.601016 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:25:55.637556 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 924/1841] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 16 17:25:55 2022] POST /identity/v3/projects => generated 379 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:25:55.639023 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7617e41-3a70-46c9-bd18-c3d58d82a785 admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:55.640982 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-c7617e41-3a70-46c9-bd18-c3d58d82a785 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:25:55.709732 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 918/1842] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 17:25:55 2022] PUT /identity/v3/projects/ec862642f56a4dec939f2fa6438f8a9e/users/41223b2d7fd446d6b80dc82884a94e19/roles/dba744f8ab2a4c45b9d3212f8d203aba => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:25:55.710923 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8fefa5-f76c-4a35-9dc9-a5f8411f1845 admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:55.744784 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-4b8fefa5-f76c-4a35-9dc9-a5f8411f1845 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:25:55.897870 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7617e41-3a70-46c9-bd18-c3d58d82a785 admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:55.958209 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8fefa5-f76c-4a35-9dc9-a5f8411f1845 admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:55.961221 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e101506-8a42-4b75-adf6-6fd71b509111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:55.962763 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e101506-8a42-4b75-adf6-6fd71b509111 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:55.963212 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e101506-8a42-4b75-adf6-6fd71b509111 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:55.963669 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e101506-8a42-4b75-adf6-6fd71b509111 admin admin] PATH_INFO: `/v3/projects/337fb9ab2e7948a9a556ca45efe2e588` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:55.967483 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e101506-8a42-4b75-adf6-6fd71b509111 admin admin] RBAC: Authorizing `identity:delete_project(project_id=337fb9ab2e7948a9a556ca45efe2e588)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:55.970337 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e101506-8a42-4b75-adf6-6fd71b509111 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:56.128039 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f59e3c-bec6-4105-b3b6-8a9165fddb17 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d381bb41dea4f1e90c3cf3815ac88dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:56.128963 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f59e3c-bec6-4105-b3b6-8a9165fddb17 service nova] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:56.129334 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f59e3c-bec6-4105-b3b6-8a9165fddb17 service nova] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:56.129685 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f59e3c-bec6-4105-b3b6-8a9165fddb17 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:56.143209 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f59e3c-bec6-4105-b3b6-8a9165fddb17 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:56.144998 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f59e3c-bec6-4105-b3b6-8a9165fddb17 service nova] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:56.177051 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 925/1843] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:25:55 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 538 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:25:56.179631 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f59e3c-bec6-4105-b3b6-8a9165fddb17 service nova] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:56.215430 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f59e3c-bec6-4105-b3b6-8a9165fddb17 service nova] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:56.226651 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-1e101506-8a42-4b75-adf6-6fd71b509111 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '337fb9ab2e7948a9a556ca45efe2e588', 'request_id': 'req-1e101506-8a42-4b75-adf6-6fd71b509111'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:25:56.244449 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-1e101506-8a42-4b75-adf6-6fd71b509111 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '337fb9ab2e7948a9a556ca45efe2e588', 'request_id': 'req-1e101506-8a42-4b75-adf6-6fd71b509111'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:25:56.344131 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e06673-324a-4c0e-9fcd-2f4a3304651e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:56.345005 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e06673-324a-4c0e-9fcd-2f4a3304651e admin admin] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:56.345381 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e06673-324a-4c0e-9fcd-2f4a3304651e admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:56.345782 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e06673-324a-4c0e-9fcd-2f4a3304651e admin admin] PATH_INFO: `/v3/users` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:56.360492 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e06673-324a-4c0e-9fcd-2f4a3304651e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:56.362962 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e06673-324a-4c0e-9fcd-2f4a3304651e admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:56.398561 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-1e101506-8a42-4b75-adf6-6fd71b509111 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '337fb9ab2e7948a9a556ca45efe2e588', 'request_id': 'req-1e101506-8a42-4b75-adf6-6fd71b509111'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:25:56.422508 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-1e101506-8a42-4b75-adf6-6fd71b509111 admin admin] The token cache is being invalidate because project 337fb9ab2e7948a9a556ca45efe2e588 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80874) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 17:25:56.423222 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-1e101506-8a42-4b75-adf6-6fd71b509111 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:25:56.424156 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-1e101506-8a42-4b75-adf6-6fd71b509111 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:25:56.432187 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 919/1844] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 16 17:25:55 2022] DELETE /identity/v3/projects/337fb9ab2e7948a9a556ca45efe2e588 => generated 0 bytes in 717 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:25:56.432187 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e101506-8a42-4b75-adf6-6fd71b509111 admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:56.435315 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-1e101506-8a42-4b75-adf6-6fd71b509111 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:25:56.479186 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e101506-8a42-4b75-adf6-6fd71b509111 admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:56.496828 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 926/1845] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 16 17:25:56 2022] POST /identity/v3/users => generated 290 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:25:56.498417 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d5d704-0530-44dd-bed2-7231099b5461 None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:56.498582 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0029ad92-df79-4967-9af1-21225cbd19d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:56.498764 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d5d704-0530-44dd-bed2-7231099b5461 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:56.499046 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d5d704-0530-44dd-bed2-7231099b5461 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:56.500061 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0029ad92-df79-4967-9af1-21225cbd19d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:56.500449 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0029ad92-df79-4967-9af1-21225cbd19d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:56.500942 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0029ad92-df79-4967-9af1-21225cbd19d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:56.501951 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0029ad92-df79-4967-9af1-21225cbd19d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:56.505446 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0029ad92-df79-4967-9af1-21225cbd19d5 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:56.526671 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 920/1846] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 17:25:56 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:25:56.529120 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0029ad92-df79-4967-9af1-21225cbd19d5 admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:56.532633 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-0029ad92-df79-4967-9af1-21225cbd19d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:25:56.532840 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-b4d5d704-0530-44dd-bed2-7231099b5461 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:25:56.534544 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-b4d5d704-0530-44dd-bed2-7231099b5461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:25:56.545792 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 927/1847] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:25:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:25:56.546624 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d5d704-0530-44dd-bed2-7231099b5461 None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:56.549477 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0029ad92-df79-4967-9af1-21225cbd19d5 admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:56.556917 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0080151d-28a6-4da0-b4f4-6f10a37d16a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:56.557926 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0080151d-28a6-4da0-b4f4-6f10a37d16a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:56.558222 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0080151d-28a6-4da0-b4f4-6f10a37d16a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:56.558498 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0080151d-28a6-4da0-b4f4-6f10a37d16a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:56.559504 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0080151d-28a6-4da0-b4f4-6f10a37d16a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:56.573960 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d5d704-0530-44dd-bed2-7231099b5461 None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:56.576397 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0080151d-28a6-4da0-b4f4-6f10a37d16a6 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:56.581019 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7fa0cb-8bc1-4007-91b1-581c8bf3b494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:56.584028 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7fa0cb-8bc1-4007-91b1-581c8bf3b494 admin admin] REQUEST_METHOD: `PUT` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:56.584619 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7fa0cb-8bc1-4007-91b1-581c8bf3b494 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:56.584988 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7fa0cb-8bc1-4007-91b1-581c8bf3b494 admin admin] PATH_INFO: `/v3/projects/ec862642f56a4dec939f2fa6438f8a9e/users/41223b2d7fd446d6b80dc82884a94e19/roles/dba744f8ab2a4c45b9d3212f8d203aba` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:56.588687 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7fa0cb-8bc1-4007-91b1-581c8bf3b494 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec862642f56a4dec939f2fa6438f8a9e, user_id=41223b2d7fd446d6b80dc82884a94e19, role_id=dba744f8ab2a4c45b9d3212f8d203aba)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:56.597692 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7fa0cb-8bc1-4007-91b1-581c8bf3b494 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:56.632074 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 921/1848] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 17:25:56 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:25:56.638062 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7a2d73-011f-47bd-b035-a38b445575ae None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:56.638062 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7a2d73-011f-47bd-b035-a38b445575ae None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:56.638595 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7a2d73-011f-47bd-b035-a38b445575ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:56.656516 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 928/1849] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 17:25:56 2022] PUT /identity/v3/projects/ec862642f56a4dec939f2fa6438f8a9e/users/41223b2d7fd446d6b80dc82884a94e19/roles/dba744f8ab2a4c45b9d3212f8d203aba => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:25:56.656516 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7fa0cb-8bc1-4007-91b1-581c8bf3b494 admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:56.689265 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-2a7a2d73-011f-47bd-b035-a38b445575ae None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:25:56.691069 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-2a7a2d73-011f-47bd-b035-a38b445575ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:25:56.827995 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 922/1850] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:25:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:25:56.829616 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbade50-80ad-48f6-b61c-6815f75f6d75 None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:56.829952 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbade50-80ad-48f6-b61c-6815f75f6d75 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:56.830260 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbade50-80ad-48f6-b61c-6815f75f6d75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:56.859399 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7fa0cb-8bc1-4007-91b1-581c8bf3b494 admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:56.873449 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-2cbade50-80ad-48f6-b61c-6815f75f6d75 None None] MFA Rules not processed for user `41223b2d7fd446d6b80dc82884a94e19`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:25:56.874082 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673ef0c0-9496-419c-9c03-c20ac20d0b7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:56.874959 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673ef0c0-9496-419c-9c03-c20ac20d0b7f admin admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:56.875084 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-2cbade50-80ad-48f6-b61c-6815f75f6d75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:25:56.875501 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673ef0c0-9496-419c-9c03-c20ac20d0b7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:56.875947 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673ef0c0-9496-419c-9c03-c20ac20d0b7f admin admin] PATH_INFO: `/v3/roles` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:56.877471 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673ef0c0-9496-419c-9c03-c20ac20d0b7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:56.880137 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673ef0c0-9496-419c-9c03-c20ac20d0b7f admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:56.897658 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 929/1851] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 17:25:56 2022] GET /identity/v3/roles => generated 1420 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:25:56.899123 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673ef0c0-9496-419c-9c03-c20ac20d0b7f admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:56.924163 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673ef0c0-9496-419c-9c03-c20ac20d0b7f admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:56.942591 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7564323e-8bde-4988-b146-537b1ffed073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:56.945347 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7564323e-8bde-4988-b146-537b1ffed073 admin admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:56.946355 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7564323e-8bde-4988-b146-537b1ffed073 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:56.947823 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7564323e-8bde-4988-b146-537b1ffed073 admin admin] PATH_INFO: `/v3/domains` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:56.949818 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7564323e-8bde-4988-b146-537b1ffed073 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80873) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:25:56.950905 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7564323e-8bde-4988-b146-537b1ffed073 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:56.957397 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7564323e-8bde-4988-b146-537b1ffed073 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:56.980354 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 930/1852] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 16 17:25:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:25:56.980354 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7564323e-8bde-4988-b146-537b1ffed073 admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:56.988952 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7564323e-8bde-4988-b146-537b1ffed073 admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:56.998751 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a1c34a-fd5a-40fb-85e6-b7873cf05b59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:56.999927 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a1c34a-fd5a-40fb-85e6-b7873cf05b59 admin admin] REQUEST_METHOD: `PUT` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:57.000682 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a1c34a-fd5a-40fb-85e6-b7873cf05b59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:57.000819 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a1c34a-fd5a-40fb-85e6-b7873cf05b59 admin admin] PATH_INFO: `/v3/projects/552d1ef8b2ec499e9de7e9462bd6652f/users/07e981de24464b1185d7f16190516126/roles/896bff49c5d6464eb612a15f4aa9badc` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:57.018329 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:25:57.042483 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a1c34a-fd5a-40fb-85e6-b7873cf05b59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=552d1ef8b2ec499e9de7e9462bd6652f, user_id=07e981de24464b1185d7f16190516126, role_id=896bff49c5d6464eb612a15f4aa9badc)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:57.043063 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 923/1853] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:25:56 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:25:57.044827 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbade50-80ad-48f6-b61c-6815f75f6d75 None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:57.046257 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a1c34a-fd5a-40fb-85e6-b7873cf05b59 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:57.104480 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbade50-80ad-48f6-b61c-6815f75f6d75 None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:57.125127 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3594c8d6-18db-4a39-a586-e101e199b108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:57.126749 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3594c8d6-18db-4a39-a586-e101e199b108 admin admin] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:57.127231 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3594c8d6-18db-4a39-a586-e101e199b108 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:57.128586 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3594c8d6-18db-4a39-a586-e101e199b108 admin admin] PATH_INFO: `/v3/projects` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:57.129977 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3594c8d6-18db-4a39-a586-e101e199b108 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:57.134726 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3594c8d6-18db-4a39-a586-e101e199b108 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:57.138238 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 931/1854] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 17:25:56 2022] PUT /identity/v3/projects/552d1ef8b2ec499e9de7e9462bd6652f/users/07e981de24464b1185d7f16190516126/roles/896bff49c5d6464eb612a15f4aa9badc => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:25:57.154709 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5257c31c-1f19-43a6-a976-b9943617a96a None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:57.154709 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5257c31c-1f19-43a6-a976-b9943617a96a None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:57.155028 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5257c31c-1f19-43a6-a976-b9943617a96a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:57.230051 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-5257c31c-1f19-43a6-a976-b9943617a96a None None] MFA Rules not processed for user `07e981de24464b1185d7f16190516126`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:25:57.230051 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-5257c31c-1f19-43a6-a976-b9943617a96a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:25:57.264901 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 924/1855] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 16 17:25:57 2022] POST /identity/v3/projects => generated 383 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:25:57.266197 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3594c8d6-18db-4a39-a586-e101e199b108 admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:57.273057 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-3594c8d6-18db-4a39-a586-e101e199b108 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:25:57.425658 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 932/1856] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:25:57 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:25:57.426871 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5257c31c-1f19-43a6-a976-b9943617a96a None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:57.438985 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3594c8d6-18db-4a39-a586-e101e199b108 admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:57.446818 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4990d49b-aab7-4e75-8886-408c6cd4522d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef37136b89d34edc9cd94c7aa81b2095', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:57.446818 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4990d49b-aab7-4e75-8886-408c6cd4522d service cinder] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:57.452851 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4990d49b-aab7-4e75-8886-408c6cd4522d service cinder] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:57.453234 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4990d49b-aab7-4e75-8886-408c6cd4522d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:57.592393 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4990d49b-aab7-4e75-8886-408c6cd4522d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:57.593952 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4990d49b-aab7-4e75-8886-408c6cd4522d service cinder] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:57.607331 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5257c31c-1f19-43a6-a976-b9943617a96a None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:57.608022 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 925/1857] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:25:57 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:25:57.609612 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4990d49b-aab7-4e75-8886-408c6cd4522d service cinder] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:57.745538 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1a4704-8ccd-4afc-9967-41d5eddfb1a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:57.746289 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1a4704-8ccd-4afc-9967-41d5eddfb1a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:57.746584 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1a4704-8ccd-4afc-9967-41d5eddfb1a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:57.747487 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1a4704-8ccd-4afc-9967-41d5eddfb1a8 admin admin] PATH_INFO: `/v3/users` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:57.748887 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1a4704-8ccd-4afc-9967-41d5eddfb1a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:57.751749 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1a4704-8ccd-4afc-9967-41d5eddfb1a8 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:57.767143 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4990d49b-aab7-4e75-8886-408c6cd4522d service cinder] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:57.772932 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8480a23-ef0d-40d1-b538-32b7f51d1045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:57.773679 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8480a23-ef0d-40d1-b538-32b7f51d1045 admin admin] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:57.774001 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8480a23-ef0d-40d1-b538-32b7f51d1045 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:57.774705 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8480a23-ef0d-40d1-b538-32b7f51d1045 admin admin] PATH_INFO: `/v3/projects` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:57.774983 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8480a23-ef0d-40d1-b538-32b7f51d1045 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:57.777253 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8480a23-ef0d-40d1-b538-32b7f51d1045 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:57.913641 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 926/1858] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 16 17:25:57 2022] POST /identity/v3/projects => generated 379 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:25:57.924012 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 933/1859] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 16 17:25:57 2022] POST /identity/v3/users => generated 292 bytes in 488 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:25:57.924198 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8480a23-ef0d-40d1-b538-32b7f51d1045 admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:57.924316 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1a4704-8ccd-4afc-9967-41d5eddfb1a8 admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:57.937647 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1a4704-8ccd-4afc-9967-41d5eddfb1a8 admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:58.021350 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8480a23-ef0d-40d1-b538-32b7f51d1045 admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:58.033789 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ed372e-f3ce-4471-b85f-568ce3741562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:58.034485 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ed372e-f3ce-4471-b85f-568ce3741562 admin admin] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:58.034782 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ed372e-f3ce-4471-b85f-568ce3741562 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:58.035068 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ed372e-f3ce-4471-b85f-568ce3741562 admin admin] PATH_INFO: `/v3/users` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:58.035799 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ed372e-f3ce-4471-b85f-568ce3741562 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:58.038714 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba8d196-7528-43b7-97ad-e4b64ffc2027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:58.039399 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba8d196-7528-43b7-97ad-e4b64ffc2027 admin admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:58.039689 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba8d196-7528-43b7-97ad-e4b64ffc2027 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:58.039997 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba8d196-7528-43b7-97ad-e4b64ffc2027 admin admin] PATH_INFO: `/v3/roles` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:58.040737 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba8d196-7528-43b7-97ad-e4b64ffc2027 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:58.042362 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba8d196-7528-43b7-97ad-e4b64ffc2027 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:58.042717 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ed372e-f3ce-4471-b85f-568ce3741562 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:58.053676 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 934/1860] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 17:25:57 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:25:58.057782 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba8d196-7528-43b7-97ad-e4b64ffc2027 admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:58.069364 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba8d196-7528-43b7-97ad-e4b64ffc2027 admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:58.074287 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c428b43a-7775-4699-9ffa-f239a74214f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:58.075568 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c428b43a-7775-4699-9ffa-f239a74214f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:58.075860 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c428b43a-7775-4699-9ffa-f239a74214f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:58.076144 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c428b43a-7775-4699-9ffa-f239a74214f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:58.076878 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c428b43a-7775-4699-9ffa-f239a74214f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:58.078651 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c428b43a-7775-4699-9ffa-f239a74214f7 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:58.092273 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 935/1861] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 17:25:58 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 17:25:58.095261 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c428b43a-7775-4699-9ffa-f239a74214f7 admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:58.105881 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c428b43a-7775-4699-9ffa-f239a74214f7 admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:58.111007 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a895bfc0-8162-4a52-b2e0-4df6b6848996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:58.111975 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a895bfc0-8162-4a52-b2e0-4df6b6848996 admin admin] REQUEST_METHOD: `PUT` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:58.112347 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a895bfc0-8162-4a52-b2e0-4df6b6848996 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:58.112636 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a895bfc0-8162-4a52-b2e0-4df6b6848996 admin admin] PATH_INFO: `/v3/projects/e1e8117cec5d4927b93cb3fb6605d3dd/users/419e5842ce8e4b06b6a089b9e7e83d31/roles/896bff49c5d6464eb612a15f4aa9badc` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:58.128896 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a895bfc0-8162-4a52-b2e0-4df6b6848996 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1e8117cec5d4927b93cb3fb6605d3dd, user_id=419e5842ce8e4b06b6a089b9e7e83d31, role_id=896bff49c5d6464eb612a15f4aa9badc)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:58.131750 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a895bfc0-8162-4a52-b2e0-4df6b6848996 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:58.346935 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 927/1862] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 16 17:25:57 2022] POST /identity/v3/users => generated 296 bytes in 423 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:25:58.346935 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ed372e-f3ce-4471-b85f-568ce3741562 admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:58.360251 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 936/1863] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 17:25:58 2022] PUT /identity/v3/projects/e1e8117cec5d4927b93cb3fb6605d3dd/users/419e5842ce8e4b06b6a089b9e7e83d31/roles/896bff49c5d6464eb612a15f4aa9badc => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:25:58.360251 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a895bfc0-8162-4a52-b2e0-4df6b6848996 admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:58.410143 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ed372e-f3ce-4471-b85f-568ce3741562 admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:58.420470 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a895bfc0-8162-4a52-b2e0-4df6b6848996 admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:58.425395 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87dc754-680b-4ceb-b00b-69af75c02f03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:58.425907 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87dc754-680b-4ceb-b00b-69af75c02f03 admin admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:58.426196 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87dc754-680b-4ceb-b00b-69af75c02f03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:58.426497 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87dc754-680b-4ceb-b00b-69af75c02f03 admin admin] PATH_INFO: `/v3/roles` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:58.427225 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87dc754-680b-4ceb-b00b-69af75c02f03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:58.428815 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87dc754-680b-4ceb-b00b-69af75c02f03 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:58.439554 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 937/1864] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 17:25:58 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:25:58.440808 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af260fce-cb51-4e9c-87cb-b13d2c0cc1c2 None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:58.441103 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af260fce-cb51-4e9c-87cb-b13d2c0cc1c2 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:58.441401 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af260fce-cb51-4e9c-87cb-b13d2c0cc1c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:58.460650 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba74329-017f-4ea8-94a0-27561ea05793 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef37136b89d34edc9cd94c7aa81b2095', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:58.461316 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba74329-017f-4ea8-94a0-27561ea05793 service cinder] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:58.461603 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba74329-017f-4ea8-94a0-27561ea05793 service cinder] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:58.461913 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba74329-017f-4ea8-94a0-27561ea05793 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:58.463701 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-7ba74329-017f-4ea8-94a0-27561ea05793 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:25:58.468180 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-af260fce-cb51-4e9c-87cb-b13d2c0cc1c2 None None] MFA Rules not processed for user `419e5842ce8e4b06b6a089b9e7e83d31`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:25:58.469377 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-af260fce-cb51-4e9c-87cb-b13d2c0cc1c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:25:58.547117 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba74329-017f-4ea8-94a0-27561ea05793 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:58.548897 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba74329-017f-4ea8-94a0-27561ea05793 service cinder] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:58.564339 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 928/1865] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:25:58 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:25:58.572364 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 938/1866] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:25:58 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:25:58.581050 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba74329-017f-4ea8-94a0-27561ea05793 service cinder] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:58.605239 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba74329-017f-4ea8-94a0-27561ea05793 service cinder] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:58.612966 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6a2422-be1a-4e93-9da5-93bd0783c65a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:58.615846 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6a2422-be1a-4e93-9da5-93bd0783c65a admin admin] REQUEST_METHOD: `PUT` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:58.615846 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6a2422-be1a-4e93-9da5-93bd0783c65a admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:58.615846 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6a2422-be1a-4e93-9da5-93bd0783c65a admin admin] PATH_INFO: `/v3/projects/e173bd794d754a5f89338566b2adc31c/users/c250dc598e2f4e5fa62c2aabb978fcae/roles/dba744f8ab2a4c45b9d3212f8d203aba` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:58.633930 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6a2422-be1a-4e93-9da5-93bd0783c65a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e173bd794d754a5f89338566b2adc31c, user_id=c250dc598e2f4e5fa62c2aabb978fcae, role_id=dba744f8ab2a4c45b9d3212f8d203aba)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:58.655477 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6a2422-be1a-4e93-9da5-93bd0783c65a admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:58.730236 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af260fce-cb51-4e9c-87cb-b13d2c0cc1c2 None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:58.732310 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-af260fce-cb51-4e9c-87cb-b13d2c0cc1c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:25:58.744154 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 929/1867] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 17:25:58 2022] PUT /identity/v3/projects/e173bd794d754a5f89338566b2adc31c/users/c250dc598e2f4e5fa62c2aabb978fcae/roles/dba744f8ab2a4c45b9d3212f8d203aba => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:25:58.746318 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af260fce-cb51-4e9c-87cb-b13d2c0cc1c2 None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:58.748693 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6a2422-be1a-4e93-9da5-93bd0783c65a admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:58.796906 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37126b26-cba8-4143-97cd-1c0e7f399c41 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef37136b89d34edc9cd94c7aa81b2095', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:58.797456 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37126b26-cba8-4143-97cd-1c0e7f399c41 service cinder] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:58.797744 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37126b26-cba8-4143-97cd-1c0e7f399c41 service cinder] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:58.798089 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37126b26-cba8-4143-97cd-1c0e7f399c41 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:58.810715 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6a2422-be1a-4e93-9da5-93bd0783c65a admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:58.815653 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6174f1a8-a6ba-4e66-99fe-b7e0de216415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:58.816318 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6174f1a8-a6ba-4e66-99fe-b7e0de216415 admin admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:58.816606 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6174f1a8-a6ba-4e66-99fe-b7e0de216415 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:58.816886 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6174f1a8-a6ba-4e66-99fe-b7e0de216415 admin admin] PATH_INFO: `/v3/roles` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:58.817616 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6174f1a8-a6ba-4e66-99fe-b7e0de216415 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:58.819244 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6174f1a8-a6ba-4e66-99fe-b7e0de216415 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:58.833433 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 930/1868] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 17:25:58 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 17:25:58.834597 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6174f1a8-a6ba-4e66-99fe-b7e0de216415 admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:58.844224 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6174f1a8-a6ba-4e66-99fe-b7e0de216415 admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:58.848997 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a4ebf6-63d1-4a41-9b00-3974fba4bb24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:58.850002 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a4ebf6-63d1-4a41-9b00-3974fba4bb24 admin admin] REQUEST_METHOD: `PUT` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:58.850334 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a4ebf6-63d1-4a41-9b00-3974fba4bb24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:58.850569 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a4ebf6-63d1-4a41-9b00-3974fba4bb24 admin admin] PATH_INFO: `/v3/projects/e173bd794d754a5f89338566b2adc31c/users/c250dc598e2f4e5fa62c2aabb978fcae/roles/dba744f8ab2a4c45b9d3212f8d203aba` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:58.853363 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a4ebf6-63d1-4a41-9b00-3974fba4bb24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e173bd794d754a5f89338566b2adc31c, user_id=c250dc598e2f4e5fa62c2aabb978fcae, role_id=dba744f8ab2a4c45b9d3212f8d203aba)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:58.855755 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a4ebf6-63d1-4a41-9b00-3974fba4bb24 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:58.859153 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37126b26-cba8-4143-97cd-1c0e7f399c41 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:58.860596 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37126b26-cba8-4143-97cd-1c0e7f399c41 service cinder] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:58.868336 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 931/1869] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 17:25:58 2022] PUT /identity/v3/projects/e173bd794d754a5f89338566b2adc31c/users/c250dc598e2f4e5fa62c2aabb978fcae/roles/dba744f8ab2a4c45b9d3212f8d203aba => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:25:58.870488 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 939/1870] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:25:58 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:25:58.881465 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1209464-80bf-4cb9-ad57-b4e0a4db84a7 None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:58.881977 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1209464-80bf-4cb9-ad57-b4e0a4db84a7 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:58.882407 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1209464-80bf-4cb9-ad57-b4e0a4db84a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:58.898898 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37126b26-cba8-4143-97cd-1c0e7f399c41 service cinder] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:58.910744 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37126b26-cba8-4143-97cd-1c0e7f399c41 service cinder] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:58.916971 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-a1209464-80bf-4cb9-ad57-b4e0a4db84a7 None None] MFA Rules not processed for user `c250dc598e2f4e5fa62c2aabb978fcae`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:25:58.918357 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-a1209464-80bf-4cb9-ad57-b4e0a4db84a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:25:58.947577 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:25:59.000819 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16eee8f5-ee27-49d4-a269-a904cc5bb108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:59.001968 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eee8f5-ee27-49d4-a269-a904cc5bb108 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:59.002255 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eee8f5-ee27-49d4-a269-a904cc5bb108 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:59.002531 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eee8f5-ee27-49d4-a269-a904cc5bb108 admin admin] PATH_INFO: `/v3/users/419e5842ce8e4b06b6a089b9e7e83d31` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:59.003787 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16eee8f5-ee27-49d4-a269-a904cc5bb108 admin admin] RBAC: Authorizing `identity:delete_user(user_id=419e5842ce8e4b06b6a089b9e7e83d31)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:59.005776 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16eee8f5-ee27-49d4-a269-a904cc5bb108 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:59.011091 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 932/1871] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:25:58 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:25:59.220873 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1209464-80bf-4cb9-ad57-b4e0a4db84a7 None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:59.280912 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1209464-80bf-4cb9-ad57-b4e0a4db84a7 None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:59.293091 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cbb94b-921f-4c4c-95a5-1292cb0daf33 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef37136b89d34edc9cd94c7aa81b2095', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:59.293091 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cbb94b-921f-4c4c-95a5-1292cb0daf33 service cinder] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:59.293091 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cbb94b-921f-4c4c-95a5-1292cb0daf33 service cinder] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:59.293091 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cbb94b-921f-4c4c-95a5-1292cb0daf33 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:59.296029 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cbb94b-921f-4c4c-95a5-1292cb0daf33 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:59.297474 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cbb94b-921f-4c4c-95a5-1292cb0daf33 service cinder] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:59.308659 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 933/1872] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:25:59 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 17:25:59.328614 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-16eee8f5-ee27-49d4-a269-a904cc5bb108 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '419e5842ce8e4b06b6a089b9e7e83d31'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:25:59.329381 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-16eee8f5-ee27-49d4-a269-a904cc5bb108 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '419e5842ce8e4b06b6a089b9e7e83d31'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:25:59.330091 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-16eee8f5-ee27-49d4-a269-a904cc5bb108 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '419e5842ce8e4b06b6a089b9e7e83d31'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:25:59.415438 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-16eee8f5-ee27-49d4-a269-a904cc5bb108 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '419e5842ce8e4b06b6a089b9e7e83d31'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:25:59.424211 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-16eee8f5-ee27-49d4-a269-a904cc5bb108 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '419e5842ce8e4b06b6a089b9e7e83d31'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:25:59.442984 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 940/1873] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 16 17:25:58 2022] DELETE /identity/v3/users/419e5842ce8e4b06b6a089b9e7e83d31 => generated 0 bytes in 545 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:25:59.447528 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba09a941-c886-437c-92d0-3db2e4e0542a None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:59.447826 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba09a941-c886-437c-92d0-3db2e4e0542a None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:59.448183 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba09a941-c886-437c-92d0-3db2e4e0542a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:59.467187 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-ba09a941-c886-437c-92d0-3db2e4e0542a None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:25:59.468423 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-ba09a941-c886-437c-92d0-3db2e4e0542a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:25:59.528187 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 934/1874] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:25:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:25:59.538642 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16eee8f5-ee27-49d4-a269-a904cc5bb108 admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:25:59.545249 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-16eee8f5-ee27-49d4-a269-a904cc5bb108 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:25:59.602857 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16eee8f5-ee27-49d4-a269-a904cc5bb108 admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:25:59.606963 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ca8f62-71e3-4249-9f4d-adbc0f8a31db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5d25bfa8dc042329d57cd55fa7b7b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:25:59.607614 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ca8f62-71e3-4249-9f4d-adbc0f8a31db service neutron] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:25:59.607936 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ca8f62-71e3-4249-9f4d-adbc0f8a31db service neutron] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:25:59.608191 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ca8f62-71e3-4249-9f4d-adbc0f8a31db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:25:59.625802 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ca8f62-71e3-4249-9f4d-adbc0f8a31db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:25:59.626986 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ca8f62-71e3-4249-9f4d-adbc0f8a31db service neutron] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:25:59.638177 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 941/1875] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:25:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:26:00.267285 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba09a941-c886-437c-92d0-3db2e4e0542a None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:00.269170 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-ba09a941-c886-437c-92d0-3db2e4e0542a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:00.283599 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba09a941-c886-437c-92d0-3db2e4e0542a None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:00.288605 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1c28b4-4e66-4bdc-b194-281b13237381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:00.289672 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1c28b4-4e66-4bdc-b194-281b13237381 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:00.289997 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1c28b4-4e66-4bdc-b194-281b13237381 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:00.290276 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1c28b4-4e66-4bdc-b194-281b13237381 admin admin] PATH_INFO: `/v3/projects/e1e8117cec5d4927b93cb3fb6605d3dd` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:00.291475 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1c28b4-4e66-4bdc-b194-281b13237381 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1e8117cec5d4927b93cb3fb6605d3dd)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:00.293438 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1c28b4-4e66-4bdc-b194-281b13237381 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:00.491009 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-0e1c28b4-4e66-4bdc-b194-281b13237381 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1e8117cec5d4927b93cb3fb6605d3dd', 'request_id': 'req-0e1c28b4-4e66-4bdc-b194-281b13237381'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:00.496595 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-0e1c28b4-4e66-4bdc-b194-281b13237381 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1e8117cec5d4927b93cb3fb6605d3dd', 'request_id': 'req-0e1c28b4-4e66-4bdc-b194-281b13237381'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:00.672398 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-0e1c28b4-4e66-4bdc-b194-281b13237381 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1e8117cec5d4927b93cb3fb6605d3dd', 'request_id': 'req-0e1c28b4-4e66-4bdc-b194-281b13237381'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:00.684312 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-0e1c28b4-4e66-4bdc-b194-281b13237381 admin admin] The token cache is being invalidate because project e1e8117cec5d4927b93cb3fb6605d3dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80874) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 17:26:00.684603 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-0e1c28b4-4e66-4bdc-b194-281b13237381 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:00.685270 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-0e1c28b4-4e66-4bdc-b194-281b13237381 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:00.686873 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 935/1876] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 16 17:26:00 2022] DELETE /identity/v3/projects/e1e8117cec5d4927b93cb3fb6605d3dd => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:26:00.692157 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979d3d8b-dd86-42f4-b0a2-63511d5c9373 None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:00.692662 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979d3d8b-dd86-42f4-b0a2-63511d5c9373 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:00.692756 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979d3d8b-dd86-42f4-b0a2-63511d5c9373 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:00.710442 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-979d3d8b-dd86-42f4-b0a2-63511d5c9373 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:26:00.711653 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-979d3d8b-dd86-42f4-b0a2-63511d5c9373 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:00.773316 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 942/1877] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:26:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:26:00.782772 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f5978b-97fb-4b46-8c80-c615751a9e2c None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:00.783136 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f5978b-97fb-4b46-8c80-c615751a9e2c None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:00.783904 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f5978b-97fb-4b46-8c80-c615751a9e2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:00.802984 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-20f5978b-97fb-4b46-8c80-c615751a9e2c None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:26:00.806746 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-20f5978b-97fb-4b46-8c80-c615751a9e2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:00.812571 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 936/1878] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:26:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:26:00.816865 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979d3d8b-dd86-42f4-b0a2-63511d5c9373 None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:00.827132 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979d3d8b-dd86-42f4-b0a2-63511d5c9373 None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:00.831813 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6064b6-76f9-4e20-aee6-898fd2798ae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:00.832476 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6064b6-76f9-4e20-aee6-898fd2798ae7 admin admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:00.832768 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6064b6-76f9-4e20-aee6-898fd2798ae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:00.833055 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6064b6-76f9-4e20-aee6-898fd2798ae7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:00.833814 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6064b6-76f9-4e20-aee6-898fd2798ae7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80873) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:26:00.834128 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6064b6-76f9-4e20-aee6-898fd2798ae7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:00.835728 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6064b6-76f9-4e20-aee6-898fd2798ae7 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:00.848011 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 943/1879] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 16 17:26:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:26:00.852330 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f5978b-97fb-4b46-8c80-c615751a9e2c None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:00.863639 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f5978b-97fb-4b46-8c80-c615751a9e2c None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:00.871606 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc3f344-6ab5-4f30-a248-428361c408d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:00.872304 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc3f344-6ab5-4f30-a248-428361c408d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:00.872597 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc3f344-6ab5-4f30-a248-428361c408d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:00.872880 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc3f344-6ab5-4f30-a248-428361c408d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:00.873597 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc3f344-6ab5-4f30-a248-428361c408d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:00.875654 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc3f344-6ab5-4f30-a248-428361c408d4 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:00.998486 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 937/1880] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 16 17:26:00 2022] POST /identity/v3/projects => generated 371 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:26:01.002998 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6064b6-76f9-4e20-aee6-898fd2798ae7 admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:01.010237 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc3f344-6ab5-4f30-a248-428361c408d4 admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:01.011997 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-bdc3f344-6ab5-4f30-a248-428361c408d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:01.025390 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6064b6-76f9-4e20-aee6-898fd2798ae7 admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:01.063010 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:26:01.096832 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c408289f-e838-4a42-b2eb-b5a20cd42916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:01.097584 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c408289f-e838-4a42-b2eb-b5a20cd42916 admin admin] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:01.097816 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c408289f-e838-4a42-b2eb-b5a20cd42916 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:01.098226 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c408289f-e838-4a42-b2eb-b5a20cd42916 admin admin] PATH_INFO: `/v3/users` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:01.098989 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c408289f-e838-4a42-b2eb-b5a20cd42916 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:01.101050 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c408289f-e838-4a42-b2eb-b5a20cd42916 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:01.107830 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc3f344-6ab5-4f30-a248-428361c408d4 admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:01.113072 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63903ec-0ef8-405f-afb7-31441ca28ca2 tempest-VolumeQuotaClassesTest-821317134 tempest-VolumeQuotaClassesTest-821317134-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c250dc598e2f4e5fa62c2aabb978fcae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e173bd794d754a5f89338566b2adc31c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:01.113745 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63903ec-0ef8-405f-afb7-31441ca28ca2 tempest-VolumeQuotaClassesTest-821317134 tempest-VolumeQuotaClassesTest-821317134-project-admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:01.114096 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63903ec-0ef8-405f-afb7-31441ca28ca2 tempest-VolumeQuotaClassesTest-821317134 tempest-VolumeQuotaClassesTest-821317134-project-admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:01.114384 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63903ec-0ef8-405f-afb7-31441ca28ca2 tempest-VolumeQuotaClassesTest-821317134 tempest-VolumeQuotaClassesTest-821317134-project-admin] PATH_INFO: `/v3/domains` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:01.115130 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63903ec-0ef8-405f-afb7-31441ca28ca2 tempest-VolumeQuotaClassesTest-821317134 tempest-VolumeQuotaClassesTest-821317134-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:26:01.115449 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63903ec-0ef8-405f-afb7-31441ca28ca2 tempest-VolumeQuotaClassesTest-821317134 tempest-VolumeQuotaClassesTest-821317134-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:01.117066 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63903ec-0ef8-405f-afb7-31441ca28ca2 tempest-VolumeQuotaClassesTest-821317134 tempest-VolumeQuotaClassesTest-821317134-project-admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:01.131919 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 938/1881] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 16 17:26:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:26:01.131919 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63903ec-0ef8-405f-afb7-31441ca28ca2 tempest-VolumeQuotaClassesTest-821317134 tempest-VolumeQuotaClassesTest-821317134-project-admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:01.131919 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-d63903ec-0ef8-405f-afb7-31441ca28ca2 tempest-VolumeQuotaClassesTest-821317134 tempest-VolumeQuotaClassesTest-821317134-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:01.145908 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63903ec-0ef8-405f-afb7-31441ca28ca2 tempest-VolumeQuotaClassesTest-821317134 tempest-VolumeQuotaClassesTest-821317134-project-admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:01.150729 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec0d242-44b1-492a-aefc-13b3f9b5193b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:01.151614 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec0d242-44b1-492a-aefc-13b3f9b5193b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:01.151905 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec0d242-44b1-492a-aefc-13b3f9b5193b admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:01.152195 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec0d242-44b1-492a-aefc-13b3f9b5193b admin admin] PATH_INFO: `/v3/users/936f41c258a8473f858ff8640e27ed6a` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:01.154015 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec0d242-44b1-492a-aefc-13b3f9b5193b admin admin] RBAC: Authorizing `identity:delete_user(user_id=936f41c258a8473f858ff8640e27ed6a)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:01.155953 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec0d242-44b1-492a-aefc-13b3f9b5193b admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:01.183071 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 944/1882] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 16 17:26:01 2022] POST /identity/v3/users => generated 286 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 17:26:01.185858 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c408289f-e838-4a42-b2eb-b5a20cd42916 admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:01.195710 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c408289f-e838-4a42-b2eb-b5a20cd42916 admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:01.201135 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd0c2e9-c9fc-4539-9df0-6f9211d6b7f5 tempest-VolumeQuotaClassesTest-821317134 tempest-VolumeQuotaClassesTest-821317134-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c250dc598e2f4e5fa62c2aabb978fcae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e173bd794d754a5f89338566b2adc31c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:01.202217 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd0c2e9-c9fc-4539-9df0-6f9211d6b7f5 tempest-VolumeQuotaClassesTest-821317134 tempest-VolumeQuotaClassesTest-821317134-project-admin] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:01.202217 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd0c2e9-c9fc-4539-9df0-6f9211d6b7f5 tempest-VolumeQuotaClassesTest-821317134 tempest-VolumeQuotaClassesTest-821317134-project-admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:01.202540 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd0c2e9-c9fc-4539-9df0-6f9211d6b7f5 tempest-VolumeQuotaClassesTest-821317134 tempest-VolumeQuotaClassesTest-821317134-project-admin] PATH_INFO: `/v3/projects` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:01.203249 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd0c2e9-c9fc-4539-9df0-6f9211d6b7f5 tempest-VolumeQuotaClassesTest-821317134 tempest-VolumeQuotaClassesTest-821317134-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:01.205209 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd0c2e9-c9fc-4539-9df0-6f9211d6b7f5 tempest-VolumeQuotaClassesTest-821317134 tempest-VolumeQuotaClassesTest-821317134-project-admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:01.340250 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 945/1883] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 16 17:26:01 2022] POST /identity/v3/projects => generated 354 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:26:01.341194 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd0c2e9-c9fc-4539-9df0-6f9211d6b7f5 tempest-VolumeQuotaClassesTest-821317134 tempest-VolumeQuotaClassesTest-821317134-project-admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:01.389363 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-9ec0d242-44b1-492a-aefc-13b3f9b5193b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '936f41c258a8473f858ff8640e27ed6a'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:01.406866 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-9ec0d242-44b1-492a-aefc-13b3f9b5193b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '936f41c258a8473f858ff8640e27ed6a'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:01.437542 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd0c2e9-c9fc-4539-9df0-6f9211d6b7f5 tempest-VolumeQuotaClassesTest-821317134 tempest-VolumeQuotaClassesTest-821317134-project-admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:01.443333 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f703f5-9f86-4512-935b-2777ad5f50ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:01.444098 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f703f5-9f86-4512-935b-2777ad5f50ff admin admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:01.444456 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f703f5-9f86-4512-935b-2777ad5f50ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:01.444809 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f703f5-9f86-4512-935b-2777ad5f50ff admin admin] PATH_INFO: `/v3/roles` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:01.445616 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f703f5-9f86-4512-935b-2777ad5f50ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:01.447526 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f703f5-9f86-4512-935b-2777ad5f50ff admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:01.458750 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 946/1884] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 17:26:01 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:26:01.459817 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f703f5-9f86-4512-935b-2777ad5f50ff admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:01.521998 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f703f5-9f86-4512-935b-2777ad5f50ff admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:01.523710 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-9ec0d242-44b1-492a-aefc-13b3f9b5193b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '936f41c258a8473f858ff8640e27ed6a'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:01.524338 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-9ec0d242-44b1-492a-aefc-13b3f9b5193b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '936f41c258a8473f858ff8640e27ed6a'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:01.526736 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf4ab9b-cfaf-4f12-b41a-f6d31cff9190 tempest-VolumeQuotaClassesTest-821317134 tempest-VolumeQuotaClassesTest-821317134-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c250dc598e2f4e5fa62c2aabb978fcae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e173bd794d754a5f89338566b2adc31c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:01.527405 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf4ab9b-cfaf-4f12-b41a-f6d31cff9190 tempest-VolumeQuotaClassesTest-821317134 tempest-VolumeQuotaClassesTest-821317134-project-admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:01.527699 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf4ab9b-cfaf-4f12-b41a-f6d31cff9190 tempest-VolumeQuotaClassesTest-821317134 tempest-VolumeQuotaClassesTest-821317134-project-admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:01.528017 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf4ab9b-cfaf-4f12-b41a-f6d31cff9190 tempest-VolumeQuotaClassesTest-821317134 tempest-VolumeQuotaClassesTest-821317134-project-admin] PATH_INFO: `/v3/domains` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:01.528761 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf4ab9b-cfaf-4f12-b41a-f6d31cff9190 tempest-VolumeQuotaClassesTest-821317134 tempest-VolumeQuotaClassesTest-821317134-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80873) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:26:01.529082 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf4ab9b-cfaf-4f12-b41a-f6d31cff9190 tempest-VolumeQuotaClassesTest-821317134 tempest-VolumeQuotaClassesTest-821317134-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:01.530727 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf4ab9b-cfaf-4f12-b41a-f6d31cff9190 tempest-VolumeQuotaClassesTest-821317134 tempest-VolumeQuotaClassesTest-821317134-project-admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:01.538243 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-9ec0d242-44b1-492a-aefc-13b3f9b5193b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '936f41c258a8473f858ff8640e27ed6a'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:01.542197 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 947/1885] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 16 17:26:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:26:01.543019 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf4ab9b-cfaf-4f12-b41a-f6d31cff9190 tempest-VolumeQuotaClassesTest-821317134 tempest-VolumeQuotaClassesTest-821317134-project-admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:01.547719 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-8cf4ab9b-cfaf-4f12-b41a-f6d31cff9190 tempest-VolumeQuotaClassesTest-821317134 tempest-VolumeQuotaClassesTest-821317134-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:01.547861 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 939/1886] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 16 17:26:01 2022] DELETE /identity/v3/users/936f41c258a8473f858ff8640e27ed6a => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:26:01.549352 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76787401-b650-40c3-b29f-3606c3e46801 None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:01.549659 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76787401-b650-40c3-b29f-3606c3e46801 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:01.549985 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76787401-b650-40c3-b29f-3606c3e46801 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:01.566914 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf4ab9b-cfaf-4f12-b41a-f6d31cff9190 tempest-VolumeQuotaClassesTest-821317134 tempest-VolumeQuotaClassesTest-821317134-project-admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:01.568429 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-76787401-b650-40c3-b29f-3606c3e46801 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:26:01.569872 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-76787401-b650-40c3-b29f-3606c3e46801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:01.638461 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff11c9e5-bd42-43c5-862b-4575fb81fd32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:01.638755 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 940/1887] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:26:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 17:26:01.639481 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff11c9e5-bd42-43c5-862b-4575fb81fd32 admin admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:01.639718 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76787401-b650-40c3-b29f-3606c3e46801 None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:01.639906 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff11c9e5-bd42-43c5-862b-4575fb81fd32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:01.640323 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff11c9e5-bd42-43c5-862b-4575fb81fd32 admin admin] PATH_INFO: `/v3/roles` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:01.641081 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-76787401-b650-40c3-b29f-3606c3e46801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:01.641196 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff11c9e5-bd42-43c5-862b-4575fb81fd32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:01.647180 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff11c9e5-bd42-43c5-862b-4575fb81fd32 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:01.660867 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 948/1888] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 17:26:01 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:26:01.664784 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff11c9e5-bd42-43c5-862b-4575fb81fd32 admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:01.666737 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-ff11c9e5-bd42-43c5-862b-4575fb81fd32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:01.715621 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76787401-b650-40c3-b29f-3606c3e46801 None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:01.723101 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199f4de1-94ec-4cd6-9894-897db9483e92 tempest-VolumeQuotaClassesTest-821317134 tempest-VolumeQuotaClassesTest-821317134-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c250dc598e2f4e5fa62c2aabb978fcae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e173bd794d754a5f89338566b2adc31c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:01.724073 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199f4de1-94ec-4cd6-9894-897db9483e92 tempest-VolumeQuotaClassesTest-821317134 tempest-VolumeQuotaClassesTest-821317134-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:01.724466 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199f4de1-94ec-4cd6-9894-897db9483e92 tempest-VolumeQuotaClassesTest-821317134 tempest-VolumeQuotaClassesTest-821317134-project-admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:01.724826 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199f4de1-94ec-4cd6-9894-897db9483e92 tempest-VolumeQuotaClassesTest-821317134 tempest-VolumeQuotaClassesTest-821317134-project-admin] PATH_INFO: `/v3/projects/25f640b342d7423f9fe84f815bd7800f` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:01.726140 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199f4de1-94ec-4cd6-9894-897db9483e92 tempest-VolumeQuotaClassesTest-821317134 tempest-VolumeQuotaClassesTest-821317134-project-admin] RBAC: Authorizing `identity:delete_project(project_id=25f640b342d7423f9fe84f815bd7800f)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:01.727703 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff11c9e5-bd42-43c5-862b-4575fb81fd32 admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:01.728165 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199f4de1-94ec-4cd6-9894-897db9483e92 tempest-VolumeQuotaClassesTest-821317134 tempest-VolumeQuotaClassesTest-821317134-project-admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:01.732221 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb149fb-5bcd-4591-9403-52355e241df7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5d25bfa8dc042329d57cd55fa7b7b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:01.732945 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb149fb-5bcd-4591-9403-52355e241df7 service neutron] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:01.733353 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb149fb-5bcd-4591-9403-52355e241df7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:01.733646 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb149fb-5bcd-4591-9403-52355e241df7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:01.743752 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb149fb-5bcd-4591-9403-52355e241df7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:01.745478 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb149fb-5bcd-4591-9403-52355e241df7 service neutron] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:01.757590 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 949/1889] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:26:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:26:01.758745 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb149fb-5bcd-4591-9403-52355e241df7 service neutron] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:01.768014 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb149fb-5bcd-4591-9403-52355e241df7 service neutron] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:01.772688 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f6e6b3-ca8a-4d01-b5cf-0495a58f0eb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:01.773584 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f6e6b3-ca8a-4d01-b5cf-0495a58f0eb3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:01.773901 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f6e6b3-ca8a-4d01-b5cf-0495a58f0eb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:01.774271 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f6e6b3-ca8a-4d01-b5cf-0495a58f0eb3 admin admin] PATH_INFO: `/v3/projects/4c44554a010743e5bcd46ae3509cf3ee/users/cd403608595a4845b7577edd632dbd58/roles/896bff49c5d6464eb612a15f4aa9badc` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:01.790553 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f6e6b3-ca8a-4d01-b5cf-0495a58f0eb3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c44554a010743e5bcd46ae3509cf3ee, user_id=cd403608595a4845b7577edd632dbd58, role_id=896bff49c5d6464eb612a15f4aa9badc)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:01.793292 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f6e6b3-ca8a-4d01-b5cf-0495a58f0eb3 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:02.011126 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 950/1890] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 17:26:01 2022] PUT /identity/v3/projects/4c44554a010743e5bcd46ae3509cf3ee/users/cd403608595a4845b7577edd632dbd58/roles/896bff49c5d6464eb612a15f4aa9badc => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:26:02.018629 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-199f4de1-94ec-4cd6-9894-897db9483e92 tempest-VolumeQuotaClassesTest-821317134 tempest-VolumeQuotaClassesTest-821317134-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25f640b342d7423f9fe84f815bd7800f', 'request_id': 'req-199f4de1-94ec-4cd6-9894-897db9483e92'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:02.028877 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb26c71-ad10-4039-b291-b8f6aeb4d320 None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:02.028877 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb26c71-ad10-4039-b291-b8f6aeb4d320 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:02.028877 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb26c71-ad10-4039-b291-b8f6aeb4d320 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:02.029158 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-199f4de1-94ec-4cd6-9894-897db9483e92 tempest-VolumeQuotaClassesTest-821317134 tempest-VolumeQuotaClassesTest-821317134-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25f640b342d7423f9fe84f815bd7800f', 'request_id': 'req-199f4de1-94ec-4cd6-9894-897db9483e92'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:02.050975 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-8bb26c71-ad10-4039-b291-b8f6aeb4d320 None None] MFA Rules not processed for user `cd403608595a4845b7577edd632dbd58`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:26:02.052288 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-8bb26c71-ad10-4039-b291-b8f6aeb4d320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:02.135413 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 951/1891] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:26:02 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:26:02.150945 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb26c71-ad10-4039-b291-b8f6aeb4d320 None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:02.156315 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-199f4de1-94ec-4cd6-9894-897db9483e92 tempest-VolumeQuotaClassesTest-821317134 tempest-VolumeQuotaClassesTest-821317134-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25f640b342d7423f9fe84f815bd7800f', 'request_id': 'req-199f4de1-94ec-4cd6-9894-897db9483e92'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:02.159210 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-8bb26c71-ad10-4039-b291-b8f6aeb4d320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:02.176177 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-199f4de1-94ec-4cd6-9894-897db9483e92 tempest-VolumeQuotaClassesTest-821317134 tempest-VolumeQuotaClassesTest-821317134-project-admin] The token cache is being invalidate because project 25f640b342d7423f9fe84f815bd7800f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80874) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 17:26:02.176884 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-199f4de1-94ec-4cd6-9894-897db9483e92 tempest-VolumeQuotaClassesTest-821317134 tempest-VolumeQuotaClassesTest-821317134-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:02.178103 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-199f4de1-94ec-4cd6-9894-897db9483e92 tempest-VolumeQuotaClassesTest-821317134 tempest-VolumeQuotaClassesTest-821317134-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:02.185328 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 941/1892] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 16 17:26:01 2022] DELETE /identity/v3/projects/25f640b342d7423f9fe84f815bd7800f => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:26:02.257398 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb26c71-ad10-4039-b291-b8f6aeb4d320 None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:02.270713 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc84a41f-e6cf-47e6-9576-d9b74ab8d1ee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef37136b89d34edc9cd94c7aa81b2095', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:02.271435 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc84a41f-e6cf-47e6-9576-d9b74ab8d1ee service cinder] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:02.272161 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc84a41f-e6cf-47e6-9576-d9b74ab8d1ee service cinder] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:02.272161 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc84a41f-e6cf-47e6-9576-d9b74ab8d1ee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:02.277752 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-bc84a41f-e6cf-47e6-9576-d9b74ab8d1ee service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:02.294359 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc84a41f-e6cf-47e6-9576-d9b74ab8d1ee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:02.296220 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc84a41f-e6cf-47e6-9576-d9b74ab8d1ee service cinder] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:02.306769 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 952/1893] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:26:02 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:26:02.330033 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199f4de1-94ec-4cd6-9894-897db9483e92 tempest-VolumeQuotaClassesTest-821317134 tempest-VolumeQuotaClassesTest-821317134-project-admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:02.331693 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-199f4de1-94ec-4cd6-9894-897db9483e92 tempest-VolumeQuotaClassesTest-821317134 tempest-VolumeQuotaClassesTest-821317134-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:02.410582 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199f4de1-94ec-4cd6-9894-897db9483e92 tempest-VolumeQuotaClassesTest-821317134 tempest-VolumeQuotaClassesTest-821317134-project-admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:02.415912 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6af94f-eb2d-4b7c-9fb4-9c33479d55fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:02.417153 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6af94f-eb2d-4b7c-9fb4-9c33479d55fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:02.417450 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6af94f-eb2d-4b7c-9fb4-9c33479d55fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:02.417738 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6af94f-eb2d-4b7c-9fb4-9c33479d55fc admin admin] PATH_INFO: `/v3/users/cd403608595a4845b7577edd632dbd58` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:02.419680 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6af94f-eb2d-4b7c-9fb4-9c33479d55fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd403608595a4845b7577edd632dbd58)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:02.421626 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6af94f-eb2d-4b7c-9fb4-9c33479d55fc admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:02.476644 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:26:02.634117 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-df6af94f-eb2d-4b7c-9fb4-9c33479d55fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd403608595a4845b7577edd632dbd58'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:02.642101 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-df6af94f-eb2d-4b7c-9fb4-9c33479d55fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd403608595a4845b7577edd632dbd58'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:02.784876 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-df6af94f-eb2d-4b7c-9fb4-9c33479d55fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd403608595a4845b7577edd632dbd58'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:02.785456 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-df6af94f-eb2d-4b7c-9fb4-9c33479d55fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd403608595a4845b7577edd632dbd58'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:02.792208 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc84a41f-e6cf-47e6-9576-d9b74ab8d1ee service cinder] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:02.794732 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-bc84a41f-e6cf-47e6-9576-d9b74ab8d1ee service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:02.806027 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-df6af94f-eb2d-4b7c-9fb4-9c33479d55fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd403608595a4845b7577edd632dbd58'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:02.813985 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 942/1894] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 16 17:26:02 2022] DELETE /identity/v3/users/cd403608595a4845b7577edd632dbd58 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:26:02.817161 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc84a41f-e6cf-47e6-9576-d9b74ab8d1ee service cinder] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:02.817389 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10a6612-bb45-4425-80b3-d9af711e02b6 None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:02.817688 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10a6612-bb45-4425-80b3-d9af711e02b6 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:02.818091 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10a6612-bb45-4425-80b3-d9af711e02b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:02.840224 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-f10a6612-bb45-4425-80b3-d9af711e02b6 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:26:02.842177 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-f10a6612-bb45-4425-80b3-d9af711e02b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:02.906622 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe43b14-35af-40f0-9bc4-410a01ac86e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:02.907528 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe43b14-35af-40f0-9bc4-410a01ac86e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:02.907854 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe43b14-35af-40f0-9bc4-410a01ac86e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:02.908107 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe43b14-35af-40f0-9bc4-410a01ac86e1 admin admin] PATH_INFO: `/v3/projects/57584dc0f3574bf3be23b89e43e3fca6` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:02.915012 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe43b14-35af-40f0-9bc4-410a01ac86e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=57584dc0f3574bf3be23b89e43e3fca6)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:02.931286 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe43b14-35af-40f0-9bc4-410a01ac86e1 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:02.970024 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 943/1895] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:26:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 17:26:02.983100 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10a6612-bb45-4425-80b3-d9af711e02b6 None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:02.985328 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-f10a6612-bb45-4425-80b3-d9af711e02b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:03.066370 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10a6612-bb45-4425-80b3-d9af711e02b6 None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:03.071352 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9644ab-9ad0-4be2-89cb-2d6a9f9ef9c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5d25bfa8dc042329d57cd55fa7b7b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:03.072167 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9644ab-9ad0-4be2-89cb-2d6a9f9ef9c4 service neutron] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:03.072480 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9644ab-9ad0-4be2-89cb-2d6a9f9ef9c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:03.072783 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9644ab-9ad0-4be2-89cb-2d6a9f9ef9c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:03.084454 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9644ab-9ad0-4be2-89cb-2d6a9f9ef9c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:03.086022 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9644ab-9ad0-4be2-89cb-2d6a9f9ef9c4 service neutron] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:03.104214 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-1fe43b14-35af-40f0-9bc4-410a01ac86e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57584dc0f3574bf3be23b89e43e3fca6', 'request_id': 'req-1fe43b14-35af-40f0-9bc4-410a01ac86e1'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:03.117261 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-1fe43b14-35af-40f0-9bc4-410a01ac86e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57584dc0f3574bf3be23b89e43e3fca6', 'request_id': 'req-1fe43b14-35af-40f0-9bc4-410a01ac86e1'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:03.124957 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 944/1896] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:26:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 17:26:03.131878 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-1fe43b14-35af-40f0-9bc4-410a01ac86e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57584dc0f3574bf3be23b89e43e3fca6', 'request_id': 'req-1fe43b14-35af-40f0-9bc4-410a01ac86e1'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:04.272030 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-1fe43b14-35af-40f0-9bc4-410a01ac86e1 admin admin] The token cache is being invalidate because project 57584dc0f3574bf3be23b89e43e3fca6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80873) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 17:26:04.272698 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-1fe43b14-35af-40f0-9bc4-410a01ac86e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:04.273313 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-1fe43b14-35af-40f0-9bc4-410a01ac86e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:04.274939 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 953/1897] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 16 17:26:02 2022] DELETE /identity/v3/projects/57584dc0f3574bf3be23b89e43e3fca6 => generated 0 bytes in 1483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 17:26:04.288534 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9644ab-9ad0-4be2-89cb-2d6a9f9ef9c4 service neutron] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:04.291249 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-6a9644ab-9ad0-4be2-89cb-2d6a9f9ef9c4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:04.307196 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9644ab-9ad0-4be2-89cb-2d6a9f9ef9c4 service neutron] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:04.394879 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f2a614-b6e5-404e-a841-4973c334770a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:04.395786 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f2a614-b6e5-404e-a841-4973c334770a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:04.396072 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f2a614-b6e5-404e-a841-4973c334770a admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:04.396355 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f2a614-b6e5-404e-a841-4973c334770a admin admin] PATH_INFO: `/v3/users/e29f5efba5714c85995cd80a479435e0` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:04.400196 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f2a614-b6e5-404e-a841-4973c334770a admin admin] RBAC: Authorizing `identity:delete_user(user_id=e29f5efba5714c85995cd80a479435e0)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:04.403364 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f2a614-b6e5-404e-a841-4973c334770a admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:04.444902 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe43b14-35af-40f0-9bc4-410a01ac86e1 admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:04.450892 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-1fe43b14-35af-40f0-9bc4-410a01ac86e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:04.480252 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe43b14-35af-40f0-9bc4-410a01ac86e1 admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:04.487393 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c32b5bf-d897-4136-a917-e4a10e1e2074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:04.488525 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c32b5bf-d897-4136-a917-e4a10e1e2074 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:04.488791 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c32b5bf-d897-4136-a917-e4a10e1e2074 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:04.489084 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c32b5bf-d897-4136-a917-e4a10e1e2074 admin admin] PATH_INFO: `/v3/users/07e981de24464b1185d7f16190516126` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:04.490428 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c32b5bf-d897-4136-a917-e4a10e1e2074 admin admin] RBAC: Authorizing `identity:delete_user(user_id=07e981de24464b1185d7f16190516126)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:04.493190 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c32b5bf-d897-4136-a917-e4a10e1e2074 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:04.995448 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:26:05.010159 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-6c32b5bf-d897-4136-a917-e4a10e1e2074 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07e981de24464b1185d7f16190516126'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:05.011095 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-6c32b5bf-d897-4136-a917-e4a10e1e2074 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07e981de24464b1185d7f16190516126'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:05.012979 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-6c32b5bf-d897-4136-a917-e4a10e1e2074 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07e981de24464b1185d7f16190516126'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:05.029442 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-24f2a614-b6e5-404e-a841-4973c334770a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e29f5efba5714c85995cd80a479435e0'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:05.038200 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-24f2a614-b6e5-404e-a841-4973c334770a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e29f5efba5714c85995cd80a479435e0'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:05.134984 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-6c32b5bf-d897-4136-a917-e4a10e1e2074 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07e981de24464b1185d7f16190516126'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:05.147359 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-6c32b5bf-d897-4136-a917-e4a10e1e2074 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07e981de24464b1185d7f16190516126'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:05.165778 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 954/1898] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 16 17:26:04 2022] DELETE /identity/v3/users/07e981de24464b1185d7f16190516126 => generated 0 bytes in 721 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:26:05.167320 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e285994d-2c1c-413d-bdb4-f3ca9656d655 None None] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:05.167613 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e285994d-2c1c-413d-bdb4-f3ca9656d655 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:05.167898 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e285994d-2c1c-413d-bdb4-f3ca9656d655 None None] PATH_INFO: `/` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:05.169876 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 955/1899] 10.222.0.39 () {54 vars in 921 bytes} [Thu Jun 16 17:26:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:26:05.170680 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e285994d-2c1c-413d-bdb4-f3ca9656d655 None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:05.172376 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-e285994d-2c1c-413d-bdb4-f3ca9656d655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:05.227705 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-24f2a614-b6e5-404e-a841-4973c334770a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e29f5efba5714c85995cd80a479435e0'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:05.228429 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-24f2a614-b6e5-404e-a841-4973c334770a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e29f5efba5714c85995cd80a479435e0'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:05.248012 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-24f2a614-b6e5-404e-a841-4973c334770a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e29f5efba5714c85995cd80a479435e0'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:05.262803 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 945/1900] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 16 17:26:04 2022] DELETE /identity/v3/users/e29f5efba5714c85995cd80a479435e0 => generated 0 bytes in 970 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:26:05.262803 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87410baf-5cc7-4bbd-9e8f-ad7a2ccd39b7 None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:05.262803 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87410baf-5cc7-4bbd-9e8f-ad7a2ccd39b7 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:05.266457 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87410baf-5cc7-4bbd-9e8f-ad7a2ccd39b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:05.300880 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-87410baf-5cc7-4bbd-9e8f-ad7a2ccd39b7 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:26:05.306444 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-87410baf-5cc7-4bbd-9e8f-ad7a2ccd39b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:05.338036 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e285994d-2c1c-413d-bdb4-f3ca9656d655 None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:05.437539 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec2eadc-8f86-49ee-85a3-c3050f9e625b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:05.439601 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 946/1901] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:26:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:26:05.440733 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4ade74-06b0-44af-953e-847283c5f1f7 None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:05.441036 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4ade74-06b0-44af-953e-847283c5f1f7 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:05.442092 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4ade74-06b0-44af-953e-847283c5f1f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:05.442251 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec2eadc-8f86-49ee-85a3-c3050f9e625b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:05.447286 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec2eadc-8f86-49ee-85a3-c3050f9e625b admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:05.447286 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec2eadc-8f86-49ee-85a3-c3050f9e625b admin admin] PATH_INFO: `/v3/projects/4c44554a010743e5bcd46ae3509cf3ee` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:05.449053 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec2eadc-8f86-49ee-85a3-c3050f9e625b admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c44554a010743e5bcd46ae3509cf3ee)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:05.451876 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec2eadc-8f86-49ee-85a3-c3050f9e625b admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:05.480129 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-0e4ade74-06b0-44af-953e-847283c5f1f7 None None] MFA Rules not processed for user `3d381bb41dea4f1e90c3cf3815ac88dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:26:05.481425 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-0e4ade74-06b0-44af-953e-847283c5f1f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:05.565800 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 947/1902] 10.222.0.39 () {58 vars in 1018 bytes} [Thu Jun 16 17:26:05 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:26:05.566678 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4ade74-06b0-44af-953e-847283c5f1f7 None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:05.568157 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-0e4ade74-06b0-44af-953e-847283c5f1f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:05.618145 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-dec2eadc-8f86-49ee-85a3-c3050f9e625b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c44554a010743e5bcd46ae3509cf3ee', 'request_id': 'req-dec2eadc-8f86-49ee-85a3-c3050f9e625b'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:05.625378 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-dec2eadc-8f86-49ee-85a3-c3050f9e625b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c44554a010743e5bcd46ae3509cf3ee', 'request_id': 'req-dec2eadc-8f86-49ee-85a3-c3050f9e625b'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:05.634519 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-dec2eadc-8f86-49ee-85a3-c3050f9e625b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c44554a010743e5bcd46ae3509cf3ee', 'request_id': 'req-dec2eadc-8f86-49ee-85a3-c3050f9e625b'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:05.646147 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4ade74-06b0-44af-953e-847283c5f1f7 None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:05.705447 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e250223-fdd1-44a6-bb8b-f220447e1a1a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5d25bfa8dc042329d57cd55fa7b7b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:05.706153 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e250223-fdd1-44a6-bb8b-f220447e1a1a service neutron] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:05.706438 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e250223-fdd1-44a6-bb8b-f220447e1a1a service neutron] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:05.706717 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e250223-fdd1-44a6-bb8b-f220447e1a1a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:05.750674 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-dec2eadc-8f86-49ee-85a3-c3050f9e625b admin admin] The token cache is being invalidate because project 4c44554a010743e5bcd46ae3509cf3ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80873) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 17:26:05.751128 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-dec2eadc-8f86-49ee-85a3-c3050f9e625b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:05.751824 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-dec2eadc-8f86-49ee-85a3-c3050f9e625b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:05.756702 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 956/1903] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 16 17:26:05 2022] DELETE /identity/v3/projects/4c44554a010743e5bcd46ae3509cf3ee => generated 0 bytes in 583 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:26:05.756702 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec2eadc-8f86-49ee-85a3-c3050f9e625b admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:05.756702 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-dec2eadc-8f86-49ee-85a3-c3050f9e625b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:05.783976 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e250223-fdd1-44a6-bb8b-f220447e1a1a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:05.785429 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e250223-fdd1-44a6-bb8b-f220447e1a1a service neutron] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:05.797061 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 948/1904] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:26:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:26:05.798529 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e375df-5ac0-4560-9176-98e6e3b4771b None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:05.798841 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e375df-5ac0-4560-9176-98e6e3b4771b None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:05.799208 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e375df-5ac0-4560-9176-98e6e3b4771b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:05.820864 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-36e375df-5ac0-4560-9176-98e6e3b4771b None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:26:05.822380 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-36e375df-5ac0-4560-9176-98e6e3b4771b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:05.831899 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 949/1905] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:26:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:26:05.839902 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2383cbd1-65c1-49b0-9c47-82acf13ba6f2 None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:05.840300 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2383cbd1-65c1-49b0-9c47-82acf13ba6f2 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:05.841118 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2383cbd1-65c1-49b0-9c47-82acf13ba6f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:05.850199 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec2eadc-8f86-49ee-85a3-c3050f9e625b admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:05.857666 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3d7961-eb08-43ef-a6d2-6ee0bdf889f3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d381bb41dea4f1e90c3cf3815ac88dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:05.858682 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3d7961-eb08-43ef-a6d2-6ee0bdf889f3 service nova] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:05.859133 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3d7961-eb08-43ef-a6d2-6ee0bdf889f3 service nova] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:05.859569 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3d7961-eb08-43ef-a6d2-6ee0bdf889f3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:05.863941 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-bb3d7961-eb08-43ef-a6d2-6ee0bdf889f3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:05.869474 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-2383cbd1-65c1-49b0-9c47-82acf13ba6f2 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:26:05.870954 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-2383cbd1-65c1-49b0-9c47-82acf13ba6f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:05.880094 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3d7961-eb08-43ef-a6d2-6ee0bdf889f3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:05.882320 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3d7961-eb08-43ef-a6d2-6ee0bdf889f3 service nova] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:05.888880 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 950/1906] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:26:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:26:05.894663 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2383cbd1-65c1-49b0-9c47-82acf13ba6f2 None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:05.894663 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-2383cbd1-65c1-49b0-9c47-82acf13ba6f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:05.905279 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 957/1907] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:26:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:26:05.908198 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3d7961-eb08-43ef-a6d2-6ee0bdf889f3 service nova] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:05.911429 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2383cbd1-65c1-49b0-9c47-82acf13ba6f2 None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:05.922220 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f8a70b-c94d-47e1-82a0-a5b1b4d31173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:05.922220 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f8a70b-c94d-47e1-82a0-a5b1b4d31173 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:05.922220 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f8a70b-c94d-47e1-82a0-a5b1b4d31173 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:05.922220 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f8a70b-c94d-47e1-82a0-a5b1b4d31173 admin admin] PATH_INFO: `/v3/projects/92db484c6df7471caa4640cfc6f29bce` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:05.922704 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f8a70b-c94d-47e1-82a0-a5b1b4d31173 admin admin] RBAC: Authorizing `identity:delete_project(project_id=92db484c6df7471caa4640cfc6f29bce)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:05.925737 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3d7961-eb08-43ef-a6d2-6ee0bdf889f3 service nova] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:05.929100 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f8a70b-c94d-47e1-82a0-a5b1b4d31173 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:05.935776 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53225173-aab1-4892-8b5f-96471af7f522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:05.937717 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53225173-aab1-4892-8b5f-96471af7f522 admin admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:05.941827 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53225173-aab1-4892-8b5f-96471af7f522 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:05.943857 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53225173-aab1-4892-8b5f-96471af7f522 admin admin] PATH_INFO: `/v3/domains` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:05.948273 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53225173-aab1-4892-8b5f-96471af7f522 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80873) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:26:05.949223 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53225173-aab1-4892-8b5f-96471af7f522 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:05.954385 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53225173-aab1-4892-8b5f-96471af7f522 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:05.991627 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 958/1908] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 16 17:26:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:26:05.996206 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53225173-aab1-4892-8b5f-96471af7f522 admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:06.041984 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53225173-aab1-4892-8b5f-96471af7f522 admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:06.048498 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd558461-89c3-49b5-bb3a-f87962751d7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:06.049632 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd558461-89c3-49b5-bb3a-f87962751d7a admin admin] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:06.050073 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd558461-89c3-49b5-bb3a-f87962751d7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:06.050480 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd558461-89c3-49b5-bb3a-f87962751d7a admin admin] PATH_INFO: `/v3/projects` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:06.051305 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd558461-89c3-49b5-bb3a-f87962751d7a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:06.053522 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd558461-89c3-49b5-bb3a-f87962751d7a admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:06.223410 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-a4f8a70b-c94d-47e1-82a0-a5b1b4d31173 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92db484c6df7471caa4640cfc6f29bce', 'request_id': 'req-a4f8a70b-c94d-47e1-82a0-a5b1b4d31173'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:06.232226 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-a4f8a70b-c94d-47e1-82a0-a5b1b4d31173 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92db484c6df7471caa4640cfc6f29bce', 'request_id': 'req-a4f8a70b-c94d-47e1-82a0-a5b1b4d31173'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:06.243678 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 959/1909] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 16 17:26:05 2022] POST /identity/v3/projects => generated 383 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 17:26:06.251009 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd558461-89c3-49b5-bb3a-f87962751d7a admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:06.325491 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd558461-89c3-49b5-bb3a-f87962751d7a admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:06.331118 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749d70f5-de8d-4ea0-8c78-1c4c1d71c0c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:06.331970 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749d70f5-de8d-4ea0-8c78-1c4c1d71c0c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:06.332326 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749d70f5-de8d-4ea0-8c78-1c4c1d71c0c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:06.332677 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749d70f5-de8d-4ea0-8c78-1c4c1d71c0c3 admin admin] PATH_INFO: `/v3/users` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:06.338149 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749d70f5-de8d-4ea0-8c78-1c4c1d71c0c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:06.340311 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749d70f5-de8d-4ea0-8c78-1c4c1d71c0c3 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:06.350150 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-a4f8a70b-c94d-47e1-82a0-a5b1b4d31173 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92db484c6df7471caa4640cfc6f29bce', 'request_id': 'req-a4f8a70b-c94d-47e1-82a0-a5b1b4d31173'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:06.364566 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-a4f8a70b-c94d-47e1-82a0-a5b1b4d31173 admin admin] The token cache is being invalidate because project 92db484c6df7471caa4640cfc6f29bce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80874) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 17:26:06.364944 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-a4f8a70b-c94d-47e1-82a0-a5b1b4d31173 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:06.365678 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-a4f8a70b-c94d-47e1-82a0-a5b1b4d31173 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:06.368883 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 951/1910] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 16 17:26:05 2022] DELETE /identity/v3/projects/92db484c6df7471caa4640cfc6f29bce => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:26:06.374008 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f401dac2-a7ae-46b7-b95b-11b5d9809fd8 None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:06.374294 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f401dac2-a7ae-46b7-b95b-11b5d9809fd8 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:06.374575 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f401dac2-a7ae-46b7-b95b-11b5d9809fd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:06.394347 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-f401dac2-a7ae-46b7-b95b-11b5d9809fd8 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:26:06.395671 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-f401dac2-a7ae-46b7-b95b-11b5d9809fd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:06.412761 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 952/1911] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:26:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:26:06.414357 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5c1c7c-ba27-4ab4-9f0f-c5fe2b86b330 None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:06.414674 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5c1c7c-ba27-4ab4-9f0f-c5fe2b86b330 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:06.414983 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5c1c7c-ba27-4ab4-9f0f-c5fe2b86b330 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:06.436886 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-2a5c1c7c-ba27-4ab4-9f0f-c5fe2b86b330 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:26:06.438085 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-2a5c1c7c-ba27-4ab4-9f0f-c5fe2b86b330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:06.452899 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 960/1912] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 16 17:26:06 2022] POST /identity/v3/users => generated 292 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 17:26:06.453005 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:26:06.454172 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749d70f5-de8d-4ea0-8c78-1c4c1d71c0c3 admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:06.456221 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-749d70f5-de8d-4ea0-8c78-1c4c1d71c0c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:06.464554 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 953/1913] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:26:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:26:06.474249 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749d70f5-de8d-4ea0-8c78-1c4c1d71c0c3 admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:06.474394 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5c1c7c-ba27-4ab4-9f0f-c5fe2b86b330 None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:06.490245 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bfc534-ccbf-4ab2-bd3f-e06a4acb70a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:06.491372 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bfc534-ccbf-4ab2-bd3f-e06a4acb70a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:06.491804 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bfc534-ccbf-4ab2-bd3f-e06a4acb70a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:06.492256 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bfc534-ccbf-4ab2-bd3f-e06a4acb70a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:06.493372 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bfc534-ccbf-4ab2-bd3f-e06a4acb70a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:06.494246 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5c1c7c-ba27-4ab4-9f0f-c5fe2b86b330 None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:06.495814 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bfc534-ccbf-4ab2-bd3f-e06a4acb70a3 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:06.505242 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab086de-3d83-419b-a918-19056a93f360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:06.505902 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab086de-3d83-419b-a918-19056a93f360 admin admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:06.506332 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab086de-3d83-419b-a918-19056a93f360 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:06.506769 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab086de-3d83-419b-a918-19056a93f360 admin admin] PATH_INFO: `/v3/domains` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:06.513117 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab086de-3d83-419b-a918-19056a93f360 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:26:06.513117 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab086de-3d83-419b-a918-19056a93f360 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:06.513117 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab086de-3d83-419b-a918-19056a93f360 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:06.514022 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 961/1914] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 17:26:06 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:26:06.515009 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bfc534-ccbf-4ab2-bd3f-e06a4acb70a3 admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:06.527303 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bfc534-ccbf-4ab2-bd3f-e06a4acb70a3 admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:06.537799 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 954/1915] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 16 17:26:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:26:06.542657 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbb21dd-829c-4d08-a1fe-0572f070e11a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:06.542657 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbb21dd-829c-4d08-a1fe-0572f070e11a admin admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:06.542657 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbb21dd-829c-4d08-a1fe-0572f070e11a admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:06.542657 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbb21dd-829c-4d08-a1fe-0572f070e11a admin admin] PATH_INFO: `/v3/roles` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:06.542980 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbb21dd-829c-4d08-a1fe-0572f070e11a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:06.542980 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbb21dd-829c-4d08-a1fe-0572f070e11a admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:06.546602 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab086de-3d83-419b-a918-19056a93f360 admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:06.556714 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab086de-3d83-419b-a918-19056a93f360 admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:06.559829 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 962/1916] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 17:26:06 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:26:06.562464 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b3848a-30a0-496c-ac53-fdd5a3adf13a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:06.563334 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b3848a-30a0-496c-ac53-fdd5a3adf13a admin admin] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:06.563714 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b3848a-30a0-496c-ac53-fdd5a3adf13a admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:06.564109 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b3848a-30a0-496c-ac53-fdd5a3adf13a admin admin] PATH_INFO: `/v3/projects` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:06.565048 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b3848a-30a0-496c-ac53-fdd5a3adf13a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:06.567569 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b3848a-30a0-496c-ac53-fdd5a3adf13a admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:06.567687 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbb21dd-829c-4d08-a1fe-0572f070e11a admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:06.584088 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbb21dd-829c-4d08-a1fe-0572f070e11a admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:06.590925 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eecd4d2-9f63-4e14-a0f0-616cdcb9a5a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:06.591952 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eecd4d2-9f63-4e14-a0f0-616cdcb9a5a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:06.592302 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eecd4d2-9f63-4e14-a0f0-616cdcb9a5a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:06.592807 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eecd4d2-9f63-4e14-a0f0-616cdcb9a5a4 admin admin] PATH_INFO: `/v3/projects/9c96aa8da9934b92a77c568070814aaa/users/8bdb7b0603bc4bb5b3ad9b9a61d95dba/roles/896bff49c5d6464eb612a15f4aa9badc` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:06.624442 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eecd4d2-9f63-4e14-a0f0-616cdcb9a5a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c96aa8da9934b92a77c568070814aaa, user_id=8bdb7b0603bc4bb5b3ad9b9a61d95dba, role_id=896bff49c5d6464eb612a15f4aa9badc)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:06.628656 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eecd4d2-9f63-4e14-a0f0-616cdcb9a5a4 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:06.679507 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 955/1917] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 16 17:26:06 2022] POST /identity/v3/projects => generated 359 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 17:26:06.680340 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b3848a-30a0-496c-ac53-fdd5a3adf13a admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:06.687954 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-e5b3848a-30a0-496c-ac53-fdd5a3adf13a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:06.784381 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b3848a-30a0-496c-ac53-fdd5a3adf13a admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:06.804625 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a295623-0adc-451b-a86b-92e5df6956ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:06.804625 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a295623-0adc-451b-a86b-92e5df6956ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:06.804625 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a295623-0adc-451b-a86b-92e5df6956ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:06.804625 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a295623-0adc-451b-a86b-92e5df6956ba admin admin] PATH_INFO: `/v3/projects/552d1ef8b2ec499e9de7e9462bd6652f` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:06.804909 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a295623-0adc-451b-a86b-92e5df6956ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=552d1ef8b2ec499e9de7e9462bd6652f)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:06.804909 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a295623-0adc-451b-a86b-92e5df6956ba admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:06.806562 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 963/1918] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 17:26:06 2022] PUT /identity/v3/projects/9c96aa8da9934b92a77c568070814aaa/users/8bdb7b0603bc4bb5b3ad9b9a61d95dba/roles/896bff49c5d6464eb612a15f4aa9badc => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 17:26:06.807888 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eecd4d2-9f63-4e14-a0f0-616cdcb9a5a4 admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:06.892449 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eecd4d2-9f63-4e14-a0f0-616cdcb9a5a4 admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:06.898008 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6ac83c-5f62-4713-a3e3-5a224b00fca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:06.898972 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6ac83c-5f62-4713-a3e3-5a224b00fca5 admin admin] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:06.899390 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6ac83c-5f62-4713-a3e3-5a224b00fca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:06.899568 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6ac83c-5f62-4713-a3e3-5a224b00fca5 admin admin] PATH_INFO: `/v3/users` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:06.900266 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6ac83c-5f62-4713-a3e3-5a224b00fca5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:06.902268 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6ac83c-5f62-4713-a3e3-5a224b00fca5 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:06.970612 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-5a295623-0adc-451b-a86b-92e5df6956ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '552d1ef8b2ec499e9de7e9462bd6652f', 'request_id': 'req-5a295623-0adc-451b-a86b-92e5df6956ba'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:06.976761 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-5a295623-0adc-451b-a86b-92e5df6956ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '552d1ef8b2ec499e9de7e9462bd6652f', 'request_id': 'req-5a295623-0adc-451b-a86b-92e5df6956ba'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:07.007769 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 964/1919] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 16 17:26:06 2022] POST /identity/v3/users => generated 280 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:26:07.007769 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f3f9c0-ca32-4a44-8bf5-554ca9a1d48b None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:07.007769 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f3f9c0-ca32-4a44-8bf5-554ca9a1d48b None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:07.007769 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f3f9c0-ca32-4a44-8bf5-554ca9a1d48b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:07.036974 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-e6f3f9c0-ca32-4a44-8bf5-554ca9a1d48b None None] MFA Rules not processed for user `8bdb7b0603bc4bb5b3ad9b9a61d95dba`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:26:07.038410 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-e6f3f9c0-ca32-4a44-8bf5-554ca9a1d48b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:07.072953 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-5a295623-0adc-451b-a86b-92e5df6956ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '552d1ef8b2ec499e9de7e9462bd6652f', 'request_id': 'req-5a295623-0adc-451b-a86b-92e5df6956ba'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:07.090238 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-5a295623-0adc-451b-a86b-92e5df6956ba admin admin] The token cache is being invalidate because project 552d1ef8b2ec499e9de7e9462bd6652f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80874) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 17:26:07.090580 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-5a295623-0adc-451b-a86b-92e5df6956ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:07.091354 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-5a295623-0adc-451b-a86b-92e5df6956ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:07.093356 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 956/1920] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 16 17:26:06 2022] DELETE /identity/v3/projects/552d1ef8b2ec499e9de7e9462bd6652f => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:26:07.094174 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a295623-0adc-451b-a86b-92e5df6956ba admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:07.095561 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-5a295623-0adc-451b-a86b-92e5df6956ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:07.147621 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 965/1921] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:26:07 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:26:07.148965 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f3f9c0-ca32-4a44-8bf5-554ca9a1d48b None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:07.150899 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-e6f3f9c0-ca32-4a44-8bf5-554ca9a1d48b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:07.183490 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a295623-0adc-451b-a86b-92e5df6956ba admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:07.189128 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d13a82-8ac5-48a3-bc11-8476fc65ec06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:07.189831 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d13a82-8ac5-48a3-bc11-8476fc65ec06 admin admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:07.190120 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d13a82-8ac5-48a3-bc11-8476fc65ec06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:07.190692 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d13a82-8ac5-48a3-bc11-8476fc65ec06 admin admin] PATH_INFO: `/v3/roles` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:07.191430 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d13a82-8ac5-48a3-bc11-8476fc65ec06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:07.193018 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d13a82-8ac5-48a3-bc11-8476fc65ec06 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:07.204021 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 957/1922] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 17:26:07 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:26:07.204866 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d13a82-8ac5-48a3-bc11-8476fc65ec06 admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:07.207548 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-f1d13a82-8ac5-48a3-bc11-8476fc65ec06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:07.228441 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d13a82-8ac5-48a3-bc11-8476fc65ec06 admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:07.234809 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e678a1b-cc53-4aa0-901a-80c32c22375b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:07.235498 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e678a1b-cc53-4aa0-901a-80c32c22375b admin admin] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:07.235789 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e678a1b-cc53-4aa0-901a-80c32c22375b admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:07.236139 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e678a1b-cc53-4aa0-901a-80c32c22375b admin admin] PATH_INFO: `/v3/projects` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:07.237171 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e678a1b-cc53-4aa0-901a-80c32c22375b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:07.239308 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e678a1b-cc53-4aa0-901a-80c32c22375b admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:07.241180 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f3f9c0-ca32-4a44-8bf5-554ca9a1d48b None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:07.246992 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e129ea17-b90a-4f9a-877e-b350a3761e0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:07.248258 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e129ea17-b90a-4f9a-877e-b350a3761e0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:07.248508 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e129ea17-b90a-4f9a-877e-b350a3761e0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:07.248901 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e129ea17-b90a-4f9a-877e-b350a3761e0d admin admin] PATH_INFO: `/v3/users/c250dc598e2f4e5fa62c2aabb978fcae` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:07.250387 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e129ea17-b90a-4f9a-877e-b350a3761e0d admin admin] RBAC: Authorizing `identity:delete_user(user_id=c250dc598e2f4e5fa62c2aabb978fcae)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:07.253246 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e129ea17-b90a-4f9a-877e-b350a3761e0d admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:07.402208 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 958/1923] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 16 17:26:07 2022] POST /identity/v3/projects => generated 383 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:26:07.402208 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e678a1b-cc53-4aa0-901a-80c32c22375b admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:07.409494 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:26:07.475770 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e678a1b-cc53-4aa0-901a-80c32c22375b admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:07.480773 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb18320-3e34-41c9-ad04-bf301cfa5b60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:07.481973 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb18320-3e34-41c9-ad04-bf301cfa5b60 admin admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:07.482279 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb18320-3e34-41c9-ad04-bf301cfa5b60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:07.482581 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb18320-3e34-41c9-ad04-bf301cfa5b60 admin admin] PATH_INFO: `/v3/roles` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:07.483299 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb18320-3e34-41c9-ad04-bf301cfa5b60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:07.485310 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb18320-3e34-41c9-ad04-bf301cfa5b60 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:07.492258 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-e129ea17-b90a-4f9a-877e-b350a3761e0d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c250dc598e2f4e5fa62c2aabb978fcae'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:07.493598 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-e129ea17-b90a-4f9a-877e-b350a3761e0d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c250dc598e2f4e5fa62c2aabb978fcae'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:07.494481 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-e129ea17-b90a-4f9a-877e-b350a3761e0d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c250dc598e2f4e5fa62c2aabb978fcae'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:07.497385 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 959/1924] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 17:26:07 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:26:07.498241 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb18320-3e34-41c9-ad04-bf301cfa5b60 admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:07.500750 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-6eb18320-3e34-41c9-ad04-bf301cfa5b60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:07.518616 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb18320-3e34-41c9-ad04-bf301cfa5b60 admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:07.523766 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8430c4-4569-4637-ab56-8b6b6b3daad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:07.524470 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8430c4-4569-4637-ab56-8b6b6b3daad0 admin admin] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:07.527995 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8430c4-4569-4637-ab56-8b6b6b3daad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:07.527995 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8430c4-4569-4637-ab56-8b6b6b3daad0 admin admin] PATH_INFO: `/v3/users` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:07.527995 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8430c4-4569-4637-ab56-8b6b6b3daad0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:07.528345 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8430c4-4569-4637-ab56-8b6b6b3daad0 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:07.595555 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-e129ea17-b90a-4f9a-877e-b350a3761e0d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c250dc598e2f4e5fa62c2aabb978fcae'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:07.603021 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-e129ea17-b90a-4f9a-877e-b350a3761e0d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c250dc598e2f4e5fa62c2aabb978fcae'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:07.622391 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 966/1925] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 16 17:26:07 2022] DELETE /identity/v3/users/c250dc598e2f4e5fa62c2aabb978fcae => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:26:07.626197 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e129ea17-b90a-4f9a-877e-b350a3761e0d admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:07.627687 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-e129ea17-b90a-4f9a-877e-b350a3761e0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:07.670588 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 960/1926] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 16 17:26:07 2022] POST /identity/v3/users => generated 292 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:26:07.671896 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8430c4-4569-4637-ab56-8b6b6b3daad0 admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:07.683299 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8430c4-4569-4637-ab56-8b6b6b3daad0 admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:07.723766 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e129ea17-b90a-4f9a-877e-b350a3761e0d admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:07.728943 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07513632-4867-4264-9a87-4d0467412ef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:07.733420 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07513632-4867-4264-9a87-4d0467412ef4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:07.733636 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07513632-4867-4264-9a87-4d0467412ef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:07.734347 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07513632-4867-4264-9a87-4d0467412ef4 admin admin] PATH_INFO: `/v3/projects/f2a9bf8be15d4459b2e8090a62a6ac0f/users/f8413b5fc5604468ab2c1a99f3e976e4/roles/896bff49c5d6464eb612a15f4aa9badc` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:07.753056 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07513632-4867-4264-9a87-4d0467412ef4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2a9bf8be15d4459b2e8090a62a6ac0f, user_id=f8413b5fc5604468ab2c1a99f3e976e4, role_id=896bff49c5d6464eb612a15f4aa9badc)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:07.757337 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07513632-4867-4264-9a87-4d0467412ef4 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:07.761084 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c31be3d-6fc7-443c-b9ff-3c46723b4403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:07.761805 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c31be3d-6fc7-443c-b9ff-3c46723b4403 admin admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:07.762943 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c31be3d-6fc7-443c-b9ff-3c46723b4403 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:07.763276 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c31be3d-6fc7-443c-b9ff-3c46723b4403 admin admin] PATH_INFO: `/v3/roles` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:07.764029 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c31be3d-6fc7-443c-b9ff-3c46723b4403 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:07.765937 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c31be3d-6fc7-443c-b9ff-3c46723b4403 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:07.779024 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 961/1927] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 17:26:07 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 17:26:07.783467 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c31be3d-6fc7-443c-b9ff-3c46723b4403 admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:07.793429 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c31be3d-6fc7-443c-b9ff-3c46723b4403 admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:07.798932 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8fa509-7e20-4670-a6cd-ae7debc51655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:07.799778 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8fa509-7e20-4670-a6cd-ae7debc51655 admin admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:07.800151 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8fa509-7e20-4670-a6cd-ae7debc51655 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:07.800519 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8fa509-7e20-4670-a6cd-ae7debc51655 admin admin] PATH_INFO: `/v3/roles` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:07.801340 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8fa509-7e20-4670-a6cd-ae7debc51655 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:07.803239 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8fa509-7e20-4670-a6cd-ae7debc51655 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:07.814409 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 962/1928] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 17:26:07 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 17:26:07.818330 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8fa509-7e20-4670-a6cd-ae7debc51655 admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:07.828892 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8fa509-7e20-4670-a6cd-ae7debc51655 admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:07.833929 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6876bf7f-a5bb-4a8a-9e71-ed23eeb7eadf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:07.840914 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6876bf7f-a5bb-4a8a-9e71-ed23eeb7eadf admin admin] REQUEST_METHOD: `PUT` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:07.840914 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6876bf7f-a5bb-4a8a-9e71-ed23eeb7eadf admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:07.840914 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6876bf7f-a5bb-4a8a-9e71-ed23eeb7eadf admin admin] PATH_INFO: `/v3/projects/18b9f518f5ee47da8a7b044ae7a836d2/users/2bca5cf9ce804f21b002bee9ff5f7dfa/roles/896bff49c5d6464eb612a15f4aa9badc` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:07.852398 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6876bf7f-a5bb-4a8a-9e71-ed23eeb7eadf admin admin] RBAC: Authorizing `identity:create_grant(project_id=18b9f518f5ee47da8a7b044ae7a836d2, user_id=2bca5cf9ce804f21b002bee9ff5f7dfa, role_id=896bff49c5d6464eb612a15f4aa9badc)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:07.855262 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6876bf7f-a5bb-4a8a-9e71-ed23eeb7eadf admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:07.879788 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 967/1929] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 17:26:07 2022] PUT /identity/v3/projects/f2a9bf8be15d4459b2e8090a62a6ac0f/users/f8413b5fc5604468ab2c1a99f3e976e4/roles/896bff49c5d6464eb612a15f4aa9badc => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:26:07.899541 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5acceb6-98e2-4b5b-a80e-7117f25ee476 None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:07.904024 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5acceb6-98e2-4b5b-a80e-7117f25ee476 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:07.904024 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5acceb6-98e2-4b5b-a80e-7117f25ee476 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:07.951031 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-b5acceb6-98e2-4b5b-a80e-7117f25ee476 None None] MFA Rules not processed for user `f8413b5fc5604468ab2c1a99f3e976e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:26:07.952272 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-b5acceb6-98e2-4b5b-a80e-7117f25ee476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:07.965019 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 963/1930] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 17:26:07 2022] PUT /identity/v3/projects/18b9f518f5ee47da8a7b044ae7a836d2/users/2bca5cf9ce804f21b002bee9ff5f7dfa/roles/896bff49c5d6464eb612a15f4aa9badc => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 17:26:07.979509 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f899e7e-8be1-46af-8c30-34c2fc4e642a None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:07.979909 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f899e7e-8be1-46af-8c30-34c2fc4e642a None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:07.980605 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f899e7e-8be1-46af-8c30-34c2fc4e642a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:08.022337 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-3f899e7e-8be1-46af-8c30-34c2fc4e642a None None] MFA Rules not processed for user `2bca5cf9ce804f21b002bee9ff5f7dfa`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:26:08.025024 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-3f899e7e-8be1-46af-8c30-34c2fc4e642a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:08.112250 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 968/1931] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:26:07 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:26:08.152518 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5acceb6-98e2-4b5b-a80e-7117f25ee476 None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:08.153384 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-b5acceb6-98e2-4b5b-a80e-7117f25ee476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:08.176620 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:26:08.182482 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 964/1932] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:26:07 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:26:08.187954 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f899e7e-8be1-46af-8c30-34c2fc4e642a None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:08.252447 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5acceb6-98e2-4b5b-a80e-7117f25ee476 None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:08.256520 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d283b788-fcc9-480e-b5f1-a51aac8648ab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef37136b89d34edc9cd94c7aa81b2095', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:08.257189 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d283b788-fcc9-480e-b5f1-a51aac8648ab service cinder] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:08.257472 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d283b788-fcc9-480e-b5f1-a51aac8648ab service cinder] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:08.257819 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d283b788-fcc9-480e-b5f1-a51aac8648ab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:08.261573 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:26:08.267602 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d283b788-fcc9-480e-b5f1-a51aac8648ab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:08.269118 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d283b788-fcc9-480e-b5f1-a51aac8648ab service cinder] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:08.273244 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f899e7e-8be1-46af-8c30-34c2fc4e642a None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:08.278481 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 969/1933] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:26:08 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:26:08.280247 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7b8313-562c-47c8-837b-4c9335b26e08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:08.280923 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7b8313-562c-47c8-837b-4c9335b26e08 admin admin] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:08.281207 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7b8313-562c-47c8-837b-4c9335b26e08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:08.281481 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7b8313-562c-47c8-837b-4c9335b26e08 admin admin] PATH_INFO: `/v3/projects` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:08.282221 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7b8313-562c-47c8-837b-4c9335b26e08 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:08.284227 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7b8313-562c-47c8-837b-4c9335b26e08 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:08.292627 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d283b788-fcc9-480e-b5f1-a51aac8648ab service cinder] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:08.306632 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d283b788-fcc9-480e-b5f1-a51aac8648ab service cinder] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:08.313714 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b62f034-711d-4a54-8949-27255b92bae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:08.314968 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b62f034-711d-4a54-8949-27255b92bae9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:08.315329 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b62f034-711d-4a54-8949-27255b92bae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:08.315684 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b62f034-711d-4a54-8949-27255b92bae9 admin admin] PATH_INFO: `/v3/users/f8413b5fc5604468ab2c1a99f3e976e4` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:08.318201 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b62f034-711d-4a54-8949-27255b92bae9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8413b5fc5604468ab2c1a99f3e976e4)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:08.320958 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b62f034-711d-4a54-8949-27255b92bae9 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:08.415228 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 965/1934] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 16 17:26:08 2022] POST /identity/v3/projects => generated 383 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 17:26:08.416101 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7b8313-562c-47c8-837b-4c9335b26e08 admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:08.420832 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-8d7b8313-562c-47c8-837b-4c9335b26e08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:08.535619 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7b8313-562c-47c8-837b-4c9335b26e08 admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:08.552552 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac9ad7d-3eb5-4dd5-9ce4-4c263857752e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:08.554635 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac9ad7d-3eb5-4dd5-9ce4-4c263857752e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:08.554939 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac9ad7d-3eb5-4dd5-9ce4-4c263857752e admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:08.555414 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac9ad7d-3eb5-4dd5-9ce4-4c263857752e admin admin] PATH_INFO: `/v3/projects/e173bd794d754a5f89338566b2adc31c` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:08.556767 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac9ad7d-3eb5-4dd5-9ce4-4c263857752e admin admin] RBAC: Authorizing `identity:delete_project(project_id=e173bd794d754a5f89338566b2adc31c)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:08.560828 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac9ad7d-3eb5-4dd5-9ce4-4c263857752e admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:08.584336 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-5b62f034-711d-4a54-8949-27255b92bae9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8413b5fc5604468ab2c1a99f3e976e4'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:08.585870 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-5b62f034-711d-4a54-8949-27255b92bae9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8413b5fc5604468ab2c1a99f3e976e4'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:08.587123 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-5b62f034-711d-4a54-8949-27255b92bae9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8413b5fc5604468ab2c1a99f3e976e4'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:08.727041 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-5b62f034-711d-4a54-8949-27255b92bae9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8413b5fc5604468ab2c1a99f3e976e4'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:08.751803 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-5b62f034-711d-4a54-8949-27255b92bae9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8413b5fc5604468ab2c1a99f3e976e4'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:08.751925 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-9ac9ad7d-3eb5-4dd5-9ce4-4c263857752e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e173bd794d754a5f89338566b2adc31c', 'request_id': 'req-9ac9ad7d-3eb5-4dd5-9ce4-4c263857752e'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:08.753837 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-9ac9ad7d-3eb5-4dd5-9ce4-4c263857752e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e173bd794d754a5f89338566b2adc31c', 'request_id': 'req-9ac9ad7d-3eb5-4dd5-9ce4-4c263857752e'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:08.757427 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 970/1935] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 16 17:26:08 2022] DELETE /identity/v3/users/f8413b5fc5604468ab2c1a99f3e976e4 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:26:08.758223 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b62f034-711d-4a54-8949-27255b92bae9 admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:08.760093 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-5b62f034-711d-4a54-8949-27255b92bae9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:08.832421 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b62f034-711d-4a54-8949-27255b92bae9 admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:08.838343 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-9ac9ad7d-3eb5-4dd5-9ce4-4c263857752e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e173bd794d754a5f89338566b2adc31c', 'request_id': 'req-9ac9ad7d-3eb5-4dd5-9ce4-4c263857752e'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:08.839751 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58c2729-00ea-44c5-ae2d-8d42e78bfee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:08.841587 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58c2729-00ea-44c5-ae2d-8d42e78bfee1 admin admin] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:08.841587 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58c2729-00ea-44c5-ae2d-8d42e78bfee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:08.842025 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58c2729-00ea-44c5-ae2d-8d42e78bfee1 admin admin] PATH_INFO: `/v3/users` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:08.842700 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58c2729-00ea-44c5-ae2d-8d42e78bfee1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:08.845066 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58c2729-00ea-44c5-ae2d-8d42e78bfee1 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:08.853500 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-9ac9ad7d-3eb5-4dd5-9ce4-4c263857752e admin admin] The token cache is being invalidate because project e173bd794d754a5f89338566b2adc31c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80874) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 17:26:08.853934 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-9ac9ad7d-3eb5-4dd5-9ce4-4c263857752e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:08.854638 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-9ac9ad7d-3eb5-4dd5-9ce4-4c263857752e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:08.859916 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 966/1936] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 16 17:26:08 2022] DELETE /identity/v3/projects/e173bd794d754a5f89338566b2adc31c => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:26:08.859916 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c29165-a8df-4c6d-9450-051c800cb66c None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:08.859916 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c29165-a8df-4c6d-9450-051c800cb66c None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:08.859916 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c29165-a8df-4c6d-9450-051c800cb66c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:08.877262 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-49c29165-a8df-4c6d-9450-051c800cb66c None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:26:08.878980 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-49c29165-a8df-4c6d-9450-051c800cb66c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:08.894008 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 967/1937] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:26:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:26:08.894008 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96c83af-81c2-4e07-b6e2-00c505cec564 None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:08.894008 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96c83af-81c2-4e07-b6e2-00c505cec564 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:08.894008 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96c83af-81c2-4e07-b6e2-00c505cec564 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:08.925598 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-d96c83af-81c2-4e07-b6e2-00c505cec564 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:26:08.928505 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-d96c83af-81c2-4e07-b6e2-00c505cec564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:08.943164 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 968/1938] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:26:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:26:08.944139 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96c83af-81c2-4e07-b6e2-00c505cec564 None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:08.946262 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-d96c83af-81c2-4e07-b6e2-00c505cec564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:09.031544 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96c83af-81c2-4e07-b6e2-00c505cec564 None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:09.035631 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926f480e-15d6-402f-947e-9fc88b430be0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5d25bfa8dc042329d57cd55fa7b7b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:09.036804 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926f480e-15d6-402f-947e-9fc88b430be0 service neutron] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:09.036804 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926f480e-15d6-402f-947e-9fc88b430be0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:09.037146 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926f480e-15d6-402f-947e-9fc88b430be0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:09.047947 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926f480e-15d6-402f-947e-9fc88b430be0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:09.049450 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926f480e-15d6-402f-947e-9fc88b430be0 service neutron] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:09.059842 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 969/1939] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:26:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:26:09.061200 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37dc029-2bd2-4225-b233-7b3fdeb1d4a2 None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:09.061784 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37dc029-2bd2-4225-b233-7b3fdeb1d4a2 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:09.061896 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37dc029-2bd2-4225-b233-7b3fdeb1d4a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:09.082297 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 971/1940] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 16 17:26:08 2022] POST /identity/v3/users => generated 298 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:26:09.082462 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-f37dc029-2bd2-4225-b233-7b3fdeb1d4a2 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:26:09.083142 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-f37dc029-2bd2-4225-b233-7b3fdeb1d4a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:09.083630 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58c2729-00ea-44c5-ae2d-8d42e78bfee1 admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:09.085339 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-d58c2729-00ea-44c5-ae2d-8d42e78bfee1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:09.093584 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 970/1941] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:26:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:26:09.097645 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37dc029-2bd2-4225-b233-7b3fdeb1d4a2 None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:09.099105 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58c2729-00ea-44c5-ae2d-8d42e78bfee1 admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:09.108696 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6165ed0-727b-465f-bde0-b6110ddb2113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:09.108696 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6165ed0-727b-465f-bde0-b6110ddb2113 admin admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:09.108696 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6165ed0-727b-465f-bde0-b6110ddb2113 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:09.108696 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6165ed0-727b-465f-bde0-b6110ddb2113 admin admin] PATH_INFO: `/v3/roles` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:09.109111 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6165ed0-727b-465f-bde0-b6110ddb2113 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:09.109193 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37dc029-2bd2-4225-b233-7b3fdeb1d4a2 None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:09.109284 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6165ed0-727b-465f-bde0-b6110ddb2113 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:09.113165 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16979178-0232-4920-903f-5e22af3801fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:09.113898 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16979178-0232-4920-903f-5e22af3801fe admin admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:09.114194 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16979178-0232-4920-903f-5e22af3801fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:09.114481 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16979178-0232-4920-903f-5e22af3801fe admin admin] PATH_INFO: `/v3/domains` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:09.115227 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16979178-0232-4920-903f-5e22af3801fe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:26:09.115547 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16979178-0232-4920-903f-5e22af3801fe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:09.117185 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16979178-0232-4920-903f-5e22af3801fe admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:09.122879 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 972/1942] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 17:26:09 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:26:09.124220 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6165ed0-727b-465f-bde0-b6110ddb2113 admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:09.132057 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 971/1943] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 16 17:26:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 17:26:09.138201 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6165ed0-727b-465f-bde0-b6110ddb2113 admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:09.142492 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16979178-0232-4920-903f-5e22af3801fe admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:09.153711 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16979178-0232-4920-903f-5e22af3801fe admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:09.159812 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54259cd-508e-4f12-b7f0-0c985bc3e04c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:09.160382 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f641012-d662-4488-9905-fbe797528dfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:09.160672 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54259cd-508e-4f12-b7f0-0c985bc3e04c admin admin] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:09.160969 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54259cd-508e-4f12-b7f0-0c985bc3e04c admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:09.161257 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54259cd-508e-4f12-b7f0-0c985bc3e04c admin admin] PATH_INFO: `/v3/projects` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:09.161734 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f641012-d662-4488-9905-fbe797528dfc admin admin] REQUEST_METHOD: `PUT` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:09.162011 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54259cd-508e-4f12-b7f0-0c985bc3e04c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:09.162244 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f641012-d662-4488-9905-fbe797528dfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:09.162679 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f641012-d662-4488-9905-fbe797528dfc admin admin] PATH_INFO: `/v3/projects/4413694bcd9442649d8e6b553f7b1ac5/users/3b6e1a655f724f5ab71c7444ddfbf563/roles/dba744f8ab2a4c45b9d3212f8d203aba` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:09.164014 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54259cd-508e-4f12-b7f0-0c985bc3e04c admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:09.188691 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f641012-d662-4488-9905-fbe797528dfc admin admin] RBAC: Authorizing `identity:create_grant(project_id=4413694bcd9442649d8e6b553f7b1ac5, user_id=3b6e1a655f724f5ab71c7444ddfbf563, role_id=dba744f8ab2a4c45b9d3212f8d203aba)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:09.191648 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f641012-d662-4488-9905-fbe797528dfc admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:09.299151 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 973/1944] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 17:26:09 2022] PUT /identity/v3/projects/4413694bcd9442649d8e6b553f7b1ac5/users/3b6e1a655f724f5ab71c7444ddfbf563/roles/dba744f8ab2a4c45b9d3212f8d203aba => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:26:09.299384 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 972/1945] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 16 17:26:09 2022] POST /identity/v3/projects => generated 385 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 17:26:09.303121 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f641012-d662-4488-9905-fbe797528dfc admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:09.306351 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54259cd-508e-4f12-b7f0-0c985bc3e04c admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:09.375423 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54259cd-508e-4f12-b7f0-0c985bc3e04c admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:09.381036 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae81701-cc93-48bc-ba59-2afb1cba0314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:09.381728 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae81701-cc93-48bc-ba59-2afb1cba0314 admin admin] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:09.382064 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae81701-cc93-48bc-ba59-2afb1cba0314 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:09.382330 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae81701-cc93-48bc-ba59-2afb1cba0314 admin admin] PATH_INFO: `/v3/users` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:09.383237 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae81701-cc93-48bc-ba59-2afb1cba0314 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:09.385248 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae81701-cc93-48bc-ba59-2afb1cba0314 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:09.386693 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f641012-d662-4488-9905-fbe797528dfc admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:09.393018 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2352c86d-0e1d-437e-b936-d08c87c34829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:09.393839 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2352c86d-0e1d-437e-b936-d08c87c34829 admin admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:09.394217 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2352c86d-0e1d-437e-b936-d08c87c34829 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:09.394570 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2352c86d-0e1d-437e-b936-d08c87c34829 admin admin] PATH_INFO: `/v3/roles` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:09.396022 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2352c86d-0e1d-437e-b936-d08c87c34829 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:09.398880 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2352c86d-0e1d-437e-b936-d08c87c34829 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:09.411417 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 974/1946] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 17:26:09 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 17:26:09.415336 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2352c86d-0e1d-437e-b936-d08c87c34829 admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:09.426736 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2352c86d-0e1d-437e-b936-d08c87c34829 admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:09.431628 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369b5e13-d5ea-438e-a9be-acf08bdd1990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:09.432748 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369b5e13-d5ea-438e-a9be-acf08bdd1990 admin admin] REQUEST_METHOD: `PUT` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:09.433244 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369b5e13-d5ea-438e-a9be-acf08bdd1990 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:09.433722 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369b5e13-d5ea-438e-a9be-acf08bdd1990 admin admin] PATH_INFO: `/v3/projects/4413694bcd9442649d8e6b553f7b1ac5/users/3b6e1a655f724f5ab71c7444ddfbf563/roles/dba744f8ab2a4c45b9d3212f8d203aba` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:09.437016 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369b5e13-d5ea-438e-a9be-acf08bdd1990 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4413694bcd9442649d8e6b553f7b1ac5, user_id=3b6e1a655f724f5ab71c7444ddfbf563, role_id=dba744f8ab2a4c45b9d3212f8d203aba)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:09.439753 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369b5e13-d5ea-438e-a9be-acf08bdd1990 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:09.451664 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 975/1947] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 17:26:09 2022] PUT /identity/v3/projects/4413694bcd9442649d8e6b553f7b1ac5/users/3b6e1a655f724f5ab71c7444ddfbf563/roles/dba744f8ab2a4c45b9d3212f8d203aba => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 17:26:09.463366 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fff93e1-6d39-4de5-afe2-57b2342d6606 None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:09.463657 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fff93e1-6d39-4de5-afe2-57b2342d6606 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:09.463943 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fff93e1-6d39-4de5-afe2-57b2342d6606 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:09.494480 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-8fff93e1-6d39-4de5-afe2-57b2342d6606 None None] MFA Rules not processed for user `3b6e1a655f724f5ab71c7444ddfbf563`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:26:09.495731 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-8fff93e1-6d39-4de5-afe2-57b2342d6606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:09.512432 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 973/1948] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 16 17:26:09 2022] POST /identity/v3/users => generated 293 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 17:26:09.516924 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae81701-cc93-48bc-ba59-2afb1cba0314 admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:09.530709 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae81701-cc93-48bc-ba59-2afb1cba0314 admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:09.593842 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 976/1949] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:26:09 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 17:26:09.598692 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9de3bd-c506-4792-a453-f0d1da7da67f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:09.601829 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9de3bd-c506-4792-a453-f0d1da7da67f admin admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:09.602205 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9de3bd-c506-4792-a453-f0d1da7da67f admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:09.602500 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9de3bd-c506-4792-a453-f0d1da7da67f admin admin] PATH_INFO: `/v3/roles` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:09.603329 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9de3bd-c506-4792-a453-f0d1da7da67f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:09.605164 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9de3bd-c506-4792-a453-f0d1da7da67f admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:09.606417 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fff93e1-6d39-4de5-afe2-57b2342d6606 None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:09.608102 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-8fff93e1-6d39-4de5-afe2-57b2342d6606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:09.617970 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 974/1950] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 17:26:09 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 17:26:09.622201 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9de3bd-c506-4792-a453-f0d1da7da67f admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:09.632356 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9de3bd-c506-4792-a453-f0d1da7da67f admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:09.637875 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64234be0-5487-46bb-961b-eed39b8fe128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:09.638592 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64234be0-5487-46bb-961b-eed39b8fe128 admin admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:09.638873 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64234be0-5487-46bb-961b-eed39b8fe128 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:09.639163 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64234be0-5487-46bb-961b-eed39b8fe128 admin admin] PATH_INFO: `/v3/roles` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:09.639958 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64234be0-5487-46bb-961b-eed39b8fe128 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:09.641590 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64234be0-5487-46bb-961b-eed39b8fe128 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:09.653208 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 975/1951] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 17:26:09 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 17:26:09.664011 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64234be0-5487-46bb-961b-eed39b8fe128 admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:09.681446 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64234be0-5487-46bb-961b-eed39b8fe128 admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:09.695879 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fff93e1-6d39-4de5-afe2-57b2342d6606 None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:09.704289 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0551ca-7fae-487f-b2aa-93c9eb8a8859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:09.705203 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0551ca-7fae-487f-b2aa-93c9eb8a8859 admin admin] REQUEST_METHOD: `PUT` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:09.705500 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0551ca-7fae-487f-b2aa-93c9eb8a8859 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:09.705823 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0551ca-7fae-487f-b2aa-93c9eb8a8859 admin admin] PATH_INFO: `/v3/projects/a2ecf7a2ff704326ae157a6b4c4f6523/users/5fe3c0ebb4d94b10bc7ee56d2e53403a/roles/896bff49c5d6464eb612a15f4aa9badc` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:09.706701 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4670d302-e799-40e2-8c3b-ba84d8c56f2e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef37136b89d34edc9cd94c7aa81b2095', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:09.707452 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4670d302-e799-40e2-8c3b-ba84d8c56f2e service cinder] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:09.707839 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4670d302-e799-40e2-8c3b-ba84d8c56f2e service cinder] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:09.708168 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4670d302-e799-40e2-8c3b-ba84d8c56f2e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:09.711193 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-4670d302-e799-40e2-8c3b-ba84d8c56f2e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:09.727001 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0551ca-7fae-487f-b2aa-93c9eb8a8859 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2ecf7a2ff704326ae157a6b4c4f6523, user_id=5fe3c0ebb4d94b10bc7ee56d2e53403a, role_id=896bff49c5d6464eb612a15f4aa9badc)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:09.730189 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0551ca-7fae-487f-b2aa-93c9eb8a8859 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:09.781400 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4670d302-e799-40e2-8c3b-ba84d8c56f2e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:09.783204 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4670d302-e799-40e2-8c3b-ba84d8c56f2e service cinder] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:09.797979 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 977/1952] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:26:09 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 17:26:09.799203 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4670d302-e799-40e2-8c3b-ba84d8c56f2e service cinder] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:09.800779 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-4670d302-e799-40e2-8c3b-ba84d8c56f2e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:09.817946 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4670d302-e799-40e2-8c3b-ba84d8c56f2e service cinder] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:09.823815 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195e1e0a-9ba5-4eda-a384-3eac9bfc2447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:09.825271 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195e1e0a-9ba5-4eda-a384-3eac9bfc2447 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:09.825943 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195e1e0a-9ba5-4eda-a384-3eac9bfc2447 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:09.826271 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195e1e0a-9ba5-4eda-a384-3eac9bfc2447 admin admin] PATH_INFO: `/v3/projects/f2a9bf8be15d4459b2e8090a62a6ac0f` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:09.827647 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195e1e0a-9ba5-4eda-a384-3eac9bfc2447 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2a9bf8be15d4459b2e8090a62a6ac0f)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:09.829922 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195e1e0a-9ba5-4eda-a384-3eac9bfc2447 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:09.844653 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 976/1953] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 17:26:09 2022] PUT /identity/v3/projects/a2ecf7a2ff704326ae157a6b4c4f6523/users/5fe3c0ebb4d94b10bc7ee56d2e53403a/roles/896bff49c5d6464eb612a15f4aa9badc => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:26:09.847948 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1620c8c8-7af5-4e63-90dc-3da69afad728 None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:09.848312 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1620c8c8-7af5-4e63-90dc-3da69afad728 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:09.850873 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1620c8c8-7af5-4e63-90dc-3da69afad728 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:09.903438 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-1620c8c8-7af5-4e63-90dc-3da69afad728 None None] MFA Rules not processed for user `5fe3c0ebb4d94b10bc7ee56d2e53403a`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:26:09.904887 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-1620c8c8-7af5-4e63-90dc-3da69afad728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:09.984012 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-195e1e0a-9ba5-4eda-a384-3eac9bfc2447 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2a9bf8be15d4459b2e8090a62a6ac0f', 'request_id': 'req-195e1e0a-9ba5-4eda-a384-3eac9bfc2447'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:09.991153 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-195e1e0a-9ba5-4eda-a384-3eac9bfc2447 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2a9bf8be15d4459b2e8090a62a6ac0f', 'request_id': 'req-195e1e0a-9ba5-4eda-a384-3eac9bfc2447'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:09.997599 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-195e1e0a-9ba5-4eda-a384-3eac9bfc2447 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2a9bf8be15d4459b2e8090a62a6ac0f', 'request_id': 'req-195e1e0a-9ba5-4eda-a384-3eac9bfc2447'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:10.006598 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 977/1954] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:26:09 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:26:10.011022 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1620c8c8-7af5-4e63-90dc-3da69afad728 None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:10.080083 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1620c8c8-7af5-4e63-90dc-3da69afad728 None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:10.141869 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c51a65-adcf-4dc6-904e-cc7f4dd807ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:10.142771 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c51a65-adcf-4dc6-904e-cc7f4dd807ef admin admin] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:10.142960 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c51a65-adcf-4dc6-904e-cc7f4dd807ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:10.143289 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c51a65-adcf-4dc6-904e-cc7f4dd807ef admin admin] PATH_INFO: `/v3/projects` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:10.144085 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c51a65-adcf-4dc6-904e-cc7f4dd807ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:10.146612 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c51a65-adcf-4dc6-904e-cc7f4dd807ef admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:10.154346 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-195e1e0a-9ba5-4eda-a384-3eac9bfc2447 admin admin] The token cache is being invalidate because project f2a9bf8be15d4459b2e8090a62a6ac0f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80873) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 17:26:10.155002 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-195e1e0a-9ba5-4eda-a384-3eac9bfc2447 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:10.155874 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-195e1e0a-9ba5-4eda-a384-3eac9bfc2447 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:10.161601 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 978/1955] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 16 17:26:09 2022] DELETE /identity/v3/projects/f2a9bf8be15d4459b2e8090a62a6ac0f => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:26:10.163617 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536212c9-2e48-484e-bdbd-3b9eb840ac6d None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:10.163908 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536212c9-2e48-484e-bdbd-3b9eb840ac6d None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:10.164187 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536212c9-2e48-484e-bdbd-3b9eb840ac6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:10.185344 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-536212c9-2e48-484e-bdbd-3b9eb840ac6d None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:26:10.186678 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-536212c9-2e48-484e-bdbd-3b9eb840ac6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:10.194723 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 979/1956] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:26:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:26:10.212411 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6567e5-2723-4a8f-b25b-32fee42327aa None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:10.212836 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6567e5-2723-4a8f-b25b-32fee42327aa None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:10.213182 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6567e5-2723-4a8f-b25b-32fee42327aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:10.232266 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-3f6567e5-2723-4a8f-b25b-32fee42327aa None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:26:10.233475 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-3f6567e5-2723-4a8f-b25b-32fee42327aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:10.241388 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 980/1957] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:26:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 17:26:10.245569 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6567e5-2723-4a8f-b25b-32fee42327aa None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:10.254579 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6567e5-2723-4a8f-b25b-32fee42327aa None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:10.255238 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:26:10.259418 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295ab1e7-d6b0-4a74-893d-4937ac24b112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:10.260064 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295ab1e7-d6b0-4a74-893d-4937ac24b112 admin admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:10.260352 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295ab1e7-d6b0-4a74-893d-4937ac24b112 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:10.260635 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295ab1e7-d6b0-4a74-893d-4937ac24b112 admin admin] PATH_INFO: `/v3/domains` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:10.261364 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295ab1e7-d6b0-4a74-893d-4937ac24b112 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80873) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:26:10.261675 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295ab1e7-d6b0-4a74-893d-4937ac24b112 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:10.263425 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295ab1e7-d6b0-4a74-893d-4937ac24b112 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:10.275334 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 981/1958] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 16 17:26:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 17:26:10.280654 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295ab1e7-d6b0-4a74-893d-4937ac24b112 admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:10.292397 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295ab1e7-d6b0-4a74-893d-4937ac24b112 admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:10.299852 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec16d47f-d8b6-49d1-8653-ec893f783389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:10.300387 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 978/1959] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 16 17:26:10 2022] POST /identity/v3/projects => generated 387 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 17:26:10.300506 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec16d47f-d8b6-49d1-8653-ec893f783389 admin admin] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:10.300788 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec16d47f-d8b6-49d1-8653-ec893f783389 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:10.301062 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec16d47f-d8b6-49d1-8653-ec893f783389 admin admin] PATH_INFO: `/v3/projects` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:10.301877 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec16d47f-d8b6-49d1-8653-ec893f783389 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:10.303836 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec16d47f-d8b6-49d1-8653-ec893f783389 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:10.304285 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c51a65-adcf-4dc6-904e-cc7f4dd807ef admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:10.306042 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-90c51a65-adcf-4dc6-904e-cc7f4dd807ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:10.371116 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c51a65-adcf-4dc6-904e-cc7f4dd807ef admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:10.376480 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e14e06-50a3-4c11-bec7-466ed6214031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:10.377261 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e14e06-50a3-4c11-bec7-466ed6214031 admin admin] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:10.377561 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e14e06-50a3-4c11-bec7-466ed6214031 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:10.377881 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e14e06-50a3-4c11-bec7-466ed6214031 admin admin] PATH_INFO: `/v3/users` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:10.378593 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e14e06-50a3-4c11-bec7-466ed6214031 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:10.381290 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e14e06-50a3-4c11-bec7-466ed6214031 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:10.406462 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 982/1960] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 16 17:26:10 2022] POST /identity/v3/projects => generated 377 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:26:10.410604 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec16d47f-d8b6-49d1-8653-ec893f783389 admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:10.477405 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec16d47f-d8b6-49d1-8653-ec893f783389 admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:10.482892 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f8ffb9-0498-4165-b661-405e5dcca789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:10.483741 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f8ffb9-0498-4165-b661-405e5dcca789 admin admin] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:10.484033 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f8ffb9-0498-4165-b661-405e5dcca789 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:10.485082 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f8ffb9-0498-4165-b661-405e5dcca789 admin admin] PATH_INFO: `/v3/users` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:10.485082 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f8ffb9-0498-4165-b661-405e5dcca789 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:10.487096 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f8ffb9-0498-4165-b661-405e5dcca789 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:10.521749 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 979/1961] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 16 17:26:10 2022] POST /identity/v3/users => generated 294 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 17:26:10.523429 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e14e06-50a3-4c11-bec7-466ed6214031 admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:10.534430 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e14e06-50a3-4c11-bec7-466ed6214031 admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:10.539473 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772a00d8-7c27-4324-98c5-b8f7fd5d3c06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:10.540180 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772a00d8-7c27-4324-98c5-b8f7fd5d3c06 admin admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:10.540504 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772a00d8-7c27-4324-98c5-b8f7fd5d3c06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:10.540792 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772a00d8-7c27-4324-98c5-b8f7fd5d3c06 admin admin] PATH_INFO: `/v3/roles` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:10.545964 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772a00d8-7c27-4324-98c5-b8f7fd5d3c06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:10.545964 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772a00d8-7c27-4324-98c5-b8f7fd5d3c06 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:10.562372 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 980/1962] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 17:26:10 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:26:10.566496 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772a00d8-7c27-4324-98c5-b8f7fd5d3c06 admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:10.587959 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772a00d8-7c27-4324-98c5-b8f7fd5d3c06 admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:10.593474 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8077a212-8109-4edb-af8c-9ab65114c458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:10.594253 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8077a212-8109-4edb-af8c-9ab65114c458 admin admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:10.594550 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8077a212-8109-4edb-af8c-9ab65114c458 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:10.594921 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8077a212-8109-4edb-af8c-9ab65114c458 admin admin] PATH_INFO: `/v3/roles` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:10.595567 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8077a212-8109-4edb-af8c-9ab65114c458 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:10.597159 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8077a212-8109-4edb-af8c-9ab65114c458 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:10.608086 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 983/1963] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 16 17:26:10 2022] POST /identity/v3/users => generated 289 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 17:26:10.613937 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 981/1964] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 17:26:10 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 17:26:10.614093 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f8ffb9-0498-4165-b661-405e5dcca789 admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:10.615563 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8077a212-8109-4edb-af8c-9ab65114c458 admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:10.623169 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f8ffb9-0498-4165-b661-405e5dcca789 admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:10.626718 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8077a212-8109-4edb-af8c-9ab65114c458 admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:10.629302 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffeaec56-32f9-4807-bdec-e1608ad2f1ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:10.630370 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeaec56-32f9-4807-bdec-e1608ad2f1ff admin admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:10.630664 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeaec56-32f9-4807-bdec-e1608ad2f1ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:10.634538 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeaec56-32f9-4807-bdec-e1608ad2f1ff admin admin] PATH_INFO: `/v3/roles` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:10.634538 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffeaec56-32f9-4807-bdec-e1608ad2f1ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:10.635030 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c750e97-d5b7-41e9-95ef-7c6e950e3750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:10.635030 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c750e97-d5b7-41e9-95ef-7c6e950e3750 admin admin] REQUEST_METHOD: `PUT` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:10.635030 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c750e97-d5b7-41e9-95ef-7c6e950e3750 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:10.635372 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffeaec56-32f9-4807-bdec-e1608ad2f1ff admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:10.635461 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c750e97-d5b7-41e9-95ef-7c6e950e3750 admin admin] PATH_INFO: `/v3/projects/34593c9a677c4bafb77b54acdf252fee/users/748143a01e68426cbf5b8052f9e7c2e8/roles/896bff49c5d6464eb612a15f4aa9badc` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:10.653166 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c750e97-d5b7-41e9-95ef-7c6e950e3750 admin admin] RBAC: Authorizing `identity:create_grant(project_id=34593c9a677c4bafb77b54acdf252fee, user_id=748143a01e68426cbf5b8052f9e7c2e8, role_id=896bff49c5d6464eb612a15f4aa9badc)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:10.653354 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 984/1965] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 17:26:10 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:26:10.655189 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffeaec56-32f9-4807-bdec-e1608ad2f1ff admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:10.657365 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c750e97-d5b7-41e9-95ef-7c6e950e3750 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:10.671822 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffeaec56-32f9-4807-bdec-e1608ad2f1ff admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:10.678327 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee9df57-fc37-4f4e-b152-6d2ec30d0205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:10.679474 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee9df57-fc37-4f4e-b152-6d2ec30d0205 admin admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:10.680002 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee9df57-fc37-4f4e-b152-6d2ec30d0205 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:10.680530 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee9df57-fc37-4f4e-b152-6d2ec30d0205 admin admin] PATH_INFO: `/v3/roles` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:10.682000 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee9df57-fc37-4f4e-b152-6d2ec30d0205 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:10.685591 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee9df57-fc37-4f4e-b152-6d2ec30d0205 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:10.704854 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 985/1966] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 17:26:10 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:26:10.708664 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee9df57-fc37-4f4e-b152-6d2ec30d0205 admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:10.719403 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee9df57-fc37-4f4e-b152-6d2ec30d0205 admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:10.724453 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f444c55b-583b-470e-b55e-c75f94c300df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:10.725362 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f444c55b-583b-470e-b55e-c75f94c300df admin admin] REQUEST_METHOD: `PUT` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:10.725653 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f444c55b-583b-470e-b55e-c75f94c300df admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:10.725967 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f444c55b-583b-470e-b55e-c75f94c300df admin admin] PATH_INFO: `/v3/projects/cb4d0d73cfca4b50bfafdca80ff09eb1/users/8129f4740aba4a5c9cbec08feb46a03b/roles/896bff49c5d6464eb612a15f4aa9badc` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:10.742905 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f444c55b-583b-470e-b55e-c75f94c300df admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb4d0d73cfca4b50bfafdca80ff09eb1, user_id=8129f4740aba4a5c9cbec08feb46a03b, role_id=896bff49c5d6464eb612a15f4aa9badc)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:10.745556 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f444c55b-583b-470e-b55e-c75f94c300df admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:10.817312 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 982/1967] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 17:26:10 2022] PUT /identity/v3/projects/34593c9a677c4bafb77b54acdf252fee/users/748143a01e68426cbf5b8052f9e7c2e8/roles/896bff49c5d6464eb612a15f4aa9badc => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:26:10.828045 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e261f03a-d600-42c8-8288-9aca6be3b092 None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:10.828636 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e261f03a-d600-42c8-8288-9aca6be3b092 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:10.830340 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e261f03a-d600-42c8-8288-9aca6be3b092 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:10.868104 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-e261f03a-d600-42c8-8288-9aca6be3b092 None None] MFA Rules not processed for user `748143a01e68426cbf5b8052f9e7c2e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:26:10.869486 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-e261f03a-d600-42c8-8288-9aca6be3b092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:10.881329 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 986/1968] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 17:26:10 2022] PUT /identity/v3/projects/cb4d0d73cfca4b50bfafdca80ff09eb1/users/8129f4740aba4a5c9cbec08feb46a03b/roles/896bff49c5d6464eb612a15f4aa9badc => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:26:10.883999 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ca5404-c529-4c1e-98a6-69a71423de61 None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:10.884533 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ca5404-c529-4c1e-98a6-69a71423de61 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:10.884937 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ca5404-c529-4c1e-98a6-69a71423de61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:10.926796 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-94ca5404-c529-4c1e-98a6-69a71423de61 None None] MFA Rules not processed for user `8129f4740aba4a5c9cbec08feb46a03b`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:26:10.928269 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-94ca5404-c529-4c1e-98a6-69a71423de61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:11.004407 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 983/1969] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:26:10 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:26:11.010299 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e261f03a-d600-42c8-8288-9aca6be3b092 None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:11.044317 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 987/1970] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:26:10 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 17:26:11.052793 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ca5404-c529-4c1e-98a6-69a71423de61 None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:11.118667 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e261f03a-d600-42c8-8288-9aca6be3b092 None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:11.127343 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc361ea2-157d-44d3-b5c1-53aac4fa14b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:11.128023 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc361ea2-157d-44d3-b5c1-53aac4fa14b3 admin admin] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:11.128483 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc361ea2-157d-44d3-b5c1-53aac4fa14b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:11.128784 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc361ea2-157d-44d3-b5c1-53aac4fa14b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:11.129546 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc361ea2-157d-44d3-b5c1-53aac4fa14b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:11.134907 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc361ea2-157d-44d3-b5c1-53aac4fa14b3 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:11.186841 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:26:11.191910 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ca5404-c529-4c1e-98a6-69a71423de61 None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:11.197998 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49b932d-01c5-43f1-a31a-8101ca470155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:11.198839 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49b932d-01c5-43f1-a31a-8101ca470155 admin admin] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:11.199274 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49b932d-01c5-43f1-a31a-8101ca470155 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:11.199931 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49b932d-01c5-43f1-a31a-8101ca470155 admin admin] PATH_INFO: `/v3/projects` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:11.200786 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49b932d-01c5-43f1-a31a-8101ca470155 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:11.202988 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49b932d-01c5-43f1-a31a-8101ca470155 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:11.248236 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 984/1971] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 16 17:26:11 2022] POST /identity/v3/projects => generated 387 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:26:11.252827 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc361ea2-157d-44d3-b5c1-53aac4fa14b3 admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:11.256777 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-dc361ea2-157d-44d3-b5c1-53aac4fa14b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:11.329525 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 988/1972] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 16 17:26:11 2022] POST /identity/v3/projects => generated 375 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 17:26:11.330832 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49b932d-01c5-43f1-a31a-8101ca470155 admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:11.379256 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc361ea2-157d-44d3-b5c1-53aac4fa14b3 admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:11.412657 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49b932d-01c5-43f1-a31a-8101ca470155 admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:11.418645 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7a4b64-29df-4916-acd8-57f0455bf872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:11.419548 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7a4b64-29df-4916-acd8-57f0455bf872 admin admin] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:11.420128 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7a4b64-29df-4916-acd8-57f0455bf872 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:11.420943 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7a4b64-29df-4916-acd8-57f0455bf872 admin admin] PATH_INFO: `/v3/users` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:11.421873 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7a4b64-29df-4916-acd8-57f0455bf872 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:11.425495 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7a4b64-29df-4916-acd8-57f0455bf872 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:11.446052 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62f366d-da61-443f-b861-1d70964004bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:11.447009 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62f366d-da61-443f-b861-1d70964004bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:11.447320 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62f366d-da61-443f-b861-1d70964004bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:11.447621 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62f366d-da61-443f-b861-1d70964004bf admin admin] PATH_INFO: `/v3/users/143d68eb89ee4283ae82886ecb768992` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:11.449941 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62f366d-da61-443f-b861-1d70964004bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=143d68eb89ee4283ae82886ecb768992)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:11.452183 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62f366d-da61-443f-b861-1d70964004bf admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:11.541698 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 989/1973] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 16 17:26:11 2022] POST /identity/v3/users => generated 300 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:26:11.542632 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7a4b64-29df-4916-acd8-57f0455bf872 admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:11.552942 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7a4b64-29df-4916-acd8-57f0455bf872 admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:11.559403 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c73746b-2cc3-4763-88c5-5562472705b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:11.560444 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c73746b-2cc3-4763-88c5-5562472705b7 admin admin] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:11.560909 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c73746b-2cc3-4763-88c5-5562472705b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:11.561565 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c73746b-2cc3-4763-88c5-5562472705b7 admin admin] PATH_INFO: `/v3/users` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:11.562801 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c73746b-2cc3-4763-88c5-5562472705b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:11.566302 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c73746b-2cc3-4763-88c5-5562472705b7 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:11.684729 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 990/1974] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 16 17:26:11 2022] POST /identity/v3/users => generated 288 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:26:11.685746 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c73746b-2cc3-4763-88c5-5562472705b7 admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:11.702835 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c73746b-2cc3-4763-88c5-5562472705b7 admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:11.708290 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3212998f-6892-48e8-8adf-a0169896226d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:11.708989 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3212998f-6892-48e8-8adf-a0169896226d admin admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:11.709262 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3212998f-6892-48e8-8adf-a0169896226d admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:11.709537 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3212998f-6892-48e8-8adf-a0169896226d admin admin] PATH_INFO: `/v3/roles` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:11.710572 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3212998f-6892-48e8-8adf-a0169896226d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:11.714425 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3212998f-6892-48e8-8adf-a0169896226d admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:11.725279 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 991/1975] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 17:26:11 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:26:11.726168 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3212998f-6892-48e8-8adf-a0169896226d admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:11.738621 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3212998f-6892-48e8-8adf-a0169896226d admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:11.743543 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b63066f-d6a6-4cd1-9d98-f442227538ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:11.744225 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b63066f-d6a6-4cd1-9d98-f442227538ff admin admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:11.744511 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b63066f-d6a6-4cd1-9d98-f442227538ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:11.744789 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b63066f-d6a6-4cd1-9d98-f442227538ff admin admin] PATH_INFO: `/v3/roles` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:11.745606 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b63066f-d6a6-4cd1-9d98-f442227538ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:11.747912 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b63066f-d6a6-4cd1-9d98-f442227538ff admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:11.751639 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-d62f366d-da61-443f-b861-1d70964004bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '143d68eb89ee4283ae82886ecb768992'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:11.767895 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-d62f366d-da61-443f-b861-1d70964004bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '143d68eb89ee4283ae82886ecb768992'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:11.772425 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 992/1976] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 17:26:11 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:26:11.772425 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b63066f-d6a6-4cd1-9d98-f442227538ff admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:11.791554 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b63066f-d6a6-4cd1-9d98-f442227538ff admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:11.798728 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c7e8da-dbca-4aa8-8def-a45f3533e8b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:11.799675 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c7e8da-dbca-4aa8-8def-a45f3533e8b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:11.799984 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c7e8da-dbca-4aa8-8def-a45f3533e8b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:11.800307 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c7e8da-dbca-4aa8-8def-a45f3533e8b6 admin admin] PATH_INFO: `/v3/projects/dc5be57b021d48f49cb081bd4b612800/users/866bcc91039d472daff01eb2385be5ac/roles/dba744f8ab2a4c45b9d3212f8d203aba` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:11.819717 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c7e8da-dbca-4aa8-8def-a45f3533e8b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc5be57b021d48f49cb081bd4b612800, user_id=866bcc91039d472daff01eb2385be5ac, role_id=dba744f8ab2a4c45b9d3212f8d203aba)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:11.822797 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c7e8da-dbca-4aa8-8def-a45f3533e8b6 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:11.877985 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-d62f366d-da61-443f-b861-1d70964004bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '143d68eb89ee4283ae82886ecb768992'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:11.878917 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-d62f366d-da61-443f-b861-1d70964004bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '143d68eb89ee4283ae82886ecb768992'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:11.915707 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-d62f366d-da61-443f-b861-1d70964004bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '143d68eb89ee4283ae82886ecb768992'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:11.928539 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 985/1977] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 16 17:26:11 2022] DELETE /identity/v3/users/143d68eb89ee4283ae82886ecb768992 => generated 0 bytes in 678 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:26:11.930033 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62f366d-da61-443f-b861-1d70964004bf admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:11.932255 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-d62f366d-da61-443f-b861-1d70964004bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:11.952510 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 993/1978] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 17:26:11 2022] PUT /identity/v3/projects/dc5be57b021d48f49cb081bd4b612800/users/866bcc91039d472daff01eb2385be5ac/roles/dba744f8ab2a4c45b9d3212f8d203aba => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:26:11.952510 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c7e8da-dbca-4aa8-8def-a45f3533e8b6 admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:11.953293 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-66c7e8da-dbca-4aa8-8def-a45f3533e8b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:12.031320 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62f366d-da61-443f-b861-1d70964004bf admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:12.036929 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dff136a-ce49-4082-8eeb-0905b7941781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:12.037614 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dff136a-ce49-4082-8eeb-0905b7941781 admin admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:12.041741 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dff136a-ce49-4082-8eeb-0905b7941781 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:12.041741 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dff136a-ce49-4082-8eeb-0905b7941781 admin admin] PATH_INFO: `/v3/roles` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:12.042431 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c7e8da-dbca-4aa8-8def-a45f3533e8b6 admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:12.042526 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dff136a-ce49-4082-8eeb-0905b7941781 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:12.042526 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dff136a-ce49-4082-8eeb-0905b7941781 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:12.045823 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e9b230-6406-4d35-8187-4653d00d7d68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:12.047123 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e9b230-6406-4d35-8187-4653d00d7d68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:12.047482 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e9b230-6406-4d35-8187-4653d00d7d68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:12.047909 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e9b230-6406-4d35-8187-4653d00d7d68 admin admin] PATH_INFO: `/v3/users/5e843498d18843bd89f8f7e33b6171f3` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:12.049469 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e9b230-6406-4d35-8187-4653d00d7d68 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e843498d18843bd89f8f7e33b6171f3)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:12.051729 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e9b230-6406-4d35-8187-4653d00d7d68 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:12.055355 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 986/1979] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 17:26:11 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:26:12.057221 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6334ec5-a911-4423-9d03-9f33f5832333 None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:12.057547 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6334ec5-a911-4423-9d03-9f33f5832333 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:12.057853 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6334ec5-a911-4423-9d03-9f33f5832333 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:12.089483 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-f6334ec5-a911-4423-9d03-9f33f5832333 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:26:12.090795 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-f6334ec5-a911-4423-9d03-9f33f5832333 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:12.099326 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 987/1980] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:26:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:26:12.100161 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6334ec5-a911-4423-9d03-9f33f5832333 None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:12.101818 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-f6334ec5-a911-4423-9d03-9f33f5832333 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:12.114905 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6334ec5-a911-4423-9d03-9f33f5832333 None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:12.120217 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bdb884-f60f-40b0-9bc8-ecc346cb54ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:12.120959 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bdb884-f60f-40b0-9bc8-ecc346cb54ef admin admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:12.122132 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bdb884-f60f-40b0-9bc8-ecc346cb54ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:12.122405 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bdb884-f60f-40b0-9bc8-ecc346cb54ef admin admin] PATH_INFO: `/v3/roles` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:12.123205 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bdb884-f60f-40b0-9bc8-ecc346cb54ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:12.124815 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bdb884-f60f-40b0-9bc8-ecc346cb54ef admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:12.136164 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 988/1981] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 17:26:12 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:26:12.136998 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bdb884-f60f-40b0-9bc8-ecc346cb54ef admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:12.147595 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bdb884-f60f-40b0-9bc8-ecc346cb54ef admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:12.152433 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34650a13-dd3c-41a5-8595-7007f2cd426d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:12.153314 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34650a13-dd3c-41a5-8595-7007f2cd426d admin admin] REQUEST_METHOD: `PUT` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:12.153613 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34650a13-dd3c-41a5-8595-7007f2cd426d admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:12.153987 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34650a13-dd3c-41a5-8595-7007f2cd426d admin admin] PATH_INFO: `/v3/projects/a2f8c9b8eea14de59fe5fc99f704d683/users/2c55974c99b24dd7a32c27b94d029daf/roles/896bff49c5d6464eb612a15f4aa9badc` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:12.169164 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34650a13-dd3c-41a5-8595-7007f2cd426d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2f8c9b8eea14de59fe5fc99f704d683, user_id=2c55974c99b24dd7a32c27b94d029daf, role_id=896bff49c5d6464eb612a15f4aa9badc)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:12.172004 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34650a13-dd3c-41a5-8595-7007f2cd426d admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:12.250499 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 989/1982] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 17:26:12 2022] PUT /identity/v3/projects/a2f8c9b8eea14de59fe5fc99f704d683/users/2c55974c99b24dd7a32c27b94d029daf/roles/896bff49c5d6464eb612a15f4aa9badc => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:26:12.251446 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34650a13-dd3c-41a5-8595-7007f2cd426d admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:12.253197 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-34650a13-dd3c-41a5-8595-7007f2cd426d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:12.282539 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-50e9b230-6406-4d35-8187-4653d00d7d68 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e843498d18843bd89f8f7e33b6171f3'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:12.283255 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-50e9b230-6406-4d35-8187-4653d00d7d68 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e843498d18843bd89f8f7e33b6171f3'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:12.284596 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-50e9b230-6406-4d35-8187-4653d00d7d68 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e843498d18843bd89f8f7e33b6171f3'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:12.332008 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:26:12.351414 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34650a13-dd3c-41a5-8595-7007f2cd426d admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:12.356330 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baca3599-9d69-4a6d-9690-7c6dbe6cac72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5d25bfa8dc042329d57cd55fa7b7b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:12.357134 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baca3599-9d69-4a6d-9690-7c6dbe6cac72 service neutron] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:12.360714 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baca3599-9d69-4a6d-9690-7c6dbe6cac72 service neutron] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:12.360714 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baca3599-9d69-4a6d-9690-7c6dbe6cac72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:12.367469 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-baca3599-9d69-4a6d-9690-7c6dbe6cac72 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:12.381719 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-50e9b230-6406-4d35-8187-4653d00d7d68 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e843498d18843bd89f8f7e33b6171f3'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:12.393254 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-50e9b230-6406-4d35-8187-4653d00d7d68 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e843498d18843bd89f8f7e33b6171f3'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:12.444909 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 994/1983] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 16 17:26:11 2022] DELETE /identity/v3/users/5e843498d18843bd89f8f7e33b6171f3 => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:26:12.444909 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e9b230-6406-4d35-8187-4653d00d7d68 admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:12.446123 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-50e9b230-6406-4d35-8187-4653d00d7d68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:12.515205 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baca3599-9d69-4a6d-9690-7c6dbe6cac72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:12.516879 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baca3599-9d69-4a6d-9690-7c6dbe6cac72 service neutron] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:12.549483 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 990/1984] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:26:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:26:12.550067 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e9b230-6406-4d35-8187-4653d00d7d68 admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:12.550538 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baca3599-9d69-4a6d-9690-7c6dbe6cac72 service neutron] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:12.552042 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-baca3599-9d69-4a6d-9690-7c6dbe6cac72 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:12.554878 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b0eb36-ee05-448a-945d-788736588a10 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef37136b89d34edc9cd94c7aa81b2095', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:12.555774 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b0eb36-ee05-448a-945d-788736588a10 service cinder] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:12.557106 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b0eb36-ee05-448a-945d-788736588a10 service cinder] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:12.557666 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b0eb36-ee05-448a-945d-788736588a10 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:12.560894 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-15b0eb36-ee05-448a-945d-788736588a10 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:12.576082 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baca3599-9d69-4a6d-9690-7c6dbe6cac72 service neutron] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:12.685680 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b0eb36-ee05-448a-945d-788736588a10 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:12.691761 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b0eb36-ee05-448a-945d-788736588a10 service cinder] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:12.707715 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 995/1985] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:26:12 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:26:12.709830 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efdcc26-6ee1-4131-b049-3b4756ca1998 None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:12.710541 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efdcc26-6ee1-4131-b049-3b4756ca1998 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:12.711339 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efdcc26-6ee1-4131-b049-3b4756ca1998 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:12.721796 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a85ded-63a6-44bf-bbd4-0a5af294edb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:12.723639 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a85ded-63a6-44bf-bbd4-0a5af294edb9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:12.723639 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a85ded-63a6-44bf-bbd4-0a5af294edb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:12.723835 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a85ded-63a6-44bf-bbd4-0a5af294edb9 admin admin] PATH_INFO: `/v3/projects/dc5be57b021d48f49cb081bd4b612800/users/866bcc91039d472daff01eb2385be5ac/roles/dba744f8ab2a4c45b9d3212f8d203aba` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:12.737362 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a85ded-63a6-44bf-bbd4-0a5af294edb9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc5be57b021d48f49cb081bd4b612800, user_id=866bcc91039d472daff01eb2385be5ac, role_id=dba744f8ab2a4c45b9d3212f8d203aba)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:12.748199 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a85ded-63a6-44bf-bbd4-0a5af294edb9 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:12.752100 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-2efdcc26-6ee1-4131-b049-3b4756ca1998 None None] MFA Rules not processed for user `2c55974c99b24dd7a32c27b94d029daf`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:26:12.754204 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-2efdcc26-6ee1-4131-b049-3b4756ca1998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:12.782648 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 991/1986] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 17:26:12 2022] PUT /identity/v3/projects/dc5be57b021d48f49cb081bd4b612800/users/866bcc91039d472daff01eb2385be5ac/roles/dba744f8ab2a4c45b9d3212f8d203aba => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:26:12.782648 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176b455c-11a6-49ff-a52d-f48038bfc9d8 None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:12.782648 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176b455c-11a6-49ff-a52d-f48038bfc9d8 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:12.782648 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176b455c-11a6-49ff-a52d-f48038bfc9d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:12.811783 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-176b455c-11a6-49ff-a52d-f48038bfc9d8 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:26:12.818521 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-176b455c-11a6-49ff-a52d-f48038bfc9d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:12.906932 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 992/1987] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:26:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:26:12.906932 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d7dd46-a90f-44d2-a200-432f0738b06e None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:12.907137 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d7dd46-a90f-44d2-a200-432f0738b06e None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:12.907930 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d7dd46-a90f-44d2-a200-432f0738b06e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:12.913041 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 996/1988] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:26:12 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:26:12.916221 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efdcc26-6ee1-4131-b049-3b4756ca1998 None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:12.919993 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-2efdcc26-6ee1-4131-b049-3b4756ca1998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:12.932223 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:26:12.959424 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-14d7dd46-a90f-44d2-a200-432f0738b06e None None] MFA Rules not processed for user `866bcc91039d472daff01eb2385be5ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:26:12.961116 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-14d7dd46-a90f-44d2-a200-432f0738b06e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:13.022086 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efdcc26-6ee1-4131-b049-3b4756ca1998 None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:13.083801 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 993/1989] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:26:12 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:26:13.084358 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d7dd46-a90f-44d2-a200-432f0738b06e None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:13.091410 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-14d7dd46-a90f-44d2-a200-432f0738b06e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:13.106757 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d7dd46-a90f-44d2-a200-432f0738b06e None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:13.113557 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb39e57-d635-4e9a-99e7-51419f81e0d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:13.114630 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb39e57-d635-4e9a-99e7-51419f81e0d2 admin admin] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:13.116734 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb39e57-d635-4e9a-99e7-51419f81e0d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:13.117234 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb39e57-d635-4e9a-99e7-51419f81e0d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:13.118058 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb39e57-d635-4e9a-99e7-51419f81e0d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:13.121012 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb39e57-d635-4e9a-99e7-51419f81e0d2 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:13.158188 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bfaccb-b20d-48cf-942a-eb65c5d72286 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5d25bfa8dc042329d57cd55fa7b7b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:13.159287 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bfaccb-b20d-48cf-942a-eb65c5d72286 service neutron] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:13.159752 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bfaccb-b20d-48cf-942a-eb65c5d72286 service neutron] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:13.160148 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bfaccb-b20d-48cf-942a-eb65c5d72286 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:13.176191 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bfaccb-b20d-48cf-942a-eb65c5d72286 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:13.179074 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bfaccb-b20d-48cf-942a-eb65c5d72286 service neutron] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:13.206160 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 997/1990] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:26:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:26:13.207423 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bfaccb-b20d-48cf-942a-eb65c5d72286 service neutron] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:13.217866 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-21bfaccb-b20d-48cf-942a-eb65c5d72286 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:13.284456 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bfaccb-b20d-48cf-942a-eb65c5d72286 service neutron] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:13.288332 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f36ddf-0802-4a06-a197-59b21230c7b4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef37136b89d34edc9cd94c7aa81b2095', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:13.289048 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f36ddf-0802-4a06-a197-59b21230c7b4 service cinder] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:13.289334 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f36ddf-0802-4a06-a197-59b21230c7b4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:13.289637 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f36ddf-0802-4a06-a197-59b21230c7b4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:13.307216 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f36ddf-0802-4a06-a197-59b21230c7b4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:13.309907 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 994/1991] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 16 17:26:13 2022] POST /identity/v3/projects => generated 377 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:26:13.312823 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f36ddf-0802-4a06-a197-59b21230c7b4 service cinder] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:13.314399 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb39e57-d635-4e9a-99e7-51419f81e0d2 admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:13.330785 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 998/1992] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:26:13 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:26:13.403882 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb39e57-d635-4e9a-99e7-51419f81e0d2 admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:13.410116 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ac3b19-8508-4af0-8e84-115027a3b102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:13.410849 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ac3b19-8508-4af0-8e84-115027a3b102 admin admin] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:13.412770 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ac3b19-8508-4af0-8e84-115027a3b102 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:13.412770 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ac3b19-8508-4af0-8e84-115027a3b102 admin admin] PATH_INFO: `/v3/users` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:13.412770 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ac3b19-8508-4af0-8e84-115027a3b102 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:13.414154 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ac3b19-8508-4af0-8e84-115027a3b102 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:13.454254 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f36ddf-0802-4a06-a197-59b21230c7b4 service cinder] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:13.458759 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-13f36ddf-0802-4a06-a197-59b21230c7b4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:13.490168 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f36ddf-0802-4a06-a197-59b21230c7b4 service cinder] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:13.496247 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0e85e1-515f-4c7a-b673-fb5a7877eb5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:13.505045 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0e85e1-515f-4c7a-b673-fb5a7877eb5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:13.505516 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0e85e1-515f-4c7a-b673-fb5a7877eb5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:13.506453 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0e85e1-515f-4c7a-b673-fb5a7877eb5c admin admin] PATH_INFO: `/v3/projects/883aff4199f6432bb431c9ad14498d4e` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:13.508182 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0e85e1-515f-4c7a-b673-fb5a7877eb5c admin admin] RBAC: Authorizing `identity:delete_project(project_id=883aff4199f6432bb431c9ad14498d4e)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:13.512335 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0e85e1-515f-4c7a-b673-fb5a7877eb5c admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:13.533571 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 995/1993] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 16 17:26:13 2022] POST /identity/v3/users => generated 295 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:26:13.537824 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ac3b19-8508-4af0-8e84-115027a3b102 admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:13.560721 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ac3b19-8508-4af0-8e84-115027a3b102 admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:13.579480 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a10a87-2deb-46ca-9d16-5984a6d99e82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:13.579870 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a10a87-2deb-46ca-9d16-5984a6d99e82 admin admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:13.580164 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a10a87-2deb-46ca-9d16-5984a6d99e82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:13.580458 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a10a87-2deb-46ca-9d16-5984a6d99e82 admin admin] PATH_INFO: `/v3/roles` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:13.581204 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a10a87-2deb-46ca-9d16-5984a6d99e82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:13.582917 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a10a87-2deb-46ca-9d16-5984a6d99e82 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:13.595693 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 996/1994] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 17:26:13 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:26:13.615841 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a10a87-2deb-46ca-9d16-5984a6d99e82 admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:13.644359 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a10a87-2deb-46ca-9d16-5984a6d99e82 admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:13.650121 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aede94c1-a22f-482b-9a75-bcf91f902649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:13.651174 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aede94c1-a22f-482b-9a75-bcf91f902649 admin admin] REQUEST_METHOD: `PUT` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:13.651558 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aede94c1-a22f-482b-9a75-bcf91f902649 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:13.652054 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aede94c1-a22f-482b-9a75-bcf91f902649 admin admin] PATH_INFO: `/v3/projects/b5281e94015a4c978c3854389f9294b3/users/77d0993f7a4749c7ab3888d4396a3203/roles/dba744f8ab2a4c45b9d3212f8d203aba` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:13.672256 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aede94c1-a22f-482b-9a75-bcf91f902649 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5281e94015a4c978c3854389f9294b3, user_id=77d0993f7a4749c7ab3888d4396a3203, role_id=dba744f8ab2a4c45b9d3212f8d203aba)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:13.676116 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aede94c1-a22f-482b-9a75-bcf91f902649 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:13.773413 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-2c0e85e1-515f-4c7a-b673-fb5a7877eb5c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '883aff4199f6432bb431c9ad14498d4e', 'request_id': 'req-2c0e85e1-515f-4c7a-b673-fb5a7877eb5c'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:13.778499 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 997/1995] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 17:26:13 2022] PUT /identity/v3/projects/b5281e94015a4c978c3854389f9294b3/users/77d0993f7a4749c7ab3888d4396a3203/roles/dba744f8ab2a4c45b9d3212f8d203aba => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:26:13.782480 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-2c0e85e1-515f-4c7a-b673-fb5a7877eb5c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '883aff4199f6432bb431c9ad14498d4e', 'request_id': 'req-2c0e85e1-515f-4c7a-b673-fb5a7877eb5c'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:13.782617 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aede94c1-a22f-482b-9a75-bcf91f902649 admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:13.788379 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-2c0e85e1-515f-4c7a-b673-fb5a7877eb5c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '883aff4199f6432bb431c9ad14498d4e', 'request_id': 'req-2c0e85e1-515f-4c7a-b673-fb5a7877eb5c'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:13.892986 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-2c0e85e1-515f-4c7a-b673-fb5a7877eb5c admin admin] The token cache is being invalidate because project 883aff4199f6432bb431c9ad14498d4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80873) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 17:26:13.893647 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-2c0e85e1-515f-4c7a-b673-fb5a7877eb5c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:13.897349 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-2c0e85e1-515f-4c7a-b673-fb5a7877eb5c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:13.899848 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 999/1996] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 16 17:26:13 2022] DELETE /identity/v3/projects/883aff4199f6432bb431c9ad14498d4e => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:26:13.901501 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0e85e1-515f-4c7a-b673-fb5a7877eb5c admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:13.903925 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-2c0e85e1-515f-4c7a-b673-fb5a7877eb5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:13.909740 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aede94c1-a22f-482b-9a75-bcf91f902649 admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:13.991050 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0e85e1-515f-4c7a-b673-fb5a7877eb5c admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:13.997265 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226fcafa-f1cb-4b24-9f13-10403efdf75f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:14.002925 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226fcafa-f1cb-4b24-9f13-10403efdf75f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:14.002925 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226fcafa-f1cb-4b24-9f13-10403efdf75f admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:14.002925 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226fcafa-f1cb-4b24-9f13-10403efdf75f admin admin] PATH_INFO: `/v3/users/41223b2d7fd446d6b80dc82884a94e19` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:14.006398 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226fcafa-f1cb-4b24-9f13-10403efdf75f admin admin] RBAC: Authorizing `identity:delete_user(user_id=41223b2d7fd446d6b80dc82884a94e19)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:14.008558 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226fcafa-f1cb-4b24-9f13-10403efdf75f admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:14.009453 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af272231-3f33-475a-8678-0f09a82de45a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:14.010172 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af272231-3f33-475a-8678-0f09a82de45a admin admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:14.010466 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af272231-3f33-475a-8678-0f09a82de45a admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:14.010761 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af272231-3f33-475a-8678-0f09a82de45a admin admin] PATH_INFO: `/v3/roles` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:14.011606 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af272231-3f33-475a-8678-0f09a82de45a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:14.014958 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af272231-3f33-475a-8678-0f09a82de45a admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:14.036328 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 998/1997] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 17:26:13 2022] GET /identity/v3/roles => generated 1420 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 17:26:14.038201 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af272231-3f33-475a-8678-0f09a82de45a admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:14.041437 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-af272231-3f33-475a-8678-0f09a82de45a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:14.085540 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:26:14.089173 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af272231-3f33-475a-8678-0f09a82de45a admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:14.097661 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eeba233-ea34-43a7-9cbd-710d8c4c7583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:14.098642 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeba233-ea34-43a7-9cbd-710d8c4c7583 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:14.098935 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeba233-ea34-43a7-9cbd-710d8c4c7583 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:14.100134 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeba233-ea34-43a7-9cbd-710d8c4c7583 admin admin] PATH_INFO: `/v3/projects/dfc352900ae746f5839a412f4758cfd7` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:14.101394 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eeba233-ea34-43a7-9cbd-710d8c4c7583 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dfc352900ae746f5839a412f4758cfd7)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:14.104372 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eeba233-ea34-43a7-9cbd-710d8c4c7583 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:14.335456 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-226fcafa-f1cb-4b24-9f13-10403efdf75f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41223b2d7fd446d6b80dc82884a94e19'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:14.336330 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-226fcafa-f1cb-4b24-9f13-10403efdf75f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41223b2d7fd446d6b80dc82884a94e19'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:14.337333 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-226fcafa-f1cb-4b24-9f13-10403efdf75f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41223b2d7fd446d6b80dc82884a94e19'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:14.353460 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-5eeba233-ea34-43a7-9cbd-710d8c4c7583 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dfc352900ae746f5839a412f4758cfd7', 'request_id': 'req-5eeba233-ea34-43a7-9cbd-710d8c4c7583'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:14.360195 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-5eeba233-ea34-43a7-9cbd-710d8c4c7583 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dfc352900ae746f5839a412f4758cfd7', 'request_id': 'req-5eeba233-ea34-43a7-9cbd-710d8c4c7583'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:14.419407 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-226fcafa-f1cb-4b24-9f13-10403efdf75f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41223b2d7fd446d6b80dc82884a94e19'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:14.429335 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-226fcafa-f1cb-4b24-9f13-10403efdf75f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41223b2d7fd446d6b80dc82884a94e19'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:14.448120 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1000/1998] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 16 17:26:13 2022] DELETE /identity/v3/users/41223b2d7fd446d6b80dc82884a94e19 => generated 0 bytes in 548 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:26:14.448936 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226fcafa-f1cb-4b24-9f13-10403efdf75f admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:14.450556 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-226fcafa-f1cb-4b24-9f13-10403efdf75f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:14.517311 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-5eeba233-ea34-43a7-9cbd-710d8c4c7583 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dfc352900ae746f5839a412f4758cfd7', 'request_id': 'req-5eeba233-ea34-43a7-9cbd-710d8c4c7583'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:14.535781 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-5eeba233-ea34-43a7-9cbd-710d8c4c7583 admin admin] The token cache is being invalidate because project dfc352900ae746f5839a412f4758cfd7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80874) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 17:26:14.536085 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-5eeba233-ea34-43a7-9cbd-710d8c4c7583 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:14.539669 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-5eeba233-ea34-43a7-9cbd-710d8c4c7583 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:14.544801 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 999/1999] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 16 17:26:14 2022] DELETE /identity/v3/projects/dfc352900ae746f5839a412f4758cfd7 => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:26:14.548755 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eeba233-ea34-43a7-9cbd-710d8c4c7583 admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:14.550766 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-5eeba233-ea34-43a7-9cbd-710d8c4c7583 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:14.555021 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226fcafa-f1cb-4b24-9f13-10403efdf75f admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:14.565859 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be14af89-df02-4c61-86c5-316b743dac63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:14.567649 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be14af89-df02-4c61-86c5-316b743dac63 admin admin] REQUEST_METHOD: `PUT` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:14.567939 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be14af89-df02-4c61-86c5-316b743dac63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:14.569936 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be14af89-df02-4c61-86c5-316b743dac63 admin admin] PATH_INFO: `/v3/projects/b5281e94015a4c978c3854389f9294b3/users/77d0993f7a4749c7ab3888d4396a3203/roles/dba744f8ab2a4c45b9d3212f8d203aba` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:14.578210 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be14af89-df02-4c61-86c5-316b743dac63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5281e94015a4c978c3854389f9294b3, user_id=77d0993f7a4749c7ab3888d4396a3203, role_id=dba744f8ab2a4c45b9d3212f8d203aba)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:14.581401 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be14af89-df02-4c61-86c5-316b743dac63 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:14.600079 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1001/2000] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 17:26:14 2022] PUT /identity/v3/projects/b5281e94015a4c978c3854389f9294b3/users/77d0993f7a4749c7ab3888d4396a3203/roles/dba744f8ab2a4c45b9d3212f8d203aba => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:26:14.615645 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b005a2-3f01-441a-81ad-1e50b061f605 None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:14.616072 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b005a2-3f01-441a-81ad-1e50b061f605 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:14.616373 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b005a2-3f01-441a-81ad-1e50b061f605 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:14.648842 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-d3b005a2-3f01-441a-81ad-1e50b061f605 None None] MFA Rules not processed for user `77d0993f7a4749c7ab3888d4396a3203`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:26:14.650269 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-d3b005a2-3f01-441a-81ad-1e50b061f605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:14.650664 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eeba233-ea34-43a7-9cbd-710d8c4c7583 admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:14.728295 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9a48d8-c5b3-4de6-bd68-e554eb4f4955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:14.729359 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9a48d8-c5b3-4de6-bd68-e554eb4f4955 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:14.729713 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9a48d8-c5b3-4de6-bd68-e554eb4f4955 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:14.730180 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9a48d8-c5b3-4de6-bd68-e554eb4f4955 admin admin] PATH_INFO: `/v3/users/b83e9e3946bd4fe6b14fa5d3eadd01e2` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:14.732317 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9a48d8-c5b3-4de6-bd68-e554eb4f4955 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b83e9e3946bd4fe6b14fa5d3eadd01e2)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:14.734839 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9a48d8-c5b3-4de6-bd68-e554eb4f4955 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:14.741688 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1002/2001] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:26:14 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 17:26:14.765432 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:26:15.006732 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b005a2-3f01-441a-81ad-1e50b061f605 None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:15.008387 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-d3b005a2-3f01-441a-81ad-1e50b061f605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:15.077193 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b005a2-3f01-441a-81ad-1e50b061f605 None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:15.079876 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-fb9a48d8-c5b3-4de6-bd68-e554eb4f4955 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b83e9e3946bd4fe6b14fa5d3eadd01e2'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:15.085817 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdd91d5-25d2-4bf5-b13b-0cfc1133babc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef37136b89d34edc9cd94c7aa81b2095', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:15.087604 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdd91d5-25d2-4bf5-b13b-0cfc1133babc service cinder] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:15.087980 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdd91d5-25d2-4bf5-b13b-0cfc1133babc service cinder] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:15.088342 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdd91d5-25d2-4bf5-b13b-0cfc1133babc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:15.090395 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-fb9a48d8-c5b3-4de6-bd68-e554eb4f4955 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b83e9e3946bd4fe6b14fa5d3eadd01e2'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:15.091924 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-6cdd91d5-25d2-4bf5-b13b-0cfc1133babc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:15.166753 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdd91d5-25d2-4bf5-b13b-0cfc1133babc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:15.168418 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdd91d5-25d2-4bf5-b13b-0cfc1133babc service cinder] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:15.182912 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1003/2002] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:26:15 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 17:26:15.185515 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdd91d5-25d2-4bf5-b13b-0cfc1133babc service cinder] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:15.187621 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-6cdd91d5-25d2-4bf5-b13b-0cfc1133babc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:15.191676 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-fb9a48d8-c5b3-4de6-bd68-e554eb4f4955 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b83e9e3946bd4fe6b14fa5d3eadd01e2'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:15.192735 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-fb9a48d8-c5b3-4de6-bd68-e554eb4f4955 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b83e9e3946bd4fe6b14fa5d3eadd01e2'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:15.217170 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-fb9a48d8-c5b3-4de6-bd68-e554eb4f4955 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b83e9e3946bd4fe6b14fa5d3eadd01e2'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:15.228749 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1000/2003] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 16 17:26:14 2022] DELETE /identity/v3/users/b83e9e3946bd4fe6b14fa5d3eadd01e2 => generated 0 bytes in 680 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:26:15.232283 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdd91d5-25d2-4bf5-b13b-0cfc1133babc service cinder] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:15.350795 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7bb49c-09d8-42a3-b391-7c2beb10d68f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:15.352050 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7bb49c-09d8-42a3-b391-7c2beb10d68f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:15.352450 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7bb49c-09d8-42a3-b391-7c2beb10d68f admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:15.352847 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7bb49c-09d8-42a3-b391-7c2beb10d68f admin admin] PATH_INFO: `/v3/projects/ec862642f56a4dec939f2fa6438f8a9e` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:15.354537 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7bb49c-09d8-42a3-b391-7c2beb10d68f admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec862642f56a4dec939f2fa6438f8a9e)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:15.357836 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7bb49c-09d8-42a3-b391-7c2beb10d68f admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:15.529399 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-cc7bb49c-09d8-42a3-b391-7c2beb10d68f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec862642f56a4dec939f2fa6438f8a9e', 'request_id': 'req-cc7bb49c-09d8-42a3-b391-7c2beb10d68f'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:15.541734 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-cc7bb49c-09d8-42a3-b391-7c2beb10d68f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec862642f56a4dec939f2fa6438f8a9e', 'request_id': 'req-cc7bb49c-09d8-42a3-b391-7c2beb10d68f'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:15.550611 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-cc7bb49c-09d8-42a3-b391-7c2beb10d68f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec862642f56a4dec939f2fa6438f8a9e', 'request_id': 'req-cc7bb49c-09d8-42a3-b391-7c2beb10d68f'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:15.658743 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-cc7bb49c-09d8-42a3-b391-7c2beb10d68f admin admin] The token cache is being invalidate because project ec862642f56a4dec939f2fa6438f8a9e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80873) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 17:26:15.659422 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-cc7bb49c-09d8-42a3-b391-7c2beb10d68f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:15.660288 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-cc7bb49c-09d8-42a3-b391-7c2beb10d68f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:15.662418 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1004/2004] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 16 17:26:15 2022] DELETE /identity/v3/projects/ec862642f56a4dec939f2fa6438f8a9e => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:26:15.668813 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dd3bf1-5035-4a0e-afa2-8cdc5223cb6d None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:15.669112 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dd3bf1-5035-4a0e-afa2-8cdc5223cb6d None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:15.669400 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dd3bf1-5035-4a0e-afa2-8cdc5223cb6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:15.694604 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-26dd3bf1-5035-4a0e-afa2-8cdc5223cb6d None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:26:15.697326 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-26dd3bf1-5035-4a0e-afa2-8cdc5223cb6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:15.760176 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7bb49c-09d8-42a3-b391-7c2beb10d68f admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:15.764563 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-cc7bb49c-09d8-42a3-b391-7c2beb10d68f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:15.786222 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:DELETE=20,keystone:SELECT=78,keystone:INSERT=2 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:26:15.802923 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1001/2005] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:26:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:26:15.814643 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdc9293-e813-49d1-a3e6-2c428ac1d29e None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:15.815358 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdc9293-e813-49d1-a3e6-2c428ac1d29e None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:15.815851 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdc9293-e813-49d1-a3e6-2c428ac1d29e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:15.841424 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-fbdc9293-e813-49d1-a3e6-2c428ac1d29e None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:26:15.844893 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-fbdc9293-e813-49d1-a3e6-2c428ac1d29e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:15.853848 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7bb49c-09d8-42a3-b391-7c2beb10d68f admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:15.854663 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1002/2006] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:26:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 17:26:15.859231 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ee1f1a-4ba5-468f-8b5f-d9c63c02965f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef37136b89d34edc9cd94c7aa81b2095', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:15.859553 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdc9293-e813-49d1-a3e6-2c428ac1d29e None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:15.860043 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ee1f1a-4ba5-468f-8b5f-d9c63c02965f service cinder] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:15.860401 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ee1f1a-4ba5-468f-8b5f-d9c63c02965f service cinder] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:15.860751 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ee1f1a-4ba5-468f-8b5f-d9c63c02965f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:15.862738 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-a2ee1f1a-4ba5-468f-8b5f-d9c63c02965f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:15.869588 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdc9293-e813-49d1-a3e6-2c428ac1d29e None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:15.875180 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c601cf29-84fd-4935-bef3-ab87ffa3ba7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:15.875953 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c601cf29-84fd-4935-bef3-ab87ffa3ba7a admin admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:15.876262 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c601cf29-84fd-4935-bef3-ab87ffa3ba7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:15.876549 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c601cf29-84fd-4935-bef3-ab87ffa3ba7a admin admin] PATH_INFO: `/v3/domains` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:15.882393 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c601cf29-84fd-4935-bef3-ab87ffa3ba7a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:26:15.882393 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c601cf29-84fd-4935-bef3-ab87ffa3ba7a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:15.882393 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c601cf29-84fd-4935-bef3-ab87ffa3ba7a admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:15.897219 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1003/2007] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 16 17:26:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 17:26:15.898316 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c601cf29-84fd-4935-bef3-ab87ffa3ba7a admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:15.919710 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c601cf29-84fd-4935-bef3-ab87ffa3ba7a admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:15.947108 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ee1f1a-4ba5-468f-8b5f-d9c63c02965f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:15.948591 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ee1f1a-4ba5-468f-8b5f-d9c63c02965f service cinder] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:15.952121 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e0ee28-769c-40ff-8efc-95332409590b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:15.953005 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e0ee28-769c-40ff-8efc-95332409590b admin admin] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:15.953324 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e0ee28-769c-40ff-8efc-95332409590b admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:15.955330 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e0ee28-769c-40ff-8efc-95332409590b admin admin] PATH_INFO: `/v3/projects` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:15.955330 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e0ee28-769c-40ff-8efc-95332409590b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:15.960453 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e0ee28-769c-40ff-8efc-95332409590b admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:15.963199 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1005/2008] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:26:15 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:26:15.964077 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ee1f1a-4ba5-468f-8b5f-d9c63c02965f service cinder] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:15.965993 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-a2ee1f1a-4ba5-468f-8b5f-d9c63c02965f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:15.983430 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ee1f1a-4ba5-468f-8b5f-d9c63c02965f service cinder] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:15.989237 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da61d260-d7df-421a-ba5e-9791bc1a9705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:15.990312 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da61d260-d7df-421a-ba5e-9791bc1a9705 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:15.990601 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da61d260-d7df-421a-ba5e-9791bc1a9705 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:15.990934 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da61d260-d7df-421a-ba5e-9791bc1a9705 admin admin] PATH_INFO: `/v3/projects/449133e6eed54cb6abb36b796f6a8302` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:15.995454 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da61d260-d7df-421a-ba5e-9791bc1a9705 admin admin] RBAC: Authorizing `identity:delete_project(project_id=449133e6eed54cb6abb36b796f6a8302)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:15.995454 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da61d260-d7df-421a-ba5e-9791bc1a9705 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:16.131827 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1004/2009] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 16 17:26:15 2022] POST /identity/v3/projects => generated 365 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:26:16.134356 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e0ee28-769c-40ff-8efc-95332409590b admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:16.140091 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-da61d260-d7df-421a-ba5e-9791bc1a9705 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '449133e6eed54cb6abb36b796f6a8302', 'request_id': 'req-da61d260-d7df-421a-ba5e-9791bc1a9705'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:16.145509 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-c2e0ee28-769c-40ff-8efc-95332409590b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:16.153855 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-da61d260-d7df-421a-ba5e-9791bc1a9705 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '449133e6eed54cb6abb36b796f6a8302', 'request_id': 'req-da61d260-d7df-421a-ba5e-9791bc1a9705'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:16.173449 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-da61d260-d7df-421a-ba5e-9791bc1a9705 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '449133e6eed54cb6abb36b796f6a8302', 'request_id': 'req-da61d260-d7df-421a-ba5e-9791bc1a9705'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:16.258240 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-da61d260-d7df-421a-ba5e-9791bc1a9705 admin admin] The token cache is being invalidate because project 449133e6eed54cb6abb36b796f6a8302 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80873) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 17:26:16.258648 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-da61d260-d7df-421a-ba5e-9791bc1a9705 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:16.259443 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-da61d260-d7df-421a-ba5e-9791bc1a9705 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:16.261994 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1006/2010] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 16 17:26:15 2022] DELETE /identity/v3/projects/449133e6eed54cb6abb36b796f6a8302 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:26:16.263190 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da61d260-d7df-421a-ba5e-9791bc1a9705 admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:16.265000 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-da61d260-d7df-421a-ba5e-9791bc1a9705 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:16.268832 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e0ee28-769c-40ff-8efc-95332409590b admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:16.281859 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11590be1-6af6-498d-ae31-4fc3926a83c0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef37136b89d34edc9cd94c7aa81b2095', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:16.282559 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11590be1-6af6-498d-ae31-4fc3926a83c0 service cinder] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:16.282851 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11590be1-6af6-498d-ae31-4fc3926a83c0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:16.283136 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11590be1-6af6-498d-ae31-4fc3926a83c0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:16.287849 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-11590be1-6af6-498d-ae31-4fc3926a83c0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:16.377594 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da61d260-d7df-421a-ba5e-9791bc1a9705 admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:16.414829 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11590be1-6af6-498d-ae31-4fc3926a83c0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:16.416461 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11590be1-6af6-498d-ae31-4fc3926a83c0 service cinder] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:16.429701 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1005/2011] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:26:16 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:26:16.432023 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43048809-3065-40c7-9e8d-9512cf89c917 None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:16.432346 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43048809-3065-40c7-9e8d-9512cf89c917 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:16.432672 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43048809-3065-40c7-9e8d-9512cf89c917 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:16.458830 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-43048809-3065-40c7-9e8d-9512cf89c917 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:26:16.460562 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-43048809-3065-40c7-9e8d-9512cf89c917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:16.464345 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abdcd92-33ae-4ab5-94e9-993d66f5fbb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:16.465692 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abdcd92-33ae-4ab5-94e9-993d66f5fbb4 admin admin] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:16.466128 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abdcd92-33ae-4ab5-94e9-993d66f5fbb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:16.466475 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abdcd92-33ae-4ab5-94e9-993d66f5fbb4 admin admin] PATH_INFO: `/v3/users` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:16.467362 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abdcd92-33ae-4ab5-94e9-993d66f5fbb4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:16.469570 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abdcd92-33ae-4ab5-94e9-993d66f5fbb4 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:16.472832 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1006/2012] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:26:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:26:16.482335 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee450b3-cf41-4681-b46f-3f50112521d8 None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:16.482661 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee450b3-cf41-4681-b46f-3f50112521d8 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:16.483002 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee450b3-cf41-4681-b46f-3f50112521d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:16.495195 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:26:16.517596 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-eee450b3-cf41-4681-b46f-3f50112521d8 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:26:16.519094 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-eee450b3-cf41-4681-b46f-3f50112521d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:16.529526 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1007/2013] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:26:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 17:26:16.535677 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee450b3-cf41-4681-b46f-3f50112521d8 None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:16.547433 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee450b3-cf41-4681-b46f-3f50112521d8 None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:16.554639 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5ef1c6-83f3-4cc3-8d48-3e4ab5820afb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:16.555601 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5ef1c6-83f3-4cc3-8d48-3e4ab5820afb admin admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:16.556159 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5ef1c6-83f3-4cc3-8d48-3e4ab5820afb admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:16.556432 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5ef1c6-83f3-4cc3-8d48-3e4ab5820afb admin admin] PATH_INFO: `/v3/domains` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:16.557503 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5ef1c6-83f3-4cc3-8d48-3e4ab5820afb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:26:16.558096 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5ef1c6-83f3-4cc3-8d48-3e4ab5820afb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:16.559785 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1007/2014] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 16 17:26:16 2022] POST /identity/v3/users => generated 283 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:26:16.559996 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5ef1c6-83f3-4cc3-8d48-3e4ab5820afb admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:16.566849 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abdcd92-33ae-4ab5-94e9-993d66f5fbb4 admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:16.578073 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1008/2015] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 16 17:26:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 17:26:16.579992 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abdcd92-33ae-4ab5-94e9-993d66f5fbb4 admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:16.581150 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5ef1c6-83f3-4cc3-8d48-3e4ab5820afb admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:16.585639 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de49a90-820c-41cc-bf4e-0b4d822aa2d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:16.591633 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de49a90-820c-41cc-bf4e-0b4d822aa2d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:16.591633 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de49a90-820c-41cc-bf4e-0b4d822aa2d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:16.591633 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de49a90-820c-41cc-bf4e-0b4d822aa2d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:16.591633 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de49a90-820c-41cc-bf4e-0b4d822aa2d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:16.591633 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de49a90-820c-41cc-bf4e-0b4d822aa2d9 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:16.595495 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5ef1c6-83f3-4cc3-8d48-3e4ab5820afb admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:16.601814 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df1ea13-42b9-4279-b4a5-c38aaacc5d08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:16.602832 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df1ea13-42b9-4279-b4a5-c38aaacc5d08 admin admin] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:16.602955 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1008/2016] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 17:26:16 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:26:16.603323 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df1ea13-42b9-4279-b4a5-c38aaacc5d08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:16.603779 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df1ea13-42b9-4279-b4a5-c38aaacc5d08 admin admin] PATH_INFO: `/v3/projects` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:16.604760 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df1ea13-42b9-4279-b4a5-c38aaacc5d08 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:16.607016 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de49a90-820c-41cc-bf4e-0b4d822aa2d9 admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:16.607983 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df1ea13-42b9-4279-b4a5-c38aaacc5d08 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:16.629360 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de49a90-820c-41cc-bf4e-0b4d822aa2d9 admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:16.639218 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26bc86d-2ada-48b5-a997-7dbec89e2ca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:16.639932 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26bc86d-2ada-48b5-a997-7dbec89e2ca4 admin admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:16.640395 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26bc86d-2ada-48b5-a997-7dbec89e2ca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:16.640734 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26bc86d-2ada-48b5-a997-7dbec89e2ca4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:16.641522 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26bc86d-2ada-48b5-a997-7dbec89e2ca4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:16.643230 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26bc86d-2ada-48b5-a997-7dbec89e2ca4 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:16.655255 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1009/2017] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 17:26:16 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:26:16.659531 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26bc86d-2ada-48b5-a997-7dbec89e2ca4 admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:16.670281 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26bc86d-2ada-48b5-a997-7dbec89e2ca4 admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:16.674983 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aba5ff6-0934-45d0-a0c5-43c819401f3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:16.675899 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aba5ff6-0934-45d0-a0c5-43c819401f3a admin admin] REQUEST_METHOD: `PUT` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:16.676181 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aba5ff6-0934-45d0-a0c5-43c819401f3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:16.676458 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aba5ff6-0934-45d0-a0c5-43c819401f3a admin admin] PATH_INFO: `/v3/projects/d8f5f046e15747c9b947d1bbd657a96c/users/c3b78bee1a424165bdd2d81eb074373b/roles/896bff49c5d6464eb612a15f4aa9badc` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:16.692315 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aba5ff6-0934-45d0-a0c5-43c819401f3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8f5f046e15747c9b947d1bbd657a96c, user_id=c3b78bee1a424165bdd2d81eb074373b, role_id=896bff49c5d6464eb612a15f4aa9badc)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:16.695175 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aba5ff6-0934-45d0-a0c5-43c819401f3a admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:16.730220 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1009/2018] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 16 17:26:16 2022] POST /identity/v3/projects => generated 387 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:26:16.737146 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df1ea13-42b9-4279-b4a5-c38aaacc5d08 admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:16.789933 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1010/2019] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 17:26:16 2022] PUT /identity/v3/projects/d8f5f046e15747c9b947d1bbd657a96c/users/c3b78bee1a424165bdd2d81eb074373b/roles/896bff49c5d6464eb612a15f4aa9badc => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 17:26:16.803077 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd2c116-c237-4222-92ef-b9da38857473 None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:16.803387 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd2c116-c237-4222-92ef-b9da38857473 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:16.803670 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd2c116-c237-4222-92ef-b9da38857473 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:16.837383 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-ebd2c116-c237-4222-92ef-b9da38857473 None None] MFA Rules not processed for user `c3b78bee1a424165bdd2d81eb074373b`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:26:16.848904 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-ebd2c116-c237-4222-92ef-b9da38857473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:16.894291 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df1ea13-42b9-4279-b4a5-c38aaacc5d08 admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:16.987254 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1011/2020] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:26:16 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 17:26:16.995216 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd2c116-c237-4222-92ef-b9da38857473 None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:17.040743 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2fbe26-7dcf-4cc8-bc51-afc73d897afd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:17.041739 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2fbe26-7dcf-4cc8-bc51-afc73d897afd admin admin] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:17.042259 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2fbe26-7dcf-4cc8-bc51-afc73d897afd admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:17.042712 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2fbe26-7dcf-4cc8-bc51-afc73d897afd admin admin] PATH_INFO: `/v3/users` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:17.043803 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2fbe26-7dcf-4cc8-bc51-afc73d897afd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:17.055443 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2fbe26-7dcf-4cc8-bc51-afc73d897afd admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:17.174718 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd2c116-c237-4222-92ef-b9da38857473 None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:17.182554 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f1e539-8e87-4b0d-bfb2-7163bea24afb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:17.184040 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f1e539-8e87-4b0d-bfb2-7163bea24afb admin admin] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:17.184444 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f1e539-8e87-4b0d-bfb2-7163bea24afb admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:17.184838 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f1e539-8e87-4b0d-bfb2-7163bea24afb admin admin] PATH_INFO: `/v3/projects` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:17.186341 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f1e539-8e87-4b0d-bfb2-7163bea24afb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:17.190028 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f1e539-8e87-4b0d-bfb2-7163bea24afb admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:17.280959 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1010/2021] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 16 17:26:16 2022] POST /identity/v3/users => generated 294 bytes in 545 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 17:26:17.285156 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2fbe26-7dcf-4cc8-bc51-afc73d897afd admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:17.298913 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2fbe26-7dcf-4cc8-bc51-afc73d897afd admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:17.306248 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5fcbdf-2ec5-45f3-aee9-b69ce814a921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:17.307396 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5fcbdf-2ec5-45f3-aee9-b69ce814a921 admin admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:17.307963 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5fcbdf-2ec5-45f3-aee9-b69ce814a921 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:17.309435 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5fcbdf-2ec5-45f3-aee9-b69ce814a921 admin admin] PATH_INFO: `/v3/roles` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:17.310493 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5fcbdf-2ec5-45f3-aee9-b69ce814a921 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:17.312366 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5fcbdf-2ec5-45f3-aee9-b69ce814a921 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:17.314713 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1012/2022] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 16 17:26:16 2022] POST /identity/v3/projects => generated 365 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:26:17.315972 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f1e539-8e87-4b0d-bfb2-7163bea24afb admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:17.325328 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1011/2023] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 17:26:17 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 17:26:17.329506 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5fcbdf-2ec5-45f3-aee9-b69ce814a921 admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:17.340968 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5fcbdf-2ec5-45f3-aee9-b69ce814a921 admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:17.410276 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f1e539-8e87-4b0d-bfb2-7163bea24afb admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:17.412773 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bc5a39-8c3f-4ef6-b0b3-909da5df129e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:17.413695 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bc5a39-8c3f-4ef6-b0b3-909da5df129e admin admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:17.414234 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bc5a39-8c3f-4ef6-b0b3-909da5df129e admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:17.414769 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bc5a39-8c3f-4ef6-b0b3-909da5df129e admin admin] PATH_INFO: `/v3/roles` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:17.415543 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bc5a39-8c3f-4ef6-b0b3-909da5df129e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:17.417162 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bc5a39-8c3f-4ef6-b0b3-909da5df129e admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:17.423337 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35898184-30be-4694-8197-638dda2d4b44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:17.424395 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35898184-30be-4694-8197-638dda2d4b44 admin admin] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:17.424879 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35898184-30be-4694-8197-638dda2d4b44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:17.425439 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35898184-30be-4694-8197-638dda2d4b44 admin admin] PATH_INFO: `/v3/users` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:17.426353 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35898184-30be-4694-8197-638dda2d4b44 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:17.428676 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35898184-30be-4694-8197-638dda2d4b44 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:17.431986 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1012/2024] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 17:26:17 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 17:26:17.432856 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bc5a39-8c3f-4ef6-b0b3-909da5df129e admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:17.443937 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bc5a39-8c3f-4ef6-b0b3-909da5df129e admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:17.448981 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983f0133-df6b-4d94-a273-b309ba92c6f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:17.450175 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983f0133-df6b-4d94-a273-b309ba92c6f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:17.450471 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983f0133-df6b-4d94-a273-b309ba92c6f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:17.450752 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983f0133-df6b-4d94-a273-b309ba92c6f7 admin admin] PATH_INFO: `/v3/projects/12d0e555957c4769b2a97d42eb93bb88/users/7b56086e53cd48fda7f183abcdf374f0/roles/896bff49c5d6464eb612a15f4aa9badc` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:17.468367 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983f0133-df6b-4d94-a273-b309ba92c6f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=12d0e555957c4769b2a97d42eb93bb88, user_id=7b56086e53cd48fda7f183abcdf374f0, role_id=896bff49c5d6464eb612a15f4aa9badc)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:17.471877 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983f0133-df6b-4d94-a273-b309ba92c6f7 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:17.553905 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1013/2025] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 16 17:26:17 2022] POST /identity/v3/users => generated 289 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:26:17.559188 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35898184-30be-4694-8197-638dda2d4b44 admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:17.569392 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35898184-30be-4694-8197-638dda2d4b44 admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:17.576873 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bd5d3b-2543-4adc-b902-e56367a8b824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:17.577479 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bd5d3b-2543-4adc-b902-e56367a8b824 admin admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:17.577870 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bd5d3b-2543-4adc-b902-e56367a8b824 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:17.578159 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bd5d3b-2543-4adc-b902-e56367a8b824 admin admin] PATH_INFO: `/v3/roles` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:17.579032 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bd5d3b-2543-4adc-b902-e56367a8b824 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:17.580711 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bd5d3b-2543-4adc-b902-e56367a8b824 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:17.582075 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1013/2026] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 17:26:17 2022] PUT /identity/v3/projects/12d0e555957c4769b2a97d42eb93bb88/users/7b56086e53cd48fda7f183abcdf374f0/roles/896bff49c5d6464eb612a15f4aa9badc => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:26:17.592571 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1014/2027] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 17:26:17 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 17:26:17.595873 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bba6f3-693e-40bc-bd54-82ea1bf031ad None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:17.596166 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bba6f3-693e-40bc-bd54-82ea1bf031ad None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:17.597223 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bd5d3b-2543-4adc-b902-e56367a8b824 admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:17.597866 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bba6f3-693e-40bc-bd54-82ea1bf031ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:17.608646 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bd5d3b-2543-4adc-b902-e56367a8b824 admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:17.627664 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-f2bba6f3-693e-40bc-bd54-82ea1bf031ad None None] MFA Rules not processed for user `7b56086e53cd48fda7f183abcdf374f0`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:26:17.628963 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-f2bba6f3-693e-40bc-bd54-82ea1bf031ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:17.672500 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9631f33c-dd83-4cf5-923a-a44c1674e8e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:17.673449 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9631f33c-dd83-4cf5-923a-a44c1674e8e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:17.673770 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9631f33c-dd83-4cf5-923a-a44c1674e8e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:17.674088 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9631f33c-dd83-4cf5-923a-a44c1674e8e8 admin admin] PATH_INFO: `/v3/projects/7a9b71cdab204fe3b25fcb6b027061ad/users/47efb5fde4bd43cbaa05e325c7d6c679/roles/dba744f8ab2a4c45b9d3212f8d203aba` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:17.689751 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9631f33c-dd83-4cf5-923a-a44c1674e8e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a9b71cdab204fe3b25fcb6b027061ad, user_id=47efb5fde4bd43cbaa05e325c7d6c679, role_id=dba744f8ab2a4c45b9d3212f8d203aba)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:17.692728 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9631f33c-dd83-4cf5-923a-a44c1674e8e8 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:17.703434 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1014/2028] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:26:17 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:26:17.704633 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bba6f3-693e-40bc-bd54-82ea1bf031ad None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:17.717325 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bba6f3-693e-40bc-bd54-82ea1bf031ad None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:17.722688 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b93a33-d0b6-46ba-accb-bfe6e0b1ac49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:17.723438 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b93a33-d0b6-46ba-accb-bfe6e0b1ac49 admin admin] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:17.723768 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b93a33-d0b6-46ba-accb-bfe6e0b1ac49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:17.724102 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b93a33-d0b6-46ba-accb-bfe6e0b1ac49 admin admin] PATH_INFO: `/v3/projects` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:17.724960 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b93a33-d0b6-46ba-accb-bfe6e0b1ac49 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:17.727284 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b93a33-d0b6-46ba-accb-bfe6e0b1ac49 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:17.795122 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1015/2029] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 17:26:17 2022] PUT /identity/v3/projects/7a9b71cdab204fe3b25fcb6b027061ad/users/47efb5fde4bd43cbaa05e325c7d6c679/roles/dba744f8ab2a4c45b9d3212f8d203aba => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:26:17.799435 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9631f33c-dd83-4cf5-923a-a44c1674e8e8 admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:17.828407 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1015/2030] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 16 17:26:17 2022] POST /identity/v3/projects => generated 387 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:26:17.832750 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b93a33-d0b6-46ba-accb-bfe6e0b1ac49 admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:17.874970 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9631f33c-dd83-4cf5-923a-a44c1674e8e8 admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:17.925575 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b93a33-d0b6-46ba-accb-bfe6e0b1ac49 admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:17.930989 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556fc9cc-66bd-4371-9f37-7a2b4e877304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:17.931740 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556fc9cc-66bd-4371-9f37-7a2b4e877304 admin admin] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:17.932099 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556fc9cc-66bd-4371-9f37-7a2b4e877304 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:17.932387 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556fc9cc-66bd-4371-9f37-7a2b4e877304 admin admin] PATH_INFO: `/v3/users` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:17.933106 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556fc9cc-66bd-4371-9f37-7a2b4e877304 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:17.935090 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556fc9cc-66bd-4371-9f37-7a2b4e877304 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:17.945406 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99182df2-d753-4c0c-9bdb-9f28abe64adf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:17.946049 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99182df2-d753-4c0c-9bdb-9f28abe64adf admin admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:17.946341 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99182df2-d753-4c0c-9bdb-9f28abe64adf admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:17.946625 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99182df2-d753-4c0c-9bdb-9f28abe64adf admin admin] PATH_INFO: `/v3/roles` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:17.947369 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99182df2-d753-4c0c-9bdb-9f28abe64adf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:17.949050 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99182df2-d753-4c0c-9bdb-9f28abe64adf admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:17.960583 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1016/2031] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 17:26:17 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 17:26:17.965176 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99182df2-d753-4c0c-9bdb-9f28abe64adf admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:17.977084 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99182df2-d753-4c0c-9bdb-9f28abe64adf admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:17.983426 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221976e1-1788-4cb7-bd2f-8a3269418418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:17.984426 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221976e1-1788-4cb7-bd2f-8a3269418418 admin admin] REQUEST_METHOD: `PUT` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:17.984838 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221976e1-1788-4cb7-bd2f-8a3269418418 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:17.985248 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221976e1-1788-4cb7-bd2f-8a3269418418 admin admin] PATH_INFO: `/v3/projects/7a9b71cdab204fe3b25fcb6b027061ad/users/47efb5fde4bd43cbaa05e325c7d6c679/roles/dba744f8ab2a4c45b9d3212f8d203aba` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:17.987633 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221976e1-1788-4cb7-bd2f-8a3269418418 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a9b71cdab204fe3b25fcb6b027061ad, user_id=47efb5fde4bd43cbaa05e325c7d6c679, role_id=dba744f8ab2a4c45b9d3212f8d203aba)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:17.990881 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221976e1-1788-4cb7-bd2f-8a3269418418 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:18.003277 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1017/2032] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 17:26:17 2022] PUT /identity/v3/projects/7a9b71cdab204fe3b25fcb6b027061ad/users/47efb5fde4bd43cbaa05e325c7d6c679/roles/dba744f8ab2a4c45b9d3212f8d203aba => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 17:26:18.016599 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14e03ba-14ab-4acc-a789-9554035ea671 None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:18.017021 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14e03ba-14ab-4acc-a789-9554035ea671 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:18.017444 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14e03ba-14ab-4acc-a789-9554035ea671 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:18.060994 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-b14e03ba-14ab-4acc-a789-9554035ea671 None None] MFA Rules not processed for user `47efb5fde4bd43cbaa05e325c7d6c679`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:26:18.062620 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-b14e03ba-14ab-4acc-a789-9554035ea671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:18.077810 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1016/2033] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 16 17:26:17 2022] POST /identity/v3/users => generated 300 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 17:26:18.080618 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556fc9cc-66bd-4371-9f37-7a2b4e877304 admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:18.092554 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556fc9cc-66bd-4371-9f37-7a2b4e877304 admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:18.157303 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1018/2034] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:26:18 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:26:18.165267 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db92149-e8cf-4df4-9fce-d32b497d8569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:18.165978 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db92149-e8cf-4df4-9fce-d32b497d8569 admin admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:18.166271 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db92149-e8cf-4df4-9fce-d32b497d8569 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:18.166556 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db92149-e8cf-4df4-9fce-d32b497d8569 admin admin] PATH_INFO: `/v3/roles` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:18.167327 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db92149-e8cf-4df4-9fce-d32b497d8569 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:18.169042 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db92149-e8cf-4df4-9fce-d32b497d8569 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:18.179491 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1017/2035] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 17:26:18 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 17:26:18.184164 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14e03ba-14ab-4acc-a789-9554035ea671 None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:18.203790 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14e03ba-14ab-4acc-a789-9554035ea671 None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:18.209998 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23645d3-969f-4d35-a18a-388285a2094c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:18.211258 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23645d3-969f-4d35-a18a-388285a2094c admin admin] REQUEST_METHOD: `PUT` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:18.211651 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23645d3-969f-4d35-a18a-388285a2094c admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:18.212059 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23645d3-969f-4d35-a18a-388285a2094c admin admin] PATH_INFO: `/v3/projects/43b6ffc05b694bdcbb7cc1c912bbba94/users/a1ab69f9871b4ca7a499211c6bc53865/roles/dba744f8ab2a4c45b9d3212f8d203aba` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:18.229257 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23645d3-969f-4d35-a18a-388285a2094c admin admin] RBAC: Authorizing `identity:create_grant(project_id=43b6ffc05b694bdcbb7cc1c912bbba94, user_id=a1ab69f9871b4ca7a499211c6bc53865, role_id=dba744f8ab2a4c45b9d3212f8d203aba)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:18.232273 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23645d3-969f-4d35-a18a-388285a2094c admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:18.301050 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db92149-e8cf-4df4-9fce-d32b497d8569 admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:18.301050 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-9db92149-e8cf-4df4-9fce-d32b497d8569 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:18.372672 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db92149-e8cf-4df4-9fce-d32b497d8569 admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:18.376646 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3c09e9-438a-4bf9-8eb2-40f1b59837f2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef37136b89d34edc9cd94c7aa81b2095', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:18.377302 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3c09e9-438a-4bf9-8eb2-40f1b59837f2 service cinder] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:18.377586 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3c09e9-438a-4bf9-8eb2-40f1b59837f2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:18.377895 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3c09e9-438a-4bf9-8eb2-40f1b59837f2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:18.389340 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3c09e9-438a-4bf9-8eb2-40f1b59837f2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:18.390918 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3c09e9-438a-4bf9-8eb2-40f1b59837f2 service cinder] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:18.394960 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1019/2036] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 17:26:18 2022] PUT /identity/v3/projects/43b6ffc05b694bdcbb7cc1c912bbba94/users/a1ab69f9871b4ca7a499211c6bc53865/roles/dba744f8ab2a4c45b9d3212f8d203aba => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:26:18.403526 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1018/2037] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:26:18 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:26:18.406891 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23645d3-969f-4d35-a18a-388285a2094c admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:18.475299 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23645d3-969f-4d35-a18a-388285a2094c admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:18.480039 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a0e99c-5b80-4f04-a3ab-3a875e1ad152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:18.480708 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a0e99c-5b80-4f04-a3ab-3a875e1ad152 admin admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:18.480993 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a0e99c-5b80-4f04-a3ab-3a875e1ad152 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:18.483916 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a0e99c-5b80-4f04-a3ab-3a875e1ad152 admin admin] PATH_INFO: `/v3/roles` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:18.483916 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a0e99c-5b80-4f04-a3ab-3a875e1ad152 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:18.483916 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a0e99c-5b80-4f04-a3ab-3a875e1ad152 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:18.493748 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1020/2038] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 17:26:18 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:26:18.499515 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3c09e9-438a-4bf9-8eb2-40f1b59837f2 service cinder] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:18.511866 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3c09e9-438a-4bf9-8eb2-40f1b59837f2 service cinder] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:18.519653 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cb99d0-791d-4740-9bdc-0727c071b930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:18.522341 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cb99d0-791d-4740-9bdc-0727c071b930 admin admin] REQUEST_METHOD: `PUT` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:18.522341 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cb99d0-791d-4740-9bdc-0727c071b930 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:18.522341 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cb99d0-791d-4740-9bdc-0727c071b930 admin admin] PATH_INFO: `/v3/projects/43b6ffc05b694bdcbb7cc1c912bbba94/users/a1ab69f9871b4ca7a499211c6bc53865/roles/dba744f8ab2a4c45b9d3212f8d203aba` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:18.523998 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cb99d0-791d-4740-9bdc-0727c071b930 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43b6ffc05b694bdcbb7cc1c912bbba94, user_id=a1ab69f9871b4ca7a499211c6bc53865, role_id=dba744f8ab2a4c45b9d3212f8d203aba)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:18.527103 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cb99d0-791d-4740-9bdc-0727c071b930 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:18.539622 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1019/2039] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 17:26:18 2022] PUT /identity/v3/projects/43b6ffc05b694bdcbb7cc1c912bbba94/users/a1ab69f9871b4ca7a499211c6bc53865/roles/dba744f8ab2a4c45b9d3212f8d203aba => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 17:26:18.552374 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38528cc-766c-48cb-854c-bff83dcf4952 None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:18.552700 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38528cc-766c-48cb-854c-bff83dcf4952 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:18.553021 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38528cc-766c-48cb-854c-bff83dcf4952 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:18.587443 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-f38528cc-766c-48cb-854c-bff83dcf4952 None None] MFA Rules not processed for user `a1ab69f9871b4ca7a499211c6bc53865`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:26:18.591582 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-f38528cc-766c-48cb-854c-bff83dcf4952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:18.651373 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:26:18.674888 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1021/2040] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:26:18 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:26:18.709060 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:26:18.835111 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cb99d0-791d-4740-9bdc-0727c071b930 admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:18.895284 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cb99d0-791d-4740-9bdc-0727c071b930 admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:18.898990 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a386957-0ba1-48a3-9b93-4e067da63bb7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef37136b89d34edc9cd94c7aa81b2095', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:18.899642 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a386957-0ba1-48a3-9b93-4e067da63bb7 service cinder] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:18.899927 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a386957-0ba1-48a3-9b93-4e067da63bb7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:18.900205 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a386957-0ba1-48a3-9b93-4e067da63bb7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:18.910144 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a386957-0ba1-48a3-9b93-4e067da63bb7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:18.911597 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a386957-0ba1-48a3-9b93-4e067da63bb7 service cinder] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:18.923262 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1020/2041] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:26:18 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:26:18.998379 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38528cc-766c-48cb-854c-bff83dcf4952 None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:19.009914 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38528cc-766c-48cb-854c-bff83dcf4952 None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:19.014366 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a88d6a5-ffcd-49ff-9b6b-a5c7c2a9905c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef37136b89d34edc9cd94c7aa81b2095', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:19.015199 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a88d6a5-ffcd-49ff-9b6b-a5c7c2a9905c service cinder] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:19.015532 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a88d6a5-ffcd-49ff-9b6b-a5c7c2a9905c service cinder] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:19.015857 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a88d6a5-ffcd-49ff-9b6b-a5c7c2a9905c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:19.087222 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a88d6a5-ffcd-49ff-9b6b-a5c7c2a9905c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:19.089236 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a88d6a5-ffcd-49ff-9b6b-a5c7c2a9905c service cinder] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:19.100517 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1022/2042] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:26:18 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 17:26:19.135416 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a386957-0ba1-48a3-9b93-4e067da63bb7 service cinder] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:19.136844 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-8a386957-0ba1-48a3-9b93-4e067da63bb7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:19.149031 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a386957-0ba1-48a3-9b93-4e067da63bb7 service cinder] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:19.153153 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb381f77-869c-43d2-a883-fb720f1a8ae6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef37136b89d34edc9cd94c7aa81b2095', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:19.153923 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb381f77-869c-43d2-a883-fb720f1a8ae6 service cinder] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:19.154349 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb381f77-869c-43d2-a883-fb720f1a8ae6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:19.154641 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb381f77-869c-43d2-a883-fb720f1a8ae6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:19.156987 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-bb381f77-869c-43d2-a883-fb720f1a8ae6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:19.219869 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb381f77-869c-43d2-a883-fb720f1a8ae6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:19.221362 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb381f77-869c-43d2-a883-fb720f1a8ae6 service cinder] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:19.232889 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1021/2043] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:26:19 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:26:20.334357 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a88d6a5-ffcd-49ff-9b6b-a5c7c2a9905c service cinder] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:20.402997 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a88d6a5-ffcd-49ff-9b6b-a5c7c2a9905c service cinder] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:20.409258 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb408d70-6a14-4b05-b888-8701da89f9ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:20.410317 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb408d70-6a14-4b05-b888-8701da89f9ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:20.410615 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb408d70-6a14-4b05-b888-8701da89f9ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:20.410941 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb408d70-6a14-4b05-b888-8701da89f9ae admin admin] PATH_INFO: `/v3/users/7b56086e53cd48fda7f183abcdf374f0` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:20.412277 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb408d70-6a14-4b05-b888-8701da89f9ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b56086e53cd48fda7f183abcdf374f0)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:20.414493 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb408d70-6a14-4b05-b888-8701da89f9ae admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:20.642184 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-bb408d70-6a14-4b05-b888-8701da89f9ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b56086e53cd48fda7f183abcdf374f0'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:20.643860 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-bb408d70-6a14-4b05-b888-8701da89f9ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b56086e53cd48fda7f183abcdf374f0'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:20.643860 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-bb408d70-6a14-4b05-b888-8701da89f9ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b56086e53cd48fda7f183abcdf374f0'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:20.723034 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-bb408d70-6a14-4b05-b888-8701da89f9ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b56086e53cd48fda7f183abcdf374f0'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:20.731418 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-bb408d70-6a14-4b05-b888-8701da89f9ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b56086e53cd48fda7f183abcdf374f0'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:20.750452 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1023/2044] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 16 17:26:20 2022] DELETE /identity/v3/users/7b56086e53cd48fda7f183abcdf374f0 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:26:20.755087 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e11579e-850f-4a34-8dba-8726c849aa6c None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:20.755650 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e11579e-850f-4a34-8dba-8726c849aa6c None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:20.755777 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e11579e-850f-4a34-8dba-8726c849aa6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:20.773725 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-6e11579e-850f-4a34-8dba-8726c849aa6c None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:26:20.774953 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-6e11579e-850f-4a34-8dba-8726c849aa6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:20.857701 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1022/2045] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:26:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:26:20.870971 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb408d70-6a14-4b05-b888-8701da89f9ae admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:20.872523 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-bb408d70-6a14-4b05-b888-8701da89f9ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:20.936754 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb408d70-6a14-4b05-b888-8701da89f9ae admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:20.941261 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd9dccb-2d9a-43d3-b29b-45f42dafb9ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5d25bfa8dc042329d57cd55fa7b7b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:20.942007 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd9dccb-2d9a-43d3-b29b-45f42dafb9ac service neutron] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:20.942355 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd9dccb-2d9a-43d3-b29b-45f42dafb9ac service neutron] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:20.942642 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd9dccb-2d9a-43d3-b29b-45f42dafb9ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:20.953347 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd9dccb-2d9a-43d3-b29b-45f42dafb9ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:20.954921 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd9dccb-2d9a-43d3-b29b-45f42dafb9ac service neutron] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:20.981077 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1024/2046] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:26:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 17:26:21.312327 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:26:21.640473 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e11579e-850f-4a34-8dba-8726c849aa6c None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:21.642764 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-6e11579e-850f-4a34-8dba-8726c849aa6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:21.674759 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e11579e-850f-4a34-8dba-8726c849aa6c None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:21.695026 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71a86cb-f3b8-4d49-a2bf-982fd3333c44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:21.696091 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71a86cb-f3b8-4d49-a2bf-982fd3333c44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:21.696572 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71a86cb-f3b8-4d49-a2bf-982fd3333c44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:21.696846 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71a86cb-f3b8-4d49-a2bf-982fd3333c44 admin admin] PATH_INFO: `/v3/projects/12d0e555957c4769b2a97d42eb93bb88` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:21.702009 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71a86cb-f3b8-4d49-a2bf-982fd3333c44 admin admin] RBAC: Authorizing `identity:delete_project(project_id=12d0e555957c4769b2a97d42eb93bb88)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:21.704024 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71a86cb-f3b8-4d49-a2bf-982fd3333c44 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:21.872605 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd9dccb-2d9a-43d3-b29b-45f42dafb9ac service neutron] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:21.874190 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-ccd9dccb-2d9a-43d3-b29b-45f42dafb9ac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:21.919194 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-c71a86cb-f3b8-4d49-a2bf-982fd3333c44 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12d0e555957c4769b2a97d42eb93bb88', 'request_id': 'req-c71a86cb-f3b8-4d49-a2bf-982fd3333c44'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:21.935167 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-c71a86cb-f3b8-4d49-a2bf-982fd3333c44 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12d0e555957c4769b2a97d42eb93bb88', 'request_id': 'req-c71a86cb-f3b8-4d49-a2bf-982fd3333c44'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:21.953984 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd9dccb-2d9a-43d3-b29b-45f42dafb9ac service neutron] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:22.011643 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e87943-10a8-4b3a-a62c-76fe77b576ea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef37136b89d34edc9cd94c7aa81b2095', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:22.012283 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e87943-10a8-4b3a-a62c-76fe77b576ea service cinder] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:22.013258 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e87943-10a8-4b3a-a62c-76fe77b576ea service cinder] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:22.013258 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e87943-10a8-4b3a-a62c-76fe77b576ea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:22.014570 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-c71a86cb-f3b8-4d49-a2bf-982fd3333c44 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12d0e555957c4769b2a97d42eb93bb88', 'request_id': 'req-c71a86cb-f3b8-4d49-a2bf-982fd3333c44'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:22.015266 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-c2e87943-10a8-4b3a-a62c-76fe77b576ea service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:22.029371 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-c71a86cb-f3b8-4d49-a2bf-982fd3333c44 admin admin] The token cache is being invalidate because project 12d0e555957c4769b2a97d42eb93bb88 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80874) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 17:26:22.029803 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-c71a86cb-f3b8-4d49-a2bf-982fd3333c44 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:22.030729 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-c71a86cb-f3b8-4d49-a2bf-982fd3333c44 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:22.035745 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1023/2047] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 16 17:26:21 2022] DELETE /identity/v3/projects/12d0e555957c4769b2a97d42eb93bb88 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 17:26:22.038225 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71a86cb-f3b8-4d49-a2bf-982fd3333c44 admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:22.038766 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-c71a86cb-f3b8-4d49-a2bf-982fd3333c44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:22.121113 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e87943-10a8-4b3a-a62c-76fe77b576ea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:22.124073 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e87943-10a8-4b3a-a62c-76fe77b576ea service cinder] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:22.140623 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1025/2048] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:26:21 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 17:26:22.150594 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71a86cb-f3b8-4d49-a2bf-982fd3333c44 admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:22.158270 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c910c3cc-539d-490f-8346-1c3338d1b9b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:22.159732 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c910c3cc-539d-490f-8346-1c3338d1b9b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:22.160097 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c910c3cc-539d-490f-8346-1c3338d1b9b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:22.160482 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c910c3cc-539d-490f-8346-1c3338d1b9b4 admin admin] PATH_INFO: `/v3/users/a1ab69f9871b4ca7a499211c6bc53865` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:22.162037 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c910c3cc-539d-490f-8346-1c3338d1b9b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1ab69f9871b4ca7a499211c6bc53865)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:22.166038 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c910c3cc-539d-490f-8346-1c3338d1b9b4 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:22.416930 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:26:22.438626 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-c910c3cc-539d-490f-8346-1c3338d1b9b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1ab69f9871b4ca7a499211c6bc53865'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:22.449633 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-c910c3cc-539d-490f-8346-1c3338d1b9b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1ab69f9871b4ca7a499211c6bc53865'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:22.597264 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-c910c3cc-539d-490f-8346-1c3338d1b9b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1ab69f9871b4ca7a499211c6bc53865'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:22.598076 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-c910c3cc-539d-490f-8346-1c3338d1b9b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1ab69f9871b4ca7a499211c6bc53865'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:22.615523 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-c910c3cc-539d-490f-8346-1c3338d1b9b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1ab69f9871b4ca7a499211c6bc53865'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:22.615761 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e87943-10a8-4b3a-a62c-76fe77b576ea service cinder] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:22.617647 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-c2e87943-10a8-4b3a-a62c-76fe77b576ea service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:22.624746 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1024/2049] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 16 17:26:22 2022] DELETE /identity/v3/users/a1ab69f9871b4ca7a499211c6bc53865 => generated 0 bytes in 588 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:26:22.633301 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e87943-10a8-4b3a-a62c-76fe77b576ea service cinder] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:22.685894 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3efd80-e6e4-4402-b0b6-a400f3d8f6f4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef37136b89d34edc9cd94c7aa81b2095', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:22.686302 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3efd80-e6e4-4402-b0b6-a400f3d8f6f4 service cinder] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:22.686673 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3efd80-e6e4-4402-b0b6-a400f3d8f6f4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:22.687136 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3efd80-e6e4-4402-b0b6-a400f3d8f6f4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:22.689040 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-3e3efd80-e6e4-4402-b0b6-a400f3d8f6f4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:22.752044 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3efd80-e6e4-4402-b0b6-a400f3d8f6f4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:22.753482 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3efd80-e6e4-4402-b0b6-a400f3d8f6f4 service cinder] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:22.763070 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1026/2050] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:26:22 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 17:26:22.907408 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c910c3cc-539d-490f-8346-1c3338d1b9b4 admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:22.908988 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-c910c3cc-539d-490f-8346-1c3338d1b9b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:22.981330 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c910c3cc-539d-490f-8346-1c3338d1b9b4 admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:22.987158 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811e72c7-4d22-4e1e-9a8a-51a9ee720cf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:22.992984 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811e72c7-4d22-4e1e-9a8a-51a9ee720cf8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:22.992984 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811e72c7-4d22-4e1e-9a8a-51a9ee720cf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:22.992984 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811e72c7-4d22-4e1e-9a8a-51a9ee720cf8 admin admin] PATH_INFO: `/v3/users/8bdb7b0603bc4bb5b3ad9b9a61d95dba` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:22.992984 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811e72c7-4d22-4e1e-9a8a-51a9ee720cf8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8bdb7b0603bc4bb5b3ad9b9a61d95dba)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:22.992984 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811e72c7-4d22-4e1e-9a8a-51a9ee720cf8 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:23.155949 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3efd80-e6e4-4402-b0b6-a400f3d8f6f4 service cinder] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:23.157483 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-3e3efd80-e6e4-4402-b0b6-a400f3d8f6f4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:23.171574 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3efd80-e6e4-4402-b0b6-a400f3d8f6f4 service cinder] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:23.176735 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2ae9f8-b1bd-418b-8a6f-57d59761c180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:23.177644 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2ae9f8-b1bd-418b-8a6f-57d59761c180 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:23.178025 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2ae9f8-b1bd-418b-8a6f-57d59761c180 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:23.178252 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2ae9f8-b1bd-418b-8a6f-57d59761c180 admin admin] PATH_INFO: `/v3/projects/43b6ffc05b694bdcbb7cc1c912bbba94` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:23.179836 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2ae9f8-b1bd-418b-8a6f-57d59761c180 admin admin] RBAC: Authorizing `identity:delete_project(project_id=43b6ffc05b694bdcbb7cc1c912bbba94)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:23.181741 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2ae9f8-b1bd-418b-8a6f-57d59761c180 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:23.257613 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-811e72c7-4d22-4e1e-9a8a-51a9ee720cf8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8bdb7b0603bc4bb5b3ad9b9a61d95dba'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:23.265658 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-811e72c7-4d22-4e1e-9a8a-51a9ee720cf8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8bdb7b0603bc4bb5b3ad9b9a61d95dba'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:23.289463 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-be2ae9f8-b1bd-418b-8a6f-57d59761c180 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43b6ffc05b694bdcbb7cc1c912bbba94', 'request_id': 'req-be2ae9f8-b1bd-418b-8a6f-57d59761c180'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:23.296448 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-be2ae9f8-b1bd-418b-8a6f-57d59761c180 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43b6ffc05b694bdcbb7cc1c912bbba94', 'request_id': 'req-be2ae9f8-b1bd-418b-8a6f-57d59761c180'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:23.302237 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-be2ae9f8-b1bd-418b-8a6f-57d59761c180 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43b6ffc05b694bdcbb7cc1c912bbba94', 'request_id': 'req-be2ae9f8-b1bd-418b-8a6f-57d59761c180'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:23.356926 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-811e72c7-4d22-4e1e-9a8a-51a9ee720cf8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8bdb7b0603bc4bb5b3ad9b9a61d95dba'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:23.358630 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-811e72c7-4d22-4e1e-9a8a-51a9ee720cf8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8bdb7b0603bc4bb5b3ad9b9a61d95dba'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:23.372307 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-811e72c7-4d22-4e1e-9a8a-51a9ee720cf8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8bdb7b0603bc4bb5b3ad9b9a61d95dba'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:23.379074 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1025/2051] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 16 17:26:22 2022] DELETE /identity/v3/users/8bdb7b0603bc4bb5b3ad9b9a61d95dba => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:26:23.380416 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:26:23.383778 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d81970b-c696-4bd8-89fd-029f6122716a None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:23.385998 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d81970b-c696-4bd8-89fd-029f6122716a None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:23.385998 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d81970b-c696-4bd8-89fd-029f6122716a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:23.402043 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-7d81970b-c696-4bd8-89fd-029f6122716a None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:26:23.403428 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-7d81970b-c696-4bd8-89fd-029f6122716a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:23.437373 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-be2ae9f8-b1bd-418b-8a6f-57d59761c180 admin admin] The token cache is being invalidate because project 43b6ffc05b694bdcbb7cc1c912bbba94 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80873) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 17:26:23.437663 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-be2ae9f8-b1bd-418b-8a6f-57d59761c180 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:23.438322 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-be2ae9f8-b1bd-418b-8a6f-57d59761c180 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:23.439880 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1027/2052] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 16 17:26:23 2022] DELETE /identity/v3/projects/43b6ffc05b694bdcbb7cc1c912bbba94 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 17:26:23.444608 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86f6a87-7ee6-4374-9441-bbde27ed7a2f None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:23.444896 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86f6a87-7ee6-4374-9441-bbde27ed7a2f None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:23.445179 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86f6a87-7ee6-4374-9441-bbde27ed7a2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:23.463198 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-f86f6a87-7ee6-4374-9441-bbde27ed7a2f None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:26:23.468835 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1026/2053] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:26:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 17:26:23.469230 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-f86f6a87-7ee6-4374-9441-bbde27ed7a2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:23.476963 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d81970b-c696-4bd8-89fd-029f6122716a None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:23.478442 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-7d81970b-c696-4bd8-89fd-029f6122716a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:23.484489 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1028/2054] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:26:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:26:23.494749 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d58b0f4-7f86-478e-8feb-dab2dca6d750 None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:23.494749 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d58b0f4-7f86-478e-8feb-dab2dca6d750 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:23.494749 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d58b0f4-7f86-478e-8feb-dab2dca6d750 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:23.513581 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-2d58b0f4-7f86-478e-8feb-dab2dca6d750 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:26:23.515160 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-2d58b0f4-7f86-478e-8feb-dab2dca6d750 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:23.528384 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1029/2055] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:26:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 17:26:23.532920 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d58b0f4-7f86-478e-8feb-dab2dca6d750 None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:23.543969 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d58b0f4-7f86-478e-8feb-dab2dca6d750 None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:23.548789 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d81970b-c696-4bd8-89fd-029f6122716a None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:23.550689 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4ea7b8-e435-4694-b335-22ce2861ea43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:23.551393 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4ea7b8-e435-4694-b335-22ce2861ea43 admin admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:23.554629 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4ea7b8-e435-4694-b335-22ce2861ea43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:23.554629 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4ea7b8-e435-4694-b335-22ce2861ea43 admin admin] PATH_INFO: `/v3/domains` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:23.554629 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4ea7b8-e435-4694-b335-22ce2861ea43 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80873) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:26:23.554629 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4ea7b8-e435-4694-b335-22ce2861ea43 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:23.555032 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d96f6e-28dd-43c4-8fb0-8a87205f8790 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5d25bfa8dc042329d57cd55fa7b7b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:23.555032 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d96f6e-28dd-43c4-8fb0-8a87205f8790 service neutron] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:23.555032 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d96f6e-28dd-43c4-8fb0-8a87205f8790 service neutron] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:23.555032 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d96f6e-28dd-43c4-8fb0-8a87205f8790 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:23.555329 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4ea7b8-e435-4694-b335-22ce2861ea43 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:23.573703 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d96f6e-28dd-43c4-8fb0-8a87205f8790 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:23.575810 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d96f6e-28dd-43c4-8fb0-8a87205f8790 service neutron] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:23.580923 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1030/2056] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 16 17:26:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 17:26:23.587553 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4ea7b8-e435-4694-b335-22ce2861ea43 admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:23.587875 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1027/2057] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:26:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:26:23.598658 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4ea7b8-e435-4694-b335-22ce2861ea43 admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:23.609970 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f93e3e5-02d6-454a-a8cc-c7671a3898cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:23.610823 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f93e3e5-02d6-454a-a8cc-c7671a3898cb admin admin] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:23.611462 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f93e3e5-02d6-454a-a8cc-c7671a3898cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:23.612042 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f93e3e5-02d6-454a-a8cc-c7671a3898cb admin admin] PATH_INFO: `/v3/projects` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:23.612963 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f93e3e5-02d6-454a-a8cc-c7671a3898cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:23.616735 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f93e3e5-02d6-454a-a8cc-c7671a3898cb admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:23.725796 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1031/2058] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 16 17:26:23 2022] POST /identity/v3/projects => generated 377 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 17:26:23.729657 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d96f6e-28dd-43c4-8fb0-8a87205f8790 service neutron] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:23.741113 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d96f6e-28dd-43c4-8fb0-8a87205f8790 service neutron] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:23.803164 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb13e81-3b9e-4a7d-b8ff-af829cc26e03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:23.803852 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb13e81-3b9e-4a7d-b8ff-af829cc26e03 admin admin] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:23.804166 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb13e81-3b9e-4a7d-b8ff-af829cc26e03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:23.804736 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb13e81-3b9e-4a7d-b8ff-af829cc26e03 admin admin] PATH_INFO: `/v3/users` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:23.805449 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb13e81-3b9e-4a7d-b8ff-af829cc26e03 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:23.807443 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb13e81-3b9e-4a7d-b8ff-af829cc26e03 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:23.958657 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1028/2059] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 16 17:26:23 2022] POST /identity/v3/users => generated 289 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:26:23.962882 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f93e3e5-02d6-454a-a8cc-c7671a3898cb admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:23.973631 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f93e3e5-02d6-454a-a8cc-c7671a3898cb admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:23.978350 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adfd9cb-e04a-4315-a3e8-60fe5005cf64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:23.984743 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adfd9cb-e04a-4315-a3e8-60fe5005cf64 admin admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:23.984743 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adfd9cb-e04a-4315-a3e8-60fe5005cf64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:23.984743 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adfd9cb-e04a-4315-a3e8-60fe5005cf64 admin admin] PATH_INFO: `/v3/roles` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:23.984743 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adfd9cb-e04a-4315-a3e8-60fe5005cf64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:23.984743 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adfd9cb-e04a-4315-a3e8-60fe5005cf64 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:23.993046 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1032/2060] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 17:26:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:26:23.997796 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb13e81-3b9e-4a7d-b8ff-af829cc26e03 admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:24.008230 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb13e81-3b9e-4a7d-b8ff-af829cc26e03 admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:24.010215 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adfd9cb-e04a-4315-a3e8-60fe5005cf64 admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:24.014760 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-0adfd9cb-e04a-4315-a3e8-60fe5005cf64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:24.014889 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f6ecab-b7bd-4998-a8f8-d14ac184b7cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:24.015013 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f6ecab-b7bd-4998-a8f8-d14ac184b7cd admin admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:24.015387 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f6ecab-b7bd-4998-a8f8-d14ac184b7cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:24.015755 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f6ecab-b7bd-4998-a8f8-d14ac184b7cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:24.016629 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f6ecab-b7bd-4998-a8f8-d14ac184b7cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:24.018667 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f6ecab-b7bd-4998-a8f8-d14ac184b7cd admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:24.027309 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adfd9cb-e04a-4315-a3e8-60fe5005cf64 admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:24.029716 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1029/2061] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 17:26:23 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:26:24.033746 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef0e43c-47a8-4441-94d2-dfc10bc1f2ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:24.034327 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f6ecab-b7bd-4998-a8f8-d14ac184b7cd admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:24.034660 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef0e43c-47a8-4441-94d2-dfc10bc1f2ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:24.034949 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef0e43c-47a8-4441-94d2-dfc10bc1f2ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:24.035683 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef0e43c-47a8-4441-94d2-dfc10bc1f2ed admin admin] PATH_INFO: `/v3/projects/9c96aa8da9934b92a77c568070814aaa` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:24.036688 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef0e43c-47a8-4441-94d2-dfc10bc1f2ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c96aa8da9934b92a77c568070814aaa)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:24.038654 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef0e43c-47a8-4441-94d2-dfc10bc1f2ed admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:24.049645 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f6ecab-b7bd-4998-a8f8-d14ac184b7cd admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:24.054995 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf6022d-89f5-4e4c-9740-de8af3f54c70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:24.055994 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf6022d-89f5-4e4c-9740-de8af3f54c70 admin admin] REQUEST_METHOD: `PUT` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:24.056172 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf6022d-89f5-4e4c-9740-de8af3f54c70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:24.056748 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf6022d-89f5-4e4c-9740-de8af3f54c70 admin admin] PATH_INFO: `/v3/projects/b514f5eba7b340ddb3766129a1b82f7b/users/7a55f99c79ac4e568b051956e1fbf292/roles/896bff49c5d6464eb612a15f4aa9badc` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:24.074695 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf6022d-89f5-4e4c-9740-de8af3f54c70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b514f5eba7b340ddb3766129a1b82f7b, user_id=7a55f99c79ac4e568b051956e1fbf292, role_id=896bff49c5d6464eb612a15f4aa9badc)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:24.077558 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf6022d-89f5-4e4c-9740-de8af3f54c70 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:24.193354 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1030/2062] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 17:26:24 2022] PUT /identity/v3/projects/b514f5eba7b340ddb3766129a1b82f7b/users/7a55f99c79ac4e568b051956e1fbf292/roles/896bff49c5d6464eb612a15f4aa9badc => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 17:26:24.204087 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795498ed-3164-4b1e-a1f9-9f18030144dc None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:24.204406 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795498ed-3164-4b1e-a1f9-9f18030144dc None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:24.204990 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795498ed-3164-4b1e-a1f9-9f18030144dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:24.206395 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-bef0e43c-47a8-4441-94d2-dfc10bc1f2ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c96aa8da9934b92a77c568070814aaa', 'request_id': 'req-bef0e43c-47a8-4441-94d2-dfc10bc1f2ed'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:24.213692 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-bef0e43c-47a8-4441-94d2-dfc10bc1f2ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c96aa8da9934b92a77c568070814aaa', 'request_id': 'req-bef0e43c-47a8-4441-94d2-dfc10bc1f2ed'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:24.219712 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-bef0e43c-47a8-4441-94d2-dfc10bc1f2ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c96aa8da9934b92a77c568070814aaa', 'request_id': 'req-bef0e43c-47a8-4441-94d2-dfc10bc1f2ed'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:24.234314 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-795498ed-3164-4b1e-a1f9-9f18030144dc None None] MFA Rules not processed for user `7a55f99c79ac4e568b051956e1fbf292`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:26:24.238237 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-795498ed-3164-4b1e-a1f9-9f18030144dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:24.248052 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:26:24.300714 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-bef0e43c-47a8-4441-94d2-dfc10bc1f2ed admin admin] The token cache is being invalidate because project 9c96aa8da9934b92a77c568070814aaa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80873) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 17:26:24.301014 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-bef0e43c-47a8-4441-94d2-dfc10bc1f2ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:24.306197 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-bef0e43c-47a8-4441-94d2-dfc10bc1f2ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:24.310121 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1033/2063] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 16 17:26:24 2022] DELETE /identity/v3/projects/9c96aa8da9934b92a77c568070814aaa => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:26:24.317040 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef0e43c-47a8-4441-94d2-dfc10bc1f2ed admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:24.318426 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-bef0e43c-47a8-4441-94d2-dfc10bc1f2ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:24.325452 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1031/2064] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:26:24 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 17:26:24.330139 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795498ed-3164-4b1e-a1f9-9f18030144dc None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:24.331449 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-795498ed-3164-4b1e-a1f9-9f18030144dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:24.391455 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef0e43c-47a8-4441-94d2-dfc10bc1f2ed admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:24.397080 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8d2fed-2fda-409b-b972-d3a34cd86fd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:24.398128 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8d2fed-2fda-409b-b972-d3a34cd86fd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:24.398483 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8d2fed-2fda-409b-b972-d3a34cd86fd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:24.398836 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8d2fed-2fda-409b-b972-d3a34cd86fd8 admin admin] PATH_INFO: `/v3/users/2bca5cf9ce804f21b002bee9ff5f7dfa` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:24.400145 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8d2fed-2fda-409b-b972-d3a34cd86fd8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2bca5cf9ce804f21b002bee9ff5f7dfa)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:24.402190 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8d2fed-2fda-409b-b972-d3a34cd86fd8 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:24.403321 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795498ed-3164-4b1e-a1f9-9f18030144dc None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:24.408754 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a89c75c-8cef-4be9-be9a-e6824d0beb46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:24.409512 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a89c75c-8cef-4be9-be9a-e6824d0beb46 admin admin] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:24.415922 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a89c75c-8cef-4be9-be9a-e6824d0beb46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:24.415922 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a89c75c-8cef-4be9-be9a-e6824d0beb46 admin admin] PATH_INFO: `/v3/projects` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:24.415922 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a89c75c-8cef-4be9-be9a-e6824d0beb46 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:24.415922 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a89c75c-8cef-4be9-be9a-e6824d0beb46 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:24.496790 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1032/2065] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 16 17:26:24 2022] POST /identity/v3/projects => generated 379 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 17:26:24.501007 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a89c75c-8cef-4be9-be9a-e6824d0beb46 admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:24.582563 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a89c75c-8cef-4be9-be9a-e6824d0beb46 admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:24.588524 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157c39a4-98c0-485a-a804-2a9b1c65a734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:24.589927 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157c39a4-98c0-485a-a804-2a9b1c65a734 admin admin] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:24.590428 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157c39a4-98c0-485a-a804-2a9b1c65a734 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:24.590832 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157c39a4-98c0-485a-a804-2a9b1c65a734 admin admin] PATH_INFO: `/v3/users` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:24.591836 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157c39a4-98c0-485a-a804-2a9b1c65a734 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:24.594114 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157c39a4-98c0-485a-a804-2a9b1c65a734 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:24.598319 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-4d8d2fed-2fda-409b-b972-d3a34cd86fd8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2bca5cf9ce804f21b002bee9ff5f7dfa'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:24.598834 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-4d8d2fed-2fda-409b-b972-d3a34cd86fd8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2bca5cf9ce804f21b002bee9ff5f7dfa'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:24.599472 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-4d8d2fed-2fda-409b-b972-d3a34cd86fd8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2bca5cf9ce804f21b002bee9ff5f7dfa'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:24.692359 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-4d8d2fed-2fda-409b-b972-d3a34cd86fd8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2bca5cf9ce804f21b002bee9ff5f7dfa'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:24.698640 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1033/2066] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 16 17:26:24 2022] POST /identity/v3/users => generated 290 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:26:24.700038 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-4d8d2fed-2fda-409b-b972-d3a34cd86fd8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2bca5cf9ce804f21b002bee9ff5f7dfa'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:24.703015 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157c39a4-98c0-485a-a804-2a9b1c65a734 admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:24.704635 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-157c39a4-98c0-485a-a804-2a9b1c65a734 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:24.717209 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157c39a4-98c0-485a-a804-2a9b1c65a734 admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:24.719042 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1034/2067] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 16 17:26:24 2022] DELETE /identity/v3/users/2bca5cf9ce804f21b002bee9ff5f7dfa => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 17:26:24.786649 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4490442e-8fd9-4e80-802f-6f2cc888ac02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:24.787433 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4490442e-8fd9-4e80-802f-6f2cc888ac02 admin admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:24.787693 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4490442e-8fd9-4e80-802f-6f2cc888ac02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:24.787980 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4490442e-8fd9-4e80-802f-6f2cc888ac02 admin admin] PATH_INFO: `/v3/roles` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:24.788782 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4490442e-8fd9-4e80-802f-6f2cc888ac02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:24.790458 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4490442e-8fd9-4e80-802f-6f2cc888ac02 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:24.803309 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1034/2068] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 17:26:24 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 17:26:24.807392 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8d2fed-2fda-409b-b972-d3a34cd86fd8 admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:24.819604 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8d2fed-2fda-409b-b972-d3a34cd86fd8 admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:24.833082 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54081b5a-889b-4e2e-b128-d45d011fc509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:24.833780 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54081b5a-889b-4e2e-b128-d45d011fc509 admin admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:24.834081 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54081b5a-889b-4e2e-b128-d45d011fc509 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:24.834359 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54081b5a-889b-4e2e-b128-d45d011fc509 admin admin] PATH_INFO: `/v3/roles` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:24.835088 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54081b5a-889b-4e2e-b128-d45d011fc509 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:24.836786 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54081b5a-889b-4e2e-b128-d45d011fc509 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:24.845394 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4490442e-8fd9-4e80-802f-6f2cc888ac02 admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:24.855404 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-4490442e-8fd9-4e80-802f-6f2cc888ac02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:24.855505 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1035/2069] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 17:26:24 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:26:24.858191 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54081b5a-889b-4e2e-b128-d45d011fc509 admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:24.862191 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4490442e-8fd9-4e80-802f-6f2cc888ac02 admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:24.867535 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd4d79a-7a1b-43b4-84e3-b2b5e97d808c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:24.868463 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54081b5a-889b-4e2e-b128-d45d011fc509 admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:24.868595 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd4d79a-7a1b-43b4-84e3-b2b5e97d808c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:24.868980 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd4d79a-7a1b-43b4-84e3-b2b5e97d808c admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:24.869339 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd4d79a-7a1b-43b4-84e3-b2b5e97d808c admin admin] PATH_INFO: `/v3/users/c3b78bee1a424165bdd2d81eb074373b` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:24.870684 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd4d79a-7a1b-43b4-84e3-b2b5e97d808c admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3b78bee1a424165bdd2d81eb074373b)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:24.873231 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd4d79a-7a1b-43b4-84e3-b2b5e97d808c admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:24.875891 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31959d2d-b02c-4c4b-80cb-4b474f6d069a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:24.878864 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31959d2d-b02c-4c4b-80cb-4b474f6d069a admin admin] REQUEST_METHOD: `PUT` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:24.878864 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31959d2d-b02c-4c4b-80cb-4b474f6d069a admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:24.878864 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31959d2d-b02c-4c4b-80cb-4b474f6d069a admin admin] PATH_INFO: `/v3/projects/e72d41116bca4f76adc67b0362ec3ff0/users/f0e5fc75d0fa4f29a6d441887fd4ed01/roles/896bff49c5d6464eb612a15f4aa9badc` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:24.897301 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31959d2d-b02c-4c4b-80cb-4b474f6d069a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e72d41116bca4f76adc67b0362ec3ff0, user_id=f0e5fc75d0fa4f29a6d441887fd4ed01, role_id=896bff49c5d6464eb612a15f4aa9badc)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:24.909943 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31959d2d-b02c-4c4b-80cb-4b474f6d069a admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:25.088521 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1036/2070] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 17:26:24 2022] PUT /identity/v3/projects/e72d41116bca4f76adc67b0362ec3ff0/users/f0e5fc75d0fa4f29a6d441887fd4ed01/roles/896bff49c5d6464eb612a15f4aa9badc => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 17:26:25.099896 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba79acf-9c94-467b-b6e8-e7aec807ffe7 None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:25.100193 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba79acf-9c94-467b-b6e8-e7aec807ffe7 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:25.100495 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba79acf-9c94-467b-b6e8-e7aec807ffe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:25.127178 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-0ba79acf-9c94-467b-b6e8-e7aec807ffe7 None None] MFA Rules not processed for user `f0e5fc75d0fa4f29a6d441887fd4ed01`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:26:25.128396 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-0ba79acf-9c94-467b-b6e8-e7aec807ffe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:25.136427 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:26:25.191479 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:26:25.197138 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1037/2071] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:26:25 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 17:26:25.213528 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba79acf-9c94-467b-b6e8-e7aec807ffe7 None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:25.213528 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-0ba79acf-9c94-467b-b6e8-e7aec807ffe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:25.266101 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba79acf-9c94-467b-b6e8-e7aec807ffe7 None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:25.270999 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b65393-7c63-4811-9d8b-99d6b100bf7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:25.272131 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b65393-7c63-4811-9d8b-99d6b100bf7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:25.272131 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b65393-7c63-4811-9d8b-99d6b100bf7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:25.272411 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b65393-7c63-4811-9d8b-99d6b100bf7a admin admin] PATH_INFO: `/v3/projects/18b9f518f5ee47da8a7b044ae7a836d2` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:25.273604 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b65393-7c63-4811-9d8b-99d6b100bf7a admin admin] RBAC: Authorizing `identity:delete_project(project_id=18b9f518f5ee47da8a7b044ae7a836d2)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:25.276195 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b65393-7c63-4811-9d8b-99d6b100bf7a admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:25.282227 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-0dd4d79a-7a1b-43b4-84e3-b2b5e97d808c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3b78bee1a424165bdd2d81eb074373b'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:25.289536 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-0dd4d79a-7a1b-43b4-84e3-b2b5e97d808c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3b78bee1a424165bdd2d81eb074373b'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:25.334037 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-0dd4d79a-7a1b-43b4-84e3-b2b5e97d808c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3b78bee1a424165bdd2d81eb074373b'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:25.334788 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-0dd4d79a-7a1b-43b4-84e3-b2b5e97d808c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3b78bee1a424165bdd2d81eb074373b'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:25.348407 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-0dd4d79a-7a1b-43b4-84e3-b2b5e97d808c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3b78bee1a424165bdd2d81eb074373b'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:25.358186 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1035/2072] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 16 17:26:24 2022] DELETE /identity/v3/users/c3b78bee1a424165bdd2d81eb074373b => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:26:25.358186 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd4d79a-7a1b-43b4-84e3-b2b5e97d808c admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:25.358186 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-0dd4d79a-7a1b-43b4-84e3-b2b5e97d808c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:25.421610 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd4d79a-7a1b-43b4-84e3-b2b5e97d808c admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:25.433910 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-39b65393-7c63-4811-9d8b-99d6b100bf7a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18b9f518f5ee47da8a7b044ae7a836d2', 'request_id': 'req-39b65393-7c63-4811-9d8b-99d6b100bf7a'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:25.440512 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-39b65393-7c63-4811-9d8b-99d6b100bf7a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18b9f518f5ee47da8a7b044ae7a836d2', 'request_id': 'req-39b65393-7c63-4811-9d8b-99d6b100bf7a'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:25.446426 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-39b65393-7c63-4811-9d8b-99d6b100bf7a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18b9f518f5ee47da8a7b044ae7a836d2', 'request_id': 'req-39b65393-7c63-4811-9d8b-99d6b100bf7a'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:25.488657 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c236b16-6e8f-494d-997f-0810fbc76f11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:25.489407 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c236b16-6e8f-494d-997f-0810fbc76f11 admin admin] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:25.489700 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c236b16-6e8f-494d-997f-0810fbc76f11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:25.497316 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c236b16-6e8f-494d-997f-0810fbc76f11 admin admin] PATH_INFO: `/v3/projects` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:25.497316 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c236b16-6e8f-494d-997f-0810fbc76f11 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:25.497316 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c236b16-6e8f-494d-997f-0810fbc76f11 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:25.550858 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-39b65393-7c63-4811-9d8b-99d6b100bf7a admin admin] The token cache is being invalidate because project 18b9f518f5ee47da8a7b044ae7a836d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80873) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 17:26:25.551117 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-39b65393-7c63-4811-9d8b-99d6b100bf7a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:25.551841 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-39b65393-7c63-4811-9d8b-99d6b100bf7a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:25.553488 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1038/2073] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 16 17:26:25 2022] DELETE /identity/v3/projects/18b9f518f5ee47da8a7b044ae7a836d2 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:26:25.554887 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084f9623-ca98-4918-bcf2-c83599ed5f19 None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:25.555091 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084f9623-ca98-4918-bcf2-c83599ed5f19 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:25.555358 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084f9623-ca98-4918-bcf2-c83599ed5f19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:25.574426 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-084f9623-ca98-4918-bcf2-c83599ed5f19 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:26:25.575795 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-084f9623-ca98-4918-bcf2-c83599ed5f19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:25.582029 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1036/2074] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 16 17:26:25 2022] POST /identity/v3/projects => generated 379 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:26:25.583391 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c236b16-6e8f-494d-997f-0810fbc76f11 admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:25.584878 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-0c236b16-6e8f-494d-997f-0810fbc76f11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:25.585873 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1039/2075] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:26:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:26:25.586652 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084f9623-ca98-4918-bcf2-c83599ed5f19 None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:25.587955 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-084f9623-ca98-4918-bcf2-c83599ed5f19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:25.600162 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084f9623-ca98-4918-bcf2-c83599ed5f19 None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:25.659322 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c236b16-6e8f-494d-997f-0810fbc76f11 admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:25.661690 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2447a6-5be0-49ab-b81a-8db613c429d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:25.662403 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2447a6-5be0-49ab-b81a-8db613c429d9 admin admin] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:25.662681 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2447a6-5be0-49ab-b81a-8db613c429d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:25.662989 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2447a6-5be0-49ab-b81a-8db613c429d9 admin admin] PATH_INFO: `/v3/users` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:25.663820 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2447a6-5be0-49ab-b81a-8db613c429d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:25.665837 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2447a6-5be0-49ab-b81a-8db613c429d9 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:25.674744 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4334dcbc-305b-434b-836f-725695dced71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:25.675657 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4334dcbc-305b-434b-836f-725695dced71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:25.675983 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4334dcbc-305b-434b-836f-725695dced71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:25.676293 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4334dcbc-305b-434b-836f-725695dced71 admin admin] PATH_INFO: `/v3/users/3b6e1a655f724f5ab71c7444ddfbf563` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:25.678271 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4334dcbc-305b-434b-836f-725695dced71 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b6e1a655f724f5ab71c7444ddfbf563)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:25.679588 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4334dcbc-305b-434b-836f-725695dced71 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:25.760561 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1040/2076] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 16 17:26:25 2022] POST /identity/v3/users => generated 296 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:26:25.760561 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2447a6-5be0-49ab-b81a-8db613c429d9 admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:25.760561 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-0a2447a6-5be0-49ab-b81a-8db613c429d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:25.840701 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2447a6-5be0-49ab-b81a-8db613c429d9 admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:25.844679 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12299492-f234-48d9-9507-45cea2e09d00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5d25bfa8dc042329d57cd55fa7b7b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:25.847213 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12299492-f234-48d9-9507-45cea2e09d00 service neutron] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:25.847213 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12299492-f234-48d9-9507-45cea2e09d00 service neutron] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:25.847213 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12299492-f234-48d9-9507-45cea2e09d00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:25.856936 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12299492-f234-48d9-9507-45cea2e09d00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:25.858456 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12299492-f234-48d9-9507-45cea2e09d00 service neutron] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:25.870234 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1041/2077] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:26:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:26:25.871904 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12299492-f234-48d9-9507-45cea2e09d00 service neutron] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:25.882635 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12299492-f234-48d9-9507-45cea2e09d00 service neutron] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:25.888745 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a7a712-a307-4900-aea0-ef2fef03393d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:25.889731 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a7a712-a307-4900-aea0-ef2fef03393d admin admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:25.890208 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a7a712-a307-4900-aea0-ef2fef03393d admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:25.890761 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a7a712-a307-4900-aea0-ef2fef03393d admin admin] PATH_INFO: `/v3/roles` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:25.891677 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a7a712-a307-4900-aea0-ef2fef03393d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:25.893517 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a7a712-a307-4900-aea0-ef2fef03393d admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:25.907737 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1042/2078] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 17:26:25 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:26:25.912711 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a7a712-a307-4900-aea0-ef2fef03393d admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:25.915659 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-4334dcbc-305b-434b-836f-725695dced71 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b6e1a655f724f5ab71c7444ddfbf563'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:25.928209 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a7a712-a307-4900-aea0-ef2fef03393d admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:25.935197 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f07f06-74b3-4312-b5e1-f92f06ab1170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:25.936128 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-4334dcbc-305b-434b-836f-725695dced71 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b6e1a655f724f5ab71c7444ddfbf563'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:25.937643 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f07f06-74b3-4312-b5e1-f92f06ab1170 admin admin] REQUEST_METHOD: `PUT` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:25.939159 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f07f06-74b3-4312-b5e1-f92f06ab1170 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:25.939833 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f07f06-74b3-4312-b5e1-f92f06ab1170 admin admin] PATH_INFO: `/v3/projects/19c688179dc94b38b9c54b8c03dd7da9/users/52feb3bb630541de864adabe8a496c29/roles/dba744f8ab2a4c45b9d3212f8d203aba` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:25.959808 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f07f06-74b3-4312-b5e1-f92f06ab1170 admin admin] RBAC: Authorizing `identity:create_grant(project_id=19c688179dc94b38b9c54b8c03dd7da9, user_id=52feb3bb630541de864adabe8a496c29, role_id=dba744f8ab2a4c45b9d3212f8d203aba)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:25.962523 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f07f06-74b3-4312-b5e1-f92f06ab1170 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:26.122752 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-4334dcbc-305b-434b-836f-725695dced71 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b6e1a655f724f5ab71c7444ddfbf563'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:26.123467 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-4334dcbc-305b-434b-836f-725695dced71 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b6e1a655f724f5ab71c7444ddfbf563'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:26.123980 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:26:26.142099 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1043/2079] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 17:26:25 2022] PUT /identity/v3/projects/19c688179dc94b38b9c54b8c03dd7da9/users/52feb3bb630541de864adabe8a496c29/roles/dba744f8ab2a4c45b9d3212f8d203aba => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:26:26.144359 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f07f06-74b3-4312-b5e1-f92f06ab1170 admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:26.146487 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-32f07f06-74b3-4312-b5e1-f92f06ab1170 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:26.148504 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-4334dcbc-305b-434b-836f-725695dced71 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b6e1a655f724f5ab71c7444ddfbf563'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:26.158664 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1037/2080] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 16 17:26:25 2022] DELETE /identity/v3/users/3b6e1a655f724f5ab71c7444ddfbf563 => generated 0 bytes in 576 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:26:26.235155 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f07f06-74b3-4312-b5e1-f92f06ab1170 admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:26.302014 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4d9326-25e8-455d-b0d4-a598aa48f03f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:26.302799 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4d9326-25e8-455d-b0d4-a598aa48f03f admin admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:26.303160 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4d9326-25e8-455d-b0d4-a598aa48f03f admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:26.303512 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4d9326-25e8-455d-b0d4-a598aa48f03f admin admin] PATH_INFO: `/v3/roles` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:26.304324 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4d9326-25e8-455d-b0d4-a598aa48f03f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:26.306091 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4d9326-25e8-455d-b0d4-a598aa48f03f admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:26.317392 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1044/2081] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 17:26:26 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:26:26.322014 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4334dcbc-305b-434b-836f-725695dced71 admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:26.333707 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4334dcbc-305b-434b-836f-725695dced71 admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:26.344281 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312d2673-9ac9-470a-93c9-3e293faa5d7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:26.344281 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312d2673-9ac9-470a-93c9-3e293faa5d7f admin admin] REQUEST_METHOD: `PUT` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:26.344281 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312d2673-9ac9-470a-93c9-3e293faa5d7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:26.344281 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312d2673-9ac9-470a-93c9-3e293faa5d7f admin admin] PATH_INFO: `/v3/projects/19c688179dc94b38b9c54b8c03dd7da9/users/52feb3bb630541de864adabe8a496c29/roles/dba744f8ab2a4c45b9d3212f8d203aba` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:26.346131 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312d2673-9ac9-470a-93c9-3e293faa5d7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=19c688179dc94b38b9c54b8c03dd7da9, user_id=52feb3bb630541de864adabe8a496c29, role_id=dba744f8ab2a4c45b9d3212f8d203aba)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:26.349009 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312d2673-9ac9-470a-93c9-3e293faa5d7f admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:26.362120 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1038/2082] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 17:26:26 2022] PUT /identity/v3/projects/19c688179dc94b38b9c54b8c03dd7da9/users/52feb3bb630541de864adabe8a496c29/roles/dba744f8ab2a4c45b9d3212f8d203aba => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:26:26.372936 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98376f0-1619-499e-b285-93ede7702fa4 None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:26.373443 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98376f0-1619-499e-b285-93ede7702fa4 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:26.373989 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98376f0-1619-499e-b285-93ede7702fa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:26.403969 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-d98376f0-1619-499e-b285-93ede7702fa4 None None] MFA Rules not processed for user `52feb3bb630541de864adabe8a496c29`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:26:26.405386 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-d98376f0-1619-499e-b285-93ede7702fa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:26.482994 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1045/2083] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:26:26 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:26:26.532413 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312d2673-9ac9-470a-93c9-3e293faa5d7f admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:26.534479 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-312d2673-9ac9-470a-93c9-3e293faa5d7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:26.614158 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312d2673-9ac9-470a-93c9-3e293faa5d7f admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:26.618802 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccc8c91-eb9b-4a71-ae3b-af0aa11beacd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef37136b89d34edc9cd94c7aa81b2095', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:26.619585 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccc8c91-eb9b-4a71-ae3b-af0aa11beacd service cinder] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:26.620052 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccc8c91-eb9b-4a71-ae3b-af0aa11beacd service cinder] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:26.620510 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccc8c91-eb9b-4a71-ae3b-af0aa11beacd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:26.633576 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccc8c91-eb9b-4a71-ae3b-af0aa11beacd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:26.635162 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccc8c91-eb9b-4a71-ae3b-af0aa11beacd service cinder] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:26.646552 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1039/2084] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:26:26 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:26:26.892443 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98376f0-1619-499e-b285-93ede7702fa4 None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:26.907220 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98376f0-1619-499e-b285-93ede7702fa4 None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:26.911344 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8907296d-5189-47e8-87a7-601be38f8dce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef37136b89d34edc9cd94c7aa81b2095', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:26.912084 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8907296d-5189-47e8-87a7-601be38f8dce service cinder] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:26.912374 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8907296d-5189-47e8-87a7-601be38f8dce service cinder] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:26.912653 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8907296d-5189-47e8-87a7-601be38f8dce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:26.914598 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-8907296d-5189-47e8-87a7-601be38f8dce service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:26.960175 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccc8c91-eb9b-4a71-ae3b-af0aa11beacd service cinder] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:26.964134 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-fccc8c91-eb9b-4a71-ae3b-af0aa11beacd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:27.016630 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8907296d-5189-47e8-87a7-601be38f8dce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:27.018718 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8907296d-5189-47e8-87a7-601be38f8dce service cinder] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:27.029184 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1046/2085] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:26:26 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:26:27.161562 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccc8c91-eb9b-4a71-ae3b-af0aa11beacd service cinder] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:27.172156 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e483cac7-4129-440a-9574-2dbe88303692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:27.174420 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e483cac7-4129-440a-9574-2dbe88303692 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:27.175389 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e483cac7-4129-440a-9574-2dbe88303692 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:27.175701 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e483cac7-4129-440a-9574-2dbe88303692 admin admin] PATH_INFO: `/v3/projects/d8f5f046e15747c9b947d1bbd657a96c` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:27.178141 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e483cac7-4129-440a-9574-2dbe88303692 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8f5f046e15747c9b947d1bbd657a96c)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:27.184119 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e483cac7-4129-440a-9574-2dbe88303692 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:27.240216 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8907296d-5189-47e8-87a7-601be38f8dce service cinder] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:27.242418 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-8907296d-5189-47e8-87a7-601be38f8dce service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:27.259715 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8907296d-5189-47e8-87a7-601be38f8dce service cinder] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:27.274597 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c605f7-7cc0-44b7-af78-9c4422437d72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:27.275637 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c605f7-7cc0-44b7-af78-9c4422437d72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:27.275949 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c605f7-7cc0-44b7-af78-9c4422437d72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:27.277174 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c605f7-7cc0-44b7-af78-9c4422437d72 admin admin] PATH_INFO: `/v3/projects/4413694bcd9442649d8e6b553f7b1ac5` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:27.279516 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c605f7-7cc0-44b7-af78-9c4422437d72 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4413694bcd9442649d8e6b553f7b1ac5)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:27.282189 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c605f7-7cc0-44b7-af78-9c4422437d72 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:27.332948 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-e483cac7-4129-440a-9574-2dbe88303692 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8f5f046e15747c9b947d1bbd657a96c', 'request_id': 'req-e483cac7-4129-440a-9574-2dbe88303692'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:27.342257 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-e483cac7-4129-440a-9574-2dbe88303692 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8f5f046e15747c9b947d1bbd657a96c', 'request_id': 'req-e483cac7-4129-440a-9574-2dbe88303692'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:27.387646 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-66c605f7-7cc0-44b7-af78-9c4422437d72 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4413694bcd9442649d8e6b553f7b1ac5', 'request_id': 'req-66c605f7-7cc0-44b7-af78-9c4422437d72'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:27.394513 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-66c605f7-7cc0-44b7-af78-9c4422437d72 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4413694bcd9442649d8e6b553f7b1ac5', 'request_id': 'req-66c605f7-7cc0-44b7-af78-9c4422437d72'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:27.400817 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-66c605f7-7cc0-44b7-af78-9c4422437d72 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4413694bcd9442649d8e6b553f7b1ac5', 'request_id': 'req-66c605f7-7cc0-44b7-af78-9c4422437d72'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:27.452122 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-e483cac7-4129-440a-9574-2dbe88303692 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8f5f046e15747c9b947d1bbd657a96c', 'request_id': 'req-e483cac7-4129-440a-9574-2dbe88303692'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:27.466010 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-e483cac7-4129-440a-9574-2dbe88303692 admin admin] The token cache is being invalidate because project d8f5f046e15747c9b947d1bbd657a96c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80874) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 17:26:27.466394 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-e483cac7-4129-440a-9574-2dbe88303692 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:27.467125 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-e483cac7-4129-440a-9574-2dbe88303692 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:27.468770 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1040/2086] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 16 17:26:26 2022] DELETE /identity/v3/projects/d8f5f046e15747c9b947d1bbd657a96c => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:26:27.473057 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e483cac7-4129-440a-9574-2dbe88303692 admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:27.474623 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-e483cac7-4129-440a-9574-2dbe88303692 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:27.540490 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-66c605f7-7cc0-44b7-af78-9c4422437d72 admin admin] The token cache is being invalidate because project 4413694bcd9442649d8e6b553f7b1ac5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80873) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 17:26:27.540899 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-66c605f7-7cc0-44b7-af78-9c4422437d72 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:27.541635 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-66c605f7-7cc0-44b7-af78-9c4422437d72 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:27.544210 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1047/2087] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 16 17:26:27 2022] DELETE /identity/v3/projects/4413694bcd9442649d8e6b553f7b1ac5 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:26:27.550012 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda18b4d-5069-4540-a868-d057508e738b None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:27.550315 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda18b4d-5069-4540-a868-d057508e738b None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:27.550596 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda18b4d-5069-4540-a868-d057508e738b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:27.558594 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e483cac7-4129-440a-9574-2dbe88303692 admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:27.570359 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-cda18b4d-5069-4540-a868-d057508e738b None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:26:27.572698 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-cda18b4d-5069-4540-a868-d057508e738b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:27.634764 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797a52d1-f1c5-4e51-a587-4afbbf76a358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:27.635472 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1048/2088] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:26:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 17:26:27.635974 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797a52d1-f1c5-4e51-a587-4afbbf76a358 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:27.636368 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797a52d1-f1c5-4e51-a587-4afbbf76a358 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:27.636716 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797a52d1-f1c5-4e51-a587-4afbbf76a358 admin admin] PATH_INFO: `/v3/users/47efb5fde4bd43cbaa05e325c7d6c679` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:27.638045 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797a52d1-f1c5-4e51-a587-4afbbf76a358 admin admin] RBAC: Authorizing `identity:delete_user(user_id=47efb5fde4bd43cbaa05e325c7d6c679)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:27.640054 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797a52d1-f1c5-4e51-a587-4afbbf76a358 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:27.643336 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a9e801-b160-4162-abe3-0b343e787397 None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:27.643641 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a9e801-b160-4162-abe3-0b343e787397 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:27.643988 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a9e801-b160-4162-abe3-0b343e787397 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:27.663971 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-88a9e801-b160-4162-abe3-0b343e787397 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:26:27.665478 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-88a9e801-b160-4162-abe3-0b343e787397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:27.682593 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1049/2089] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:26:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:26:27.685733 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a9e801-b160-4162-abe3-0b343e787397 None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:27.696048 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a9e801-b160-4162-abe3-0b343e787397 None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:27.750391 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ece54a-e090-4787-a90a-ce97486852d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:27.750391 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ece54a-e090-4787-a90a-ce97486852d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:27.750391 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ece54a-e090-4787-a90a-ce97486852d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:27.750391 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ece54a-e090-4787-a90a-ce97486852d3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:27.750824 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ece54a-e090-4787-a90a-ce97486852d3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80873) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:26:27.750824 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ece54a-e090-4787-a90a-ce97486852d3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:27.750824 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ece54a-e090-4787-a90a-ce97486852d3 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:27.750824 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1050/2090] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 16 17:26:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 17:26:27.750824 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ece54a-e090-4787-a90a-ce97486852d3 admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:27.750824 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ece54a-e090-4787-a90a-ce97486852d3 admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:27.753193 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a5f72b-8620-4ad3-bb4a-9b2e3d665d7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:27.753908 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a5f72b-8620-4ad3-bb4a-9b2e3d665d7d admin admin] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:27.754197 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a5f72b-8620-4ad3-bb4a-9b2e3d665d7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:27.754472 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a5f72b-8620-4ad3-bb4a-9b2e3d665d7d admin admin] PATH_INFO: `/v3/projects` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:27.755199 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a5f72b-8620-4ad3-bb4a-9b2e3d665d7d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:27.757135 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a5f72b-8620-4ad3-bb4a-9b2e3d665d7d admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:27.801315 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:26:27.928449 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1051/2091] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 16 17:26:27 2022] POST /identity/v3/projects => generated 367 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:26:27.928449 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a5f72b-8620-4ad3-bb4a-9b2e3d665d7d admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:27.928449 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-a3a5f72b-8620-4ad3-bb4a-9b2e3d665d7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:27.938371 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-797a52d1-f1c5-4e51-a587-4afbbf76a358 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47efb5fde4bd43cbaa05e325c7d6c679'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:27.946170 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-797a52d1-f1c5-4e51-a587-4afbbf76a358 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47efb5fde4bd43cbaa05e325c7d6c679'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:28.020976 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a5f72b-8620-4ad3-bb4a-9b2e3d665d7d admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:28.042517 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc99aa11-aef5-4263-ba00-cd399aaa7f1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:28.043545 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc99aa11-aef5-4263-ba00-cd399aaa7f1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:28.043942 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc99aa11-aef5-4263-ba00-cd399aaa7f1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:28.044331 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc99aa11-aef5-4263-ba00-cd399aaa7f1f admin admin] PATH_INFO: `/v3/users/5fe3c0ebb4d94b10bc7ee56d2e53403a` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:28.045851 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc99aa11-aef5-4263-ba00-cd399aaa7f1f admin admin] RBAC: Authorizing `identity:delete_user(user_id=5fe3c0ebb4d94b10bc7ee56d2e53403a)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:28.048453 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc99aa11-aef5-4263-ba00-cd399aaa7f1f admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:28.069015 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-797a52d1-f1c5-4e51-a587-4afbbf76a358 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47efb5fde4bd43cbaa05e325c7d6c679'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:28.070967 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-797a52d1-f1c5-4e51-a587-4afbbf76a358 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47efb5fde4bd43cbaa05e325c7d6c679'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:28.089878 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-797a52d1-f1c5-4e51-a587-4afbbf76a358 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47efb5fde4bd43cbaa05e325c7d6c679'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:28.097373 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1041/2092] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 16 17:26:27 2022] DELETE /identity/v3/users/47efb5fde4bd43cbaa05e325c7d6c679 => generated 0 bytes in 625 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:26:28.098568 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797a52d1-f1c5-4e51-a587-4afbbf76a358 admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:28.099956 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-797a52d1-f1c5-4e51-a587-4afbbf76a358 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:28.176763 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797a52d1-f1c5-4e51-a587-4afbbf76a358 admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:28.181683 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615c1b09-5f56-4a84-8f39-049098b7ac2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:28.183377 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615c1b09-5f56-4a84-8f39-049098b7ac2b admin admin] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:28.183881 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615c1b09-5f56-4a84-8f39-049098b7ac2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:28.184312 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615c1b09-5f56-4a84-8f39-049098b7ac2b admin admin] PATH_INFO: `/v3/users` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:28.185581 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615c1b09-5f56-4a84-8f39-049098b7ac2b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:28.187773 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615c1b09-5f56-4a84-8f39-049098b7ac2b admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:28.389823 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1042/2093] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 16 17:26:28 2022] POST /identity/v3/users => generated 284 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:26:28.389823 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615c1b09-5f56-4a84-8f39-049098b7ac2b admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:28.393728 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-615c1b09-5f56-4a84-8f39-049098b7ac2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:28.405714 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-bc99aa11-aef5-4263-ba00-cd399aaa7f1f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5fe3c0ebb4d94b10bc7ee56d2e53403a'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:28.407582 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-bc99aa11-aef5-4263-ba00-cd399aaa7f1f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5fe3c0ebb4d94b10bc7ee56d2e53403a'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:28.409014 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-bc99aa11-aef5-4263-ba00-cd399aaa7f1f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5fe3c0ebb4d94b10bc7ee56d2e53403a'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:28.416810 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615c1b09-5f56-4a84-8f39-049098b7ac2b admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:28.431594 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f33efe9-b532-46c9-994a-0bc87468eef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:28.431594 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f33efe9-b532-46c9-994a-0bc87468eef2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:28.431594 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f33efe9-b532-46c9-994a-0bc87468eef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:28.431594 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f33efe9-b532-46c9-994a-0bc87468eef2 admin admin] PATH_INFO: `/v3/users/8129f4740aba4a5c9cbec08feb46a03b` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:28.432027 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f33efe9-b532-46c9-994a-0bc87468eef2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8129f4740aba4a5c9cbec08feb46a03b)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:28.433810 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f33efe9-b532-46c9-994a-0bc87468eef2 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:28.531895 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-bc99aa11-aef5-4263-ba00-cd399aaa7f1f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5fe3c0ebb4d94b10bc7ee56d2e53403a'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:28.541035 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-bc99aa11-aef5-4263-ba00-cd399aaa7f1f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5fe3c0ebb4d94b10bc7ee56d2e53403a'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:28.562663 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:26:28.568547 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1052/2094] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 16 17:26:27 2022] DELETE /identity/v3/users/5fe3c0ebb4d94b10bc7ee56d2e53403a => generated 0 bytes in 642 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:26:28.569519 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc99aa11-aef5-4263-ba00-cd399aaa7f1f admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:28.570975 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-bc99aa11-aef5-4263-ba00-cd399aaa7f1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:28.644765 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc99aa11-aef5-4263-ba00-cd399aaa7f1f admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:28.649553 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51c6a60-ce2c-455b-a841-ea6f09186c37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:28.650482 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51c6a60-ce2c-455b-a841-ea6f09186c37 admin admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:28.650774 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51c6a60-ce2c-455b-a841-ea6f09186c37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:28.651054 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51c6a60-ce2c-455b-a841-ea6f09186c37 admin admin] PATH_INFO: `/v3/roles` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:28.652493 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51c6a60-ce2c-455b-a841-ea6f09186c37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:28.654179 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51c6a60-ce2c-455b-a841-ea6f09186c37 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:28.668800 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1053/2095] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 17:26:28 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:26:28.668800 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbd090d-f6ab-46de-8427-4f16db2f7f2d None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:28.668800 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbd090d-f6ab-46de-8427-4f16db2f7f2d None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:28.668800 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbd090d-f6ab-46de-8427-4f16db2f7f2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:28.691790 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-5bbd090d-f6ab-46de-8427-4f16db2f7f2d None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:26:28.693260 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-5bbd090d-f6ab-46de-8427-4f16db2f7f2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:28.695061 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-5f33efe9-b532-46c9-994a-0bc87468eef2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8129f4740aba4a5c9cbec08feb46a03b'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:28.706726 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-5f33efe9-b532-46c9-994a-0bc87468eef2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8129f4740aba4a5c9cbec08feb46a03b'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:28.707865 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1054/2096] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:26:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:26:28.708703 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbd090d-f6ab-46de-8427-4f16db2f7f2d None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:28.720432 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbd090d-f6ab-46de-8427-4f16db2f7f2d None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:28.725871 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14229b6-2e46-4954-8469-ed4140362406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:28.726277 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14229b6-2e46-4954-8469-ed4140362406 admin admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:28.726570 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14229b6-2e46-4954-8469-ed4140362406 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:28.726843 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14229b6-2e46-4954-8469-ed4140362406 admin admin] PATH_INFO: `/v3/roles` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:28.727693 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14229b6-2e46-4954-8469-ed4140362406 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:28.729187 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14229b6-2e46-4954-8469-ed4140362406 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:28.744711 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1055/2097] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 17:26:28 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:26:28.744711 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14229b6-2e46-4954-8469-ed4140362406 admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:28.746711 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-c14229b6-2e46-4954-8469-ed4140362406 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:28.812744 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14229b6-2e46-4954-8469-ed4140362406 admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:28.817136 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8e0ea1-6e9b-4636-b0fb-7f3c71e4865e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5d25bfa8dc042329d57cd55fa7b7b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:28.817925 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8e0ea1-6e9b-4636-b0fb-7f3c71e4865e service neutron] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:28.818263 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8e0ea1-6e9b-4636-b0fb-7f3c71e4865e service neutron] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:28.818637 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8e0ea1-6e9b-4636-b0fb-7f3c71e4865e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:28.830385 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8e0ea1-6e9b-4636-b0fb-7f3c71e4865e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:28.832530 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8e0ea1-6e9b-4636-b0fb-7f3c71e4865e service neutron] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:28.847155 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1056/2098] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:26:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:26:28.859123 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8e0ea1-6e9b-4636-b0fb-7f3c71e4865e service neutron] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:28.866566 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-5f33efe9-b532-46c9-994a-0bc87468eef2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8129f4740aba4a5c9cbec08feb46a03b'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:28.867464 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-5f33efe9-b532-46c9-994a-0bc87468eef2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8129f4740aba4a5c9cbec08feb46a03b'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:28.884412 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8e0ea1-6e9b-4636-b0fb-7f3c71e4865e service neutron] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:28.893639 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bcf814-2ae0-4b92-bb68-08678fe57a2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:28.895289 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bcf814-2ae0-4b92-bb68-08678fe57a2b admin admin] REQUEST_METHOD: `PUT` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:28.895548 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bcf814-2ae0-4b92-bb68-08678fe57a2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:28.895862 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bcf814-2ae0-4b92-bb68-08678fe57a2b admin admin] PATH_INFO: `/v3/projects/5e42defbdf734583b6b7c760f8ac34e7/users/1609f46dc6214756ba27539f82ae81d6/roles/896bff49c5d6464eb612a15f4aa9badc` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:28.910133 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-5f33efe9-b532-46c9-994a-0bc87468eef2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8129f4740aba4a5c9cbec08feb46a03b'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:28.924369 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1043/2099] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 16 17:26:28 2022] DELETE /identity/v3/users/8129f4740aba4a5c9cbec08feb46a03b => generated 0 bytes in 536 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:26:28.925734 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bcf814-2ae0-4b92-bb68-08678fe57a2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e42defbdf734583b6b7c760f8ac34e7, user_id=1609f46dc6214756ba27539f82ae81d6, role_id=896bff49c5d6464eb612a15f4aa9badc)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:28.925886 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f33efe9-b532-46c9-994a-0bc87468eef2 admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:28.929052 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-5f33efe9-b532-46c9-994a-0bc87468eef2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:28.939685 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bcf814-2ae0-4b92-bb68-08678fe57a2b admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:29.019864 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f33efe9-b532-46c9-994a-0bc87468eef2 admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:29.024709 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c916d2-12f5-4df5-9cfd-9338e6664d4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:29.025936 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c916d2-12f5-4df5-9cfd-9338e6664d4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:29.026525 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c916d2-12f5-4df5-9cfd-9338e6664d4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:29.026920 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c916d2-12f5-4df5-9cfd-9338e6664d4c admin admin] PATH_INFO: `/v3/projects/7a9b71cdab204fe3b25fcb6b027061ad` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:29.028257 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c916d2-12f5-4df5-9cfd-9338e6664d4c admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a9b71cdab204fe3b25fcb6b027061ad)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:29.030481 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c916d2-12f5-4df5-9cfd-9338e6664d4c admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:29.067995 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1057/2100] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 17:26:28 2022] PUT /identity/v3/projects/5e42defbdf734583b6b7c760f8ac34e7/users/1609f46dc6214756ba27539f82ae81d6/roles/896bff49c5d6464eb612a15f4aa9badc => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:26:29.069906 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43efe6af-99f8-465e-891c-45a0ce4cb200 None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:29.070565 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43efe6af-99f8-465e-891c-45a0ce4cb200 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:29.070891 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43efe6af-99f8-465e-891c-45a0ce4cb200 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:29.092404 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-43efe6af-99f8-465e-891c-45a0ce4cb200 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:26:29.093813 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-43efe6af-99f8-465e-891c-45a0ce4cb200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:29.177083 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1058/2101] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:26:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:26:29.178907 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77804106-37a7-4f33-8b25-00f14cefaabc None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:29.179357 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77804106-37a7-4f33-8b25-00f14cefaabc None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:29.180086 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77804106-37a7-4f33-8b25-00f14cefaabc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:29.204368 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-a8c916d2-12f5-4df5-9cfd-9338e6664d4c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a9b71cdab204fe3b25fcb6b027061ad', 'request_id': 'req-a8c916d2-12f5-4df5-9cfd-9338e6664d4c'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:29.215034 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-a8c916d2-12f5-4df5-9cfd-9338e6664d4c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a9b71cdab204fe3b25fcb6b027061ad', 'request_id': 'req-a8c916d2-12f5-4df5-9cfd-9338e6664d4c'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:29.216147 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-77804106-37a7-4f33-8b25-00f14cefaabc None None] MFA Rules not processed for user `1609f46dc6214756ba27539f82ae81d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:26:29.217445 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-77804106-37a7-4f33-8b25-00f14cefaabc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:29.299454 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1059/2102] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:26:29 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:26:29.300562 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77804106-37a7-4f33-8b25-00f14cefaabc None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:29.302771 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-77804106-37a7-4f33-8b25-00f14cefaabc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:29.313606 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-a8c916d2-12f5-4df5-9cfd-9338e6664d4c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a9b71cdab204fe3b25fcb6b027061ad', 'request_id': 'req-a8c916d2-12f5-4df5-9cfd-9338e6664d4c'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:29.337069 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-a8c916d2-12f5-4df5-9cfd-9338e6664d4c admin admin] The token cache is being invalidate because project 7a9b71cdab204fe3b25fcb6b027061ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80874) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 17:26:29.337359 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-a8c916d2-12f5-4df5-9cfd-9338e6664d4c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:29.346337 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-a8c916d2-12f5-4df5-9cfd-9338e6664d4c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:29.348361 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1044/2103] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 16 17:26:28 2022] DELETE /identity/v3/projects/7a9b71cdab204fe3b25fcb6b027061ad => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:26:29.349288 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c916d2-12f5-4df5-9cfd-9338e6664d4c admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:29.350942 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-a8c916d2-12f5-4df5-9cfd-9338e6664d4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:29.404972 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77804106-37a7-4f33-8b25-00f14cefaabc None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:29.409239 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2f1b14-dcf7-4456-b191-9709c8049d45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5d25bfa8dc042329d57cd55fa7b7b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:29.410514 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2f1b14-dcf7-4456-b191-9709c8049d45 service neutron] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:29.410514 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2f1b14-dcf7-4456-b191-9709c8049d45 service neutron] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:29.410910 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2f1b14-dcf7-4456-b191-9709c8049d45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:29.416206 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-0b2f1b14-dcf7-4456-b191-9709c8049d45 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:29.428292 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c916d2-12f5-4df5-9cfd-9338e6664d4c admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:29.451171 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e3d145-a962-4eff-9214-c663575205c9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3985eae1ec3240129eec8d1f4d8d21e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:29.451861 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e3d145-a962-4eff-9214-c663575205c9 service glance] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:29.452153 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e3d145-a962-4eff-9214-c663575205c9 service glance] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:29.452492 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e3d145-a962-4eff-9214-c663575205c9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:29.457321 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-a3e3d145-a962-4eff-9214-c663575205c9 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:29.490824 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e3d145-a962-4eff-9214-c663575205c9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:29.490824 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e3d145-a962-4eff-9214-c663575205c9 service glance] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:29.494136 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1045/2104] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:26:29 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:26:29.496322 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867de0a8-9312-407a-aede-b0d70417c275 None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:29.496800 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867de0a8-9312-407a-aede-b0d70417c275 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:29.497195 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867de0a8-9312-407a-aede-b0d70417c275 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:29.517802 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2f1b14-dcf7-4456-b191-9709c8049d45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:29.519093 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-867de0a8-9312-407a-aede-b0d70417c275 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:26:29.519591 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2f1b14-dcf7-4456-b191-9709c8049d45 service neutron] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:29.520466 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-867de0a8-9312-407a-aede-b0d70417c275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:29.534946 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1046/2105] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:26:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:26:29.536170 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1060/2106] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:26:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:26:29.545402 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb985c9-8230-4748-b9f3-2f54759ec93f None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:29.545402 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb985c9-8230-4748-b9f3-2f54759ec93f None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:29.545402 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb985c9-8230-4748-b9f3-2f54759ec93f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:29.574503 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-fbb985c9-8230-4748-b9f3-2f54759ec93f None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:26:29.575860 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-fbb985c9-8230-4748-b9f3-2f54759ec93f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:29.592019 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2f1b14-dcf7-4456-b191-9709c8049d45 service neutron] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:29.592532 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1047/2107] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:26:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:26:29.592532 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=94,keystone:INSERT=4,keystone:DELETE=2 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:26:29.605329 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2f1b14-dcf7-4456-b191-9709c8049d45 service neutron] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:29.611739 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c172c0-6c5e-4e0a-b159-59cf8c7edcb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:29.612613 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c172c0-6c5e-4e0a-b159-59cf8c7edcb8 admin admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:29.613069 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c172c0-6c5e-4e0a-b159-59cf8c7edcb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:29.613445 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c172c0-6c5e-4e0a-b159-59cf8c7edcb8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:29.614467 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c172c0-6c5e-4e0a-b159-59cf8c7edcb8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80873) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:26:29.614854 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c172c0-6c5e-4e0a-b159-59cf8c7edcb8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:29.616784 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c172c0-6c5e-4e0a-b159-59cf8c7edcb8 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:29.636502 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1061/2108] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 16 17:26:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:26:29.637737 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb985c9-8230-4748-b9f3-2f54759ec93f None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:29.650633 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb985c9-8230-4748-b9f3-2f54759ec93f None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:29.655265 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb25a1eb-4d5e-4f74-83a6-ec92cf7c8d96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:29.656182 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb25a1eb-4d5e-4f74-83a6-ec92cf7c8d96 admin admin] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:29.656316 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb25a1eb-4d5e-4f74-83a6-ec92cf7c8d96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:29.656588 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb25a1eb-4d5e-4f74-83a6-ec92cf7c8d96 admin admin] PATH_INFO: `/v3/projects` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:29.657295 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb25a1eb-4d5e-4f74-83a6-ec92cf7c8d96 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:29.659283 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb25a1eb-4d5e-4f74-83a6-ec92cf7c8d96 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:29.735418 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c172c0-6c5e-4e0a-b159-59cf8c7edcb8 admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:29.737283 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-04c172c0-6c5e-4e0a-b159-59cf8c7edcb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:29.771382 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1048/2109] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 16 17:26:29 2022] POST /identity/v3/projects => generated 387 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 17:26:29.775609 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb25a1eb-4d5e-4f74-83a6-ec92cf7c8d96 admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:29.785422 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c172c0-6c5e-4e0a-b159-59cf8c7edcb8 admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:29.910042 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb25a1eb-4d5e-4f74-83a6-ec92cf7c8d96 admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:29.931000 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8a414d-41a2-4b81-914b-d00329737f6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:29.933324 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8a414d-41a2-4b81-914b-d00329737f6b admin admin] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:29.933324 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8a414d-41a2-4b81-914b-d00329737f6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:29.933324 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8a414d-41a2-4b81-914b-d00329737f6b admin admin] PATH_INFO: `/v3/users` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:29.934268 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8a414d-41a2-4b81-914b-d00329737f6b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:29.949100 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792f078e-d9f2-405d-8d52-15234063cc0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:29.950339 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792f078e-d9f2-405d-8d52-15234063cc0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:29.950634 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792f078e-d9f2-405d-8d52-15234063cc0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:29.950982 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792f078e-d9f2-405d-8d52-15234063cc0a admin admin] PATH_INFO: `/v3/projects/a2ecf7a2ff704326ae157a6b4c4f6523` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:29.951082 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8a414d-41a2-4b81-914b-d00329737f6b admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:29.953113 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792f078e-d9f2-405d-8d52-15234063cc0a admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2ecf7a2ff704326ae157a6b4c4f6523)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:29.955500 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792f078e-d9f2-405d-8d52-15234063cc0a admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:30.262713 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1049/2110] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 16 17:26:29 2022] POST /identity/v3/users => generated 294 bytes in 488 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:26:30.265290 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8a414d-41a2-4b81-914b-d00329737f6b admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:30.270543 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-6d8a414d-41a2-4b81-914b-d00329737f6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:30.287670 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8a414d-41a2-4b81-914b-d00329737f6b admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:30.289690 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-792f078e-d9f2-405d-8d52-15234063cc0a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2ecf7a2ff704326ae157a6b4c4f6523', 'request_id': 'req-792f078e-d9f2-405d-8d52-15234063cc0a'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:30.303554 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-792f078e-d9f2-405d-8d52-15234063cc0a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2ecf7a2ff704326ae157a6b4c4f6523', 'request_id': 'req-792f078e-d9f2-405d-8d52-15234063cc0a'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:30.315686 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-792f078e-d9f2-405d-8d52-15234063cc0a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2ecf7a2ff704326ae157a6b4c4f6523', 'request_id': 'req-792f078e-d9f2-405d-8d52-15234063cc0a'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:30.403526 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-792f078e-d9f2-405d-8d52-15234063cc0a admin admin] The token cache is being invalidate because project a2ecf7a2ff704326ae157a6b4c4f6523 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80873) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 17:26:30.403798 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-792f078e-d9f2-405d-8d52-15234063cc0a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:30.413310 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-792f078e-d9f2-405d-8d52-15234063cc0a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:30.415204 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1062/2111] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 16 17:26:29 2022] DELETE /identity/v3/projects/a2ecf7a2ff704326ae157a6b4c4f6523 => generated 0 bytes in 680 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:26:30.418525 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792f078e-d9f2-405d-8d52-15234063cc0a admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:30.418525 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-792f078e-d9f2-405d-8d52-15234063cc0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:30.418724 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3e7c2b-0013-4695-a3e4-5afa806854fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:30.419922 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3e7c2b-0013-4695-a3e4-5afa806854fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:30.420056 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3e7c2b-0013-4695-a3e4-5afa806854fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:30.420836 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3e7c2b-0013-4695-a3e4-5afa806854fd admin admin] PATH_INFO: `/v3/projects/cb4d0d73cfca4b50bfafdca80ff09eb1` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:30.422116 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3e7c2b-0013-4695-a3e4-5afa806854fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb4d0d73cfca4b50bfafdca80ff09eb1)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:30.424230 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3e7c2b-0013-4695-a3e4-5afa806854fd admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:30.440087 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792f078e-d9f2-405d-8d52-15234063cc0a admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:30.454806 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe84462b-6b82-45d6-9a0d-7dbb503cab7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:30.455932 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe84462b-6b82-45d6-9a0d-7dbb503cab7b admin admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:30.456420 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe84462b-6b82-45d6-9a0d-7dbb503cab7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:30.456569 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe84462b-6b82-45d6-9a0d-7dbb503cab7b admin admin] PATH_INFO: `/v3/roles` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:30.457376 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe84462b-6b82-45d6-9a0d-7dbb503cab7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:30.459635 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe84462b-6b82-45d6-9a0d-7dbb503cab7b admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:30.474975 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1063/2112] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 17:26:30 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:26:30.474975 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe84462b-6b82-45d6-9a0d-7dbb503cab7b admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:30.474975 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-fe84462b-6b82-45d6-9a0d-7dbb503cab7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:30.491083 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe84462b-6b82-45d6-9a0d-7dbb503cab7b admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:30.495914 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb6b973-5de0-4d69-aabb-836f04cab5fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:30.496806 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb6b973-5de0-4d69-aabb-836f04cab5fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:30.499009 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb6b973-5de0-4d69-aabb-836f04cab5fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:30.499009 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb6b973-5de0-4d69-aabb-836f04cab5fe admin admin] PATH_INFO: `/v3/users/748143a01e68426cbf5b8052f9e7c2e8` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:30.499009 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb6b973-5de0-4d69-aabb-836f04cab5fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=748143a01e68426cbf5b8052f9e7c2e8)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:30.500732 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb6b973-5de0-4d69-aabb-836f04cab5fe admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:30.566911 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-5d3e7c2b-0013-4695-a3e4-5afa806854fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb4d0d73cfca4b50bfafdca80ff09eb1', 'request_id': 'req-5d3e7c2b-0013-4695-a3e4-5afa806854fd'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:30.572936 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-5d3e7c2b-0013-4695-a3e4-5afa806854fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb4d0d73cfca4b50bfafdca80ff09eb1', 'request_id': 'req-5d3e7c2b-0013-4695-a3e4-5afa806854fd'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:30.682633 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-5d3e7c2b-0013-4695-a3e4-5afa806854fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb4d0d73cfca4b50bfafdca80ff09eb1', 'request_id': 'req-5d3e7c2b-0013-4695-a3e4-5afa806854fd'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:30.711311 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-5d3e7c2b-0013-4695-a3e4-5afa806854fd admin admin] The token cache is being invalidate because project cb4d0d73cfca4b50bfafdca80ff09eb1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80874) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 17:26:30.711855 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-5d3e7c2b-0013-4695-a3e4-5afa806854fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:30.714513 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-5d3e7c2b-0013-4695-a3e4-5afa806854fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:30.716309 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1050/2113] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 16 17:26:30 2022] DELETE /identity/v3/projects/cb4d0d73cfca4b50bfafdca80ff09eb1 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:26:30.717698 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3e7c2b-0013-4695-a3e4-5afa806854fd admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:30.719133 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-5d3e7c2b-0013-4695-a3e4-5afa806854fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:30.769663 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-6eb6b973-5de0-4d69-aabb-836f04cab5fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '748143a01e68426cbf5b8052f9e7c2e8'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:30.773853 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-6eb6b973-5de0-4d69-aabb-836f04cab5fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '748143a01e68426cbf5b8052f9e7c2e8'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:30.773853 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-6eb6b973-5de0-4d69-aabb-836f04cab5fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '748143a01e68426cbf5b8052f9e7c2e8'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:30.831925 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3e7c2b-0013-4695-a3e4-5afa806854fd admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:30.836763 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af939ed0-9cff-4697-ae98-a1d21becaba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:30.837445 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af939ed0-9cff-4697-ae98-a1d21becaba9 admin admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:30.842802 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af939ed0-9cff-4697-ae98-a1d21becaba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:30.842802 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af939ed0-9cff-4697-ae98-a1d21becaba9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:30.842802 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af939ed0-9cff-4697-ae98-a1d21becaba9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:30.842802 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af939ed0-9cff-4697-ae98-a1d21becaba9 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:30.851406 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1051/2114] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 17:26:30 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:26:30.852239 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af939ed0-9cff-4697-ae98-a1d21becaba9 admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:30.853940 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-af939ed0-9cff-4697-ae98-a1d21becaba9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:30.866308 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af939ed0-9cff-4697-ae98-a1d21becaba9 admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:30.872005 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba5653e-d074-4710-9c27-97054c7bb3f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:30.872954 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba5653e-d074-4710-9c27-97054c7bb3f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:30.873247 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba5653e-d074-4710-9c27-97054c7bb3f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:30.873534 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba5653e-d074-4710-9c27-97054c7bb3f7 admin admin] PATH_INFO: `/v3/users/2c55974c99b24dd7a32c27b94d029daf` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:30.877299 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba5653e-d074-4710-9c27-97054c7bb3f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c55974c99b24dd7a32c27b94d029daf)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:30.877299 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba5653e-d074-4710-9c27-97054c7bb3f7 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:30.902652 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-6eb6b973-5de0-4d69-aabb-836f04cab5fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '748143a01e68426cbf5b8052f9e7c2e8'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:30.911018 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-6eb6b973-5de0-4d69-aabb-836f04cab5fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '748143a01e68426cbf5b8052f9e7c2e8'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:30.941067 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1064/2115] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 16 17:26:30 2022] DELETE /identity/v3/users/748143a01e68426cbf5b8052f9e7c2e8 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:26:30.946789 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb6b973-5de0-4d69-aabb-836f04cab5fe admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:30.951639 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-6eb6b973-5de0-4d69-aabb-836f04cab5fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:31.021820 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:26:31.047996 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb6b973-5de0-4d69-aabb-836f04cab5fe admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:31.052701 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a560ef6-4dbb-4417-aef7-ac6d0e7eba82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:31.054548 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a560ef6-4dbb-4417-aef7-ac6d0e7eba82 admin admin] REQUEST_METHOD: `PUT` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:31.054548 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a560ef6-4dbb-4417-aef7-ac6d0e7eba82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:31.054548 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a560ef6-4dbb-4417-aef7-ac6d0e7eba82 admin admin] PATH_INFO: `/v3/projects/9cfa474547a744678171dc5c7c22f6c9/users/6232b967ebb643c78949e23cf2c96ae2/roles/896bff49c5d6464eb612a15f4aa9badc` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:31.071963 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a560ef6-4dbb-4417-aef7-ac6d0e7eba82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cfa474547a744678171dc5c7c22f6c9, user_id=6232b967ebb643c78949e23cf2c96ae2, role_id=896bff49c5d6464eb612a15f4aa9badc)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:31.075587 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a560ef6-4dbb-4417-aef7-ac6d0e7eba82 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:31.122898 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-3ba5653e-d074-4710-9c27-97054c7bb3f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c55974c99b24dd7a32c27b94d029daf'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:31.130892 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-3ba5653e-d074-4710-9c27-97054c7bb3f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c55974c99b24dd7a32c27b94d029daf'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:31.208571 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-3ba5653e-d074-4710-9c27-97054c7bb3f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c55974c99b24dd7a32c27b94d029daf'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:31.209724 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-3ba5653e-d074-4710-9c27-97054c7bb3f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c55974c99b24dd7a32c27b94d029daf'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:31.221239 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1065/2116] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 17:26:30 2022] PUT /identity/v3/projects/9cfa474547a744678171dc5c7c22f6c9/users/6232b967ebb643c78949e23cf2c96ae2/roles/896bff49c5d6464eb612a15f4aa9badc => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:26:31.227626 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104d85c8-8558-4965-8b24-d98b5973dc61 None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:31.227898 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104d85c8-8558-4965-8b24-d98b5973dc61 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:31.228620 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104d85c8-8558-4965-8b24-d98b5973dc61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:31.234657 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-3ba5653e-d074-4710-9c27-97054c7bb3f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c55974c99b24dd7a32c27b94d029daf'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:31.244719 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1052/2117] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 16 17:26:30 2022] DELETE /identity/v3/users/2c55974c99b24dd7a32c27b94d029daf => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:26:31.262790 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-104d85c8-8558-4965-8b24-d98b5973dc61 None None] MFA Rules not processed for user `6232b967ebb643c78949e23cf2c96ae2`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:26:31.264026 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-104d85c8-8558-4965-8b24-d98b5973dc61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:31.359779 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b27413-563b-4e45-a9ca-aa8ed2b33aa1 None None] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:31.360121 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b27413-563b-4e45-a9ca-aa8ed2b33aa1 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:31.360487 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b27413-563b-4e45-a9ca-aa8ed2b33aa1 None None] PATH_INFO: `/` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:31.362332 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1053/2118] 10.222.0.39 () {54 vars in 921 bytes} [Thu Jun 16 17:26:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:26:31.367076 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1066/2119] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:26:31 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 17:26:31.368212 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b27413-563b-4e45-a9ca-aa8ed2b33aa1 None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:31.374619 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-68b27413-563b-4e45-a9ca-aa8ed2b33aa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:31.397110 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81f97ee-b38b-4c2d-b170-bcc29e2392a3 None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:31.398269 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81f97ee-b38b-4c2d-b170-bcc29e2392a3 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:31.399700 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81f97ee-b38b-4c2d-b170-bcc29e2392a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:31.424051 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-f81f97ee-b38b-4c2d-b170-bcc29e2392a3 None None] MFA Rules not processed for user `2882f26811094d8e88c03701c94296fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:26:31.426294 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-f81f97ee-b38b-4c2d-b170-bcc29e2392a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:31.462547 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b27413-563b-4e45-a9ca-aa8ed2b33aa1 None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:31.469631 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59715714-7ed6-40eb-b5b1-b134031a41c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:31.470344 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59715714-7ed6-40eb-b5b1-b134031a41c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:31.470634 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59715714-7ed6-40eb-b5b1-b134031a41c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:31.470917 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59715714-7ed6-40eb-b5b1-b134031a41c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:31.471627 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59715714-7ed6-40eb-b5b1-b134031a41c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:31.473649 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59715714-7ed6-40eb-b5b1-b134031a41c3 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:31.498872 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1067/2120] 10.222.0.39 () {58 vars in 1018 bytes} [Thu Jun 16 17:26:31 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 17:26:31.509624 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81f97ee-b38b-4c2d-b170-bcc29e2392a3 None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:31.512049 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-f81f97ee-b38b-4c2d-b170-bcc29e2392a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:31.526133 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81f97ee-b38b-4c2d-b170-bcc29e2392a3 None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:31.531834 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa12ebb5-39c4-4e8f-9104-0e31e2ab1629 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2882f26811094d8e88c03701c94296fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:31.532497 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa12ebb5-39c4-4e8f-9104-0e31e2ab1629 service placement] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:31.532820 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa12ebb5-39c4-4e8f-9104-0e31e2ab1629 service placement] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:31.533305 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa12ebb5-39c4-4e8f-9104-0e31e2ab1629 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:31.544764 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa12ebb5-39c4-4e8f-9104-0e31e2ab1629 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:31.547528 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa12ebb5-39c4-4e8f-9104-0e31e2ab1629 service placement] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:31.564588 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1068/2121] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:26:31 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 17:26:31.602922 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa12ebb5-39c4-4e8f-9104-0e31e2ab1629 service placement] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:31.604863 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-fa12ebb5-39c4-4e8f-9104-0e31e2ab1629 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:31.613242 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1054/2122] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 16 17:26:31 2022] POST /identity/v3/projects => generated 385 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:26:31.614434 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59715714-7ed6-40eb-b5b1-b134031a41c3 admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:31.628144 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa12ebb5-39c4-4e8f-9104-0e31e2ab1629 service placement] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:31.751542 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ebae16-9d82-4c79-8a64-040dfef12417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:31.752808 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ebae16-9d82-4c79-8a64-040dfef12417 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:31.753000 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ebae16-9d82-4c79-8a64-040dfef12417 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:31.754018 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ebae16-9d82-4c79-8a64-040dfef12417 admin admin] PATH_INFO: `/v3/projects/34593c9a677c4bafb77b54acdf252fee` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:31.757539 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ebae16-9d82-4c79-8a64-040dfef12417 admin admin] RBAC: Authorizing `identity:delete_project(project_id=34593c9a677c4bafb77b54acdf252fee)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:31.759576 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ebae16-9d82-4c79-8a64-040dfef12417 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:31.784215 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59715714-7ed6-40eb-b5b1-b134031a41c3 admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:31.793048 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ecfd81-c54b-49eb-9dc6-3263b8414a92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:31.795289 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ecfd81-c54b-49eb-9dc6-3263b8414a92 admin admin] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:31.795289 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ecfd81-c54b-49eb-9dc6-3263b8414a92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:31.795541 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ecfd81-c54b-49eb-9dc6-3263b8414a92 admin admin] PATH_INFO: `/v3/users` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:31.796327 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ecfd81-c54b-49eb-9dc6-3263b8414a92 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:31.800453 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ecfd81-c54b-49eb-9dc6-3263b8414a92 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:31.970460 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-59ebae16-9d82-4c79-8a64-040dfef12417 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34593c9a677c4bafb77b54acdf252fee', 'request_id': 'req-59ebae16-9d82-4c79-8a64-040dfef12417'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:31.976791 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-59ebae16-9d82-4c79-8a64-040dfef12417 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34593c9a677c4bafb77b54acdf252fee', 'request_id': 'req-59ebae16-9d82-4c79-8a64-040dfef12417'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:31.983290 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-59ebae16-9d82-4c79-8a64-040dfef12417 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34593c9a677c4bafb77b54acdf252fee', 'request_id': 'req-59ebae16-9d82-4c79-8a64-040dfef12417'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:31.996176 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:26:32.003562 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1055/2123] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 16 17:26:31 2022] POST /identity/v3/users => generated 299 bytes in 388 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:26:32.003562 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ecfd81-c54b-49eb-9dc6-3263b8414a92 admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:32.004674 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-23ecfd81-c54b-49eb-9dc6-3263b8414a92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:32.017438 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ecfd81-c54b-49eb-9dc6-3263b8414a92 admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:32.084173 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-59ebae16-9d82-4c79-8a64-040dfef12417 admin admin] The token cache is being invalidate because project 34593c9a677c4bafb77b54acdf252fee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80873) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 17:26:32.084173 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-59ebae16-9d82-4c79-8a64-040dfef12417 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:32.084173 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-59ebae16-9d82-4c79-8a64-040dfef12417 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:32.084173 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1069/2124] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 16 17:26:31 2022] DELETE /identity/v3/projects/34593c9a677c4bafb77b54acdf252fee => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 17:26:32.084545 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ebae16-9d82-4c79-8a64-040dfef12417 admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:32.088043 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-59ebae16-9d82-4c79-8a64-040dfef12417 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:32.088178 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021000a4-39b7-48d8-8a63-092ea74976e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:32.088178 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021000a4-39b7-48d8-8a63-092ea74976e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:32.088178 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021000a4-39b7-48d8-8a63-092ea74976e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:32.088178 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021000a4-39b7-48d8-8a63-092ea74976e7 admin admin] PATH_INFO: `/v3/users/b2dcab3652474b53b88e9443c0458721` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:32.089647 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021000a4-39b7-48d8-8a63-092ea74976e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2dcab3652474b53b88e9443c0458721)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:32.091673 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021000a4-39b7-48d8-8a63-092ea74976e7 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:32.099322 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ebae16-9d82-4c79-8a64-040dfef12417 admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:32.104097 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09992057-2b60-4140-adf6-f21a04b1e466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:32.105342 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09992057-2b60-4140-adf6-f21a04b1e466 admin admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:32.105630 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09992057-2b60-4140-adf6-f21a04b1e466 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:32.105947 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09992057-2b60-4140-adf6-f21a04b1e466 admin admin] PATH_INFO: `/v3/roles` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:32.106687 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09992057-2b60-4140-adf6-f21a04b1e466 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:32.108501 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09992057-2b60-4140-adf6-f21a04b1e466 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:32.121804 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1070/2125] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 17:26:32 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:26:32.121804 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09992057-2b60-4140-adf6-f21a04b1e466 admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:32.121804 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-09992057-2b60-4140-adf6-f21a04b1e466 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:32.133909 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09992057-2b60-4140-adf6-f21a04b1e466 admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:32.138891 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb3acdc-c625-4a1c-939f-95993b2495d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:32.139788 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb3acdc-c625-4a1c-939f-95993b2495d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:32.140076 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb3acdc-c625-4a1c-939f-95993b2495d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:32.140359 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb3acdc-c625-4a1c-939f-95993b2495d9 admin admin] PATH_INFO: `/v3/users/7a55f99c79ac4e568b051956e1fbf292` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:32.141616 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb3acdc-c625-4a1c-939f-95993b2495d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a55f99c79ac4e568b051956e1fbf292)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:32.143582 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb3acdc-c625-4a1c-939f-95993b2495d9 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:32.155095 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:26:32.352500 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-021000a4-39b7-48d8-8a63-092ea74976e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2dcab3652474b53b88e9443c0458721'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:32.359436 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-021000a4-39b7-48d8-8a63-092ea74976e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2dcab3652474b53b88e9443c0458721'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:32.427993 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-4cb3acdc-c625-4a1c-939f-95993b2495d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a55f99c79ac4e568b051956e1fbf292'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:32.428669 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-4cb3acdc-c625-4a1c-939f-95993b2495d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a55f99c79ac4e568b051956e1fbf292'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:32.429411 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-4cb3acdc-c625-4a1c-939f-95993b2495d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a55f99c79ac4e568b051956e1fbf292'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:32.442265 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-021000a4-39b7-48d8-8a63-092ea74976e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2dcab3652474b53b88e9443c0458721'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:32.442987 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-021000a4-39b7-48d8-8a63-092ea74976e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2dcab3652474b53b88e9443c0458721'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:32.456588 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-021000a4-39b7-48d8-8a63-092ea74976e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2dcab3652474b53b88e9443c0458721'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:32.462483 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1056/2126] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 16 17:26:32 2022] DELETE /identity/v3/users/b2dcab3652474b53b88e9443c0458721 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:26:32.463255 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021000a4-39b7-48d8-8a63-092ea74976e7 admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:32.465401 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-021000a4-39b7-48d8-8a63-092ea74976e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:32.522391 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-4cb3acdc-c625-4a1c-939f-95993b2495d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a55f99c79ac4e568b051956e1fbf292'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:32.530777 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-4cb3acdc-c625-4a1c-939f-95993b2495d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a55f99c79ac4e568b051956e1fbf292'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:32.531905 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021000a4-39b7-48d8-8a63-092ea74976e7 admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:32.536702 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1bd2ae-fade-4f3c-b38e-e9873f75a507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:32.537707 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1bd2ae-fade-4f3c-b38e-e9873f75a507 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:32.538033 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1bd2ae-fade-4f3c-b38e-e9873f75a507 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:32.538310 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1bd2ae-fade-4f3c-b38e-e9873f75a507 admin admin] PATH_INFO: `/v3/projects/a2f8c9b8eea14de59fe5fc99f704d683` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:32.539512 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1bd2ae-fade-4f3c-b38e-e9873f75a507 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2f8c9b8eea14de59fe5fc99f704d683)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:32.541416 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1bd2ae-fade-4f3c-b38e-e9873f75a507 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:32.553964 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1071/2127] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 16 17:26:32 2022] DELETE /identity/v3/users/7a55f99c79ac4e568b051956e1fbf292 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:26:32.558262 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb3acdc-c625-4a1c-939f-95993b2495d9 admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:32.560356 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-4cb3acdc-c625-4a1c-939f-95993b2495d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:32.631038 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb3acdc-c625-4a1c-939f-95993b2495d9 admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:32.636249 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e31582a-a734-4523-bd83-c925c1081902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:32.637192 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e31582a-a734-4523-bd83-c925c1081902 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:32.641070 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e31582a-a734-4523-bd83-c925c1081902 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:32.641070 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e31582a-a734-4523-bd83-c925c1081902 admin admin] PATH_INFO: `/v3/users/866bcc91039d472daff01eb2385be5ac` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:32.641070 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e31582a-a734-4523-bd83-c925c1081902 admin admin] RBAC: Authorizing `identity:delete_user(user_id=866bcc91039d472daff01eb2385be5ac)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:32.641070 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e31582a-a734-4523-bd83-c925c1081902 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:32.677074 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-2d1bd2ae-fade-4f3c-b38e-e9873f75a507 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2f8c9b8eea14de59fe5fc99f704d683', 'request_id': 'req-2d1bd2ae-fade-4f3c-b38e-e9873f75a507'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:32.683780 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-2d1bd2ae-fade-4f3c-b38e-e9873f75a507 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2f8c9b8eea14de59fe5fc99f704d683', 'request_id': 'req-2d1bd2ae-fade-4f3c-b38e-e9873f75a507'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:32.773677 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-2d1bd2ae-fade-4f3c-b38e-e9873f75a507 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2f8c9b8eea14de59fe5fc99f704d683', 'request_id': 'req-2d1bd2ae-fade-4f3c-b38e-e9873f75a507'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:32.786080 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-2d1bd2ae-fade-4f3c-b38e-e9873f75a507 admin admin] The token cache is being invalidate because project a2f8c9b8eea14de59fe5fc99f704d683 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80874) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 17:26:32.786375 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-2d1bd2ae-fade-4f3c-b38e-e9873f75a507 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:32.790391 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-2d1bd2ae-fade-4f3c-b38e-e9873f75a507 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:32.790391 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1057/2128] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 16 17:26:32 2022] DELETE /identity/v3/projects/a2f8c9b8eea14de59fe5fc99f704d683 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:26:32.790391 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1bd2ae-fade-4f3c-b38e-e9873f75a507 admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:32.790878 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-2d1bd2ae-fade-4f3c-b38e-e9873f75a507 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:32.860339 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1bd2ae-fade-4f3c-b38e-e9873f75a507 admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:32.865297 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcf2cdc-0145-43b9-aa92-59f3a3df6587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:32.866334 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcf2cdc-0145-43b9-aa92-59f3a3df6587 admin admin] REQUEST_METHOD: `PUT` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:32.866623 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcf2cdc-0145-43b9-aa92-59f3a3df6587 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:32.866913 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcf2cdc-0145-43b9-aa92-59f3a3df6587 admin admin] PATH_INFO: `/v3/projects/1a6c7786df004232aa9d78f818932256/users/6ade9bf545224023ab992241895c15b7/roles/dba744f8ab2a4c45b9d3212f8d203aba` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:32.885104 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcf2cdc-0145-43b9-aa92-59f3a3df6587 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a6c7786df004232aa9d78f818932256, user_id=6ade9bf545224023ab992241895c15b7, role_id=dba744f8ab2a4c45b9d3212f8d203aba)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:32.888923 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcf2cdc-0145-43b9-aa92-59f3a3df6587 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:32.906000 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-9e31582a-a734-4523-bd83-c925c1081902 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '866bcc91039d472daff01eb2385be5ac'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:32.906674 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-9e31582a-a734-4523-bd83-c925c1081902 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '866bcc91039d472daff01eb2385be5ac'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:32.907313 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-9e31582a-a734-4523-bd83-c925c1081902 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '866bcc91039d472daff01eb2385be5ac'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:33.000384 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-9e31582a-a734-4523-bd83-c925c1081902 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '866bcc91039d472daff01eb2385be5ac'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:33.009025 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1058/2129] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 17:26:32 2022] PUT /identity/v3/projects/1a6c7786df004232aa9d78f818932256/users/6ade9bf545224023ab992241895c15b7/roles/dba744f8ab2a4c45b9d3212f8d203aba => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:26:33.009848 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-9e31582a-a734-4523-bd83-c925c1081902 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '866bcc91039d472daff01eb2385be5ac'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:33.011151 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959d04c5-0519-4b11-b66c-cd7238e233bc None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:33.011522 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959d04c5-0519-4b11-b66c-cd7238e233bc None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:33.011877 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959d04c5-0519-4b11-b66c-cd7238e233bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:33.030053 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1072/2130] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 16 17:26:32 2022] DELETE /identity/v3/users/866bcc91039d472daff01eb2385be5ac => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:26:33.031017 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e31582a-a734-4523-bd83-c925c1081902 admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:33.032390 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-9e31582a-a734-4523-bd83-c925c1081902 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:33.044101 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-959d04c5-0519-4b11-b66c-cd7238e233bc None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:26:33.045368 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-959d04c5-0519-4b11-b66c-cd7238e233bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:33.120829 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e31582a-a734-4523-bd83-c925c1081902 admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:33.126438 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b72ed46-fcfc-4247-9501-f5ecec472707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:33.127462 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b72ed46-fcfc-4247-9501-f5ecec472707 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:33.127760 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b72ed46-fcfc-4247-9501-f5ecec472707 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:33.128043 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b72ed46-fcfc-4247-9501-f5ecec472707 admin admin] PATH_INFO: `/v3/projects/7f8a1bf102df4dc3ae9c1fa94c5863a8` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:33.132735 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b72ed46-fcfc-4247-9501-f5ecec472707 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f8a1bf102df4dc3ae9c1fa94c5863a8)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:33.135283 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b72ed46-fcfc-4247-9501-f5ecec472707 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:33.138963 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1059/2131] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:26:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:26:33.140202 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959d04c5-0519-4b11-b66c-cd7238e233bc None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:33.142225 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-959d04c5-0519-4b11-b66c-cd7238e233bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:33.155930 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959d04c5-0519-4b11-b66c-cd7238e233bc None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:33.161452 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8404cb13-1964-4380-b83c-474709417a52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:33.162377 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8404cb13-1964-4380-b83c-474709417a52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:33.162724 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8404cb13-1964-4380-b83c-474709417a52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:33.163009 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8404cb13-1964-4380-b83c-474709417a52 admin admin] PATH_INFO: `/v3/users/77d0993f7a4749c7ab3888d4396a3203` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:33.164582 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8404cb13-1964-4380-b83c-474709417a52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=77d0993f7a4749c7ab3888d4396a3203)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:33.167255 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8404cb13-1964-4380-b83c-474709417a52 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:33.252576 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-3b72ed46-fcfc-4247-9501-f5ecec472707 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f8a1bf102df4dc3ae9c1fa94c5863a8', 'request_id': 'req-3b72ed46-fcfc-4247-9501-f5ecec472707'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:33.261097 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-3b72ed46-fcfc-4247-9501-f5ecec472707 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f8a1bf102df4dc3ae9c1fa94c5863a8', 'request_id': 'req-3b72ed46-fcfc-4247-9501-f5ecec472707'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:33.270850 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-3b72ed46-fcfc-4247-9501-f5ecec472707 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f8a1bf102df4dc3ae9c1fa94c5863a8', 'request_id': 'req-3b72ed46-fcfc-4247-9501-f5ecec472707'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:33.362329 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-3b72ed46-fcfc-4247-9501-f5ecec472707 admin admin] The token cache is being invalidate because project 7f8a1bf102df4dc3ae9c1fa94c5863a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80873) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 17:26:33.362707 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-3b72ed46-fcfc-4247-9501-f5ecec472707 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:33.363307 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-3b72ed46-fcfc-4247-9501-f5ecec472707 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:33.364974 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1073/2132] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 16 17:26:33 2022] DELETE /identity/v3/projects/7f8a1bf102df4dc3ae9c1fa94c5863a8 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:26:33.365863 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b72ed46-fcfc-4247-9501-f5ecec472707 admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:33.367192 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-3b72ed46-fcfc-4247-9501-f5ecec472707 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:33.388606 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-8404cb13-1964-4380-b83c-474709417a52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77d0993f7a4749c7ab3888d4396a3203'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:33.396166 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-8404cb13-1964-4380-b83c-474709417a52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77d0993f7a4749c7ab3888d4396a3203'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:33.432155 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b72ed46-fcfc-4247-9501-f5ecec472707 admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:33.437908 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240de664-b5db-498c-a912-7096cfd6db9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:33.438578 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240de664-b5db-498c-a912-7096cfd6db9b admin admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:33.438865 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240de664-b5db-498c-a912-7096cfd6db9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:33.439142 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240de664-b5db-498c-a912-7096cfd6db9b admin admin] PATH_INFO: `/v3/roles` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:33.439869 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240de664-b5db-498c-a912-7096cfd6db9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:33.441450 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240de664-b5db-498c-a912-7096cfd6db9b admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:33.451850 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1074/2133] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 17:26:33 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:26:33.452648 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240de664-b5db-498c-a912-7096cfd6db9b admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:33.454352 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-240de664-b5db-498c-a912-7096cfd6db9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:33.487893 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-8404cb13-1964-4380-b83c-474709417a52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77d0993f7a4749c7ab3888d4396a3203'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:33.488492 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-8404cb13-1964-4380-b83c-474709417a52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77d0993f7a4749c7ab3888d4396a3203'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:33.506693 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-8404cb13-1964-4380-b83c-474709417a52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77d0993f7a4749c7ab3888d4396a3203'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:33.512735 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240de664-b5db-498c-a912-7096cfd6db9b admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:33.513552 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1060/2134] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 16 17:26:33 2022] DELETE /identity/v3/users/77d0993f7a4749c7ab3888d4396a3203 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:26:33.514972 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6631ddbd-7a51-4a6f-891f-1154a810ce1d None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:33.515417 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6631ddbd-7a51-4a6f-891f-1154a810ce1d None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:33.515708 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6631ddbd-7a51-4a6f-891f-1154a810ce1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:33.535904 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-6631ddbd-7a51-4a6f-891f-1154a810ce1d None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:26:33.537172 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-6631ddbd-7a51-4a6f-891f-1154a810ce1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:33.569168 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a629a54f-3341-4804-a592-d86bcd3904a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5d25bfa8dc042329d57cd55fa7b7b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:33.569865 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a629a54f-3341-4804-a592-d86bcd3904a3 service neutron] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:33.570391 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a629a54f-3341-4804-a592-d86bcd3904a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:33.570503 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a629a54f-3341-4804-a592-d86bcd3904a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:33.572313 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-a629a54f-3341-4804-a592-d86bcd3904a3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:33.613807 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1061/2135] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:26:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:26:33.614658 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6631ddbd-7a51-4a6f-891f-1154a810ce1d None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:33.616152 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-6631ddbd-7a51-4a6f-891f-1154a810ce1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:33.628395 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6631ddbd-7a51-4a6f-891f-1154a810ce1d None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:33.634209 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bcd98c-3578-4bfe-825f-01729eb1d863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:33.635131 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bcd98c-3578-4bfe-825f-01729eb1d863 admin admin] REQUEST_METHOD: `PUT` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:33.637750 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bcd98c-3578-4bfe-825f-01729eb1d863 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:33.637750 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bcd98c-3578-4bfe-825f-01729eb1d863 admin admin] PATH_INFO: `/v3/projects/1a6c7786df004232aa9d78f818932256/users/6ade9bf545224023ab992241895c15b7/roles/dba744f8ab2a4c45b9d3212f8d203aba` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:33.638054 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bcd98c-3578-4bfe-825f-01729eb1d863 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a6c7786df004232aa9d78f818932256, user_id=6ade9bf545224023ab992241895c15b7, role_id=dba744f8ab2a4c45b9d3212f8d203aba)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:33.645886 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bcd98c-3578-4bfe-825f-01729eb1d863 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:33.658180 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1062/2136] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 17:26:33 2022] PUT /identity/v3/projects/1a6c7786df004232aa9d78f818932256/users/6ade9bf545224023ab992241895c15b7/roles/dba744f8ab2a4c45b9d3212f8d203aba => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:26:33.662713 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bcd98c-3578-4bfe-825f-01729eb1d863 admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:33.664691 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-96bcd98c-3578-4bfe-825f-01729eb1d863 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:33.671816 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a629a54f-3341-4804-a592-d86bcd3904a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:33.677934 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a629a54f-3341-4804-a592-d86bcd3904a3 service neutron] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:33.683880 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1075/2137] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:26:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:26:33.685088 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217e59a6-6e3f-4bf4-996c-1d9ff7df4246 None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:33.685396 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217e59a6-6e3f-4bf4-996c-1d9ff7df4246 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:33.685667 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217e59a6-6e3f-4bf4-996c-1d9ff7df4246 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:33.712088 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-217e59a6-6e3f-4bf4-996c-1d9ff7df4246 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:26:33.713314 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-217e59a6-6e3f-4bf4-996c-1d9ff7df4246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:33.744411 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bcd98c-3578-4bfe-825f-01729eb1d863 admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:33.753156 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f381c456-bde5-4641-87c4-01e02d4ffa85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:33.753156 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f381c456-bde5-4641-87c4-01e02d4ffa85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:33.753156 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f381c456-bde5-4641-87c4-01e02d4ffa85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:33.753156 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f381c456-bde5-4641-87c4-01e02d4ffa85 admin admin] PATH_INFO: `/v3/projects/dc5be57b021d48f49cb081bd4b612800` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:33.754618 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f381c456-bde5-4641-87c4-01e02d4ffa85 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc5be57b021d48f49cb081bd4b612800)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:33.758701 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f381c456-bde5-4641-87c4-01e02d4ffa85 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:33.812481 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1076/2138] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:26:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:26:33.812481 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8692bf-5df8-47c7-bdd1-da5f46139c6c None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:33.812481 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8692bf-5df8-47c7-bdd1-da5f46139c6c None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:33.812481 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8692bf-5df8-47c7-bdd1-da5f46139c6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:33.843341 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-2e8692bf-5df8-47c7-bdd1-da5f46139c6c None None] MFA Rules not processed for user `6ade9bf545224023ab992241895c15b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:26:33.844644 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-2e8692bf-5df8-47c7-bdd1-da5f46139c6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:33.887598 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-f381c456-bde5-4641-87c4-01e02d4ffa85 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc5be57b021d48f49cb081bd4b612800', 'request_id': 'req-f381c456-bde5-4641-87c4-01e02d4ffa85'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:33.921088 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-f381c456-bde5-4641-87c4-01e02d4ffa85 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc5be57b021d48f49cb081bd4b612800', 'request_id': 'req-f381c456-bde5-4641-87c4-01e02d4ffa85'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:33.935917 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:26:33.955729 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1077/2139] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:26:33 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:26:33.956869 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8692bf-5df8-47c7-bdd1-da5f46139c6c None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:33.984148 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8692bf-5df8-47c7-bdd1-da5f46139c6c None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:34.038511 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29a7e3b-374a-40b7-bd11-0cc71fc6d912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:34.039190 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29a7e3b-374a-40b7-bd11-0cc71fc6d912 admin admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:34.039485 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29a7e3b-374a-40b7-bd11-0cc71fc6d912 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:34.039760 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29a7e3b-374a-40b7-bd11-0cc71fc6d912 admin admin] PATH_INFO: `/v3/domains` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:34.040493 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29a7e3b-374a-40b7-bd11-0cc71fc6d912 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80873) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:26:34.040797 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29a7e3b-374a-40b7-bd11-0cc71fc6d912 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:34.042491 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29a7e3b-374a-40b7-bd11-0cc71fc6d912 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:34.042679 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-f381c456-bde5-4641-87c4-01e02d4ffa85 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc5be57b021d48f49cb081bd4b612800', 'request_id': 'req-f381c456-bde5-4641-87c4-01e02d4ffa85'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:34.058550 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1078/2140] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 16 17:26:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:26:34.059785 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29a7e3b-374a-40b7-bd11-0cc71fc6d912 admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:34.061876 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-f29a7e3b-374a-40b7-bd11-0cc71fc6d912 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:34.070669 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-f381c456-bde5-4641-87c4-01e02d4ffa85 admin admin] The token cache is being invalidate because project dc5be57b021d48f49cb081bd4b612800 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80874) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 17:26:34.071031 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-f381c456-bde5-4641-87c4-01e02d4ffa85 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:34.073341 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-f381c456-bde5-4641-87c4-01e02d4ffa85 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:34.076263 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1063/2141] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 16 17:26:33 2022] DELETE /identity/v3/projects/dc5be57b021d48f49cb081bd4b612800 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:26:34.078161 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f381c456-bde5-4641-87c4-01e02d4ffa85 admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:34.083237 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:26:34.087179 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-f381c456-bde5-4641-87c4-01e02d4ffa85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:34.136752 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f381c456-bde5-4641-87c4-01e02d4ffa85 admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:34.141477 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0092cd-ec00-4836-85f6-5c096442575b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:34.141639 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29a7e3b-374a-40b7-bd11-0cc71fc6d912 admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:34.142621 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0092cd-ec00-4836-85f6-5c096442575b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:34.142953 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0092cd-ec00-4836-85f6-5c096442575b admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:34.143429 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0092cd-ec00-4836-85f6-5c096442575b admin admin] PATH_INFO: `/v3/projects/b5281e94015a4c978c3854389f9294b3` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:34.144734 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0092cd-ec00-4836-85f6-5c096442575b admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5281e94015a4c978c3854389f9294b3)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:34.145212 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867c9501-3192-46f1-b971-1985ae93c336 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef37136b89d34edc9cd94c7aa81b2095', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:34.146003 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867c9501-3192-46f1-b971-1985ae93c336 service cinder] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:34.146451 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867c9501-3192-46f1-b971-1985ae93c336 service cinder] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:34.146817 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867c9501-3192-46f1-b971-1985ae93c336 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:34.147412 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0092cd-ec00-4836-85f6-5c096442575b admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:34.149078 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-867c9501-3192-46f1-b971-1985ae93c336 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:34.220551 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867c9501-3192-46f1-b971-1985ae93c336 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:34.222016 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867c9501-3192-46f1-b971-1985ae93c336 service cinder] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:34.233745 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1079/2142] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:26:34 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:26:34.234710 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867c9501-3192-46f1-b971-1985ae93c336 service cinder] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:34.236200 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-867c9501-3192-46f1-b971-1985ae93c336 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:34.261145 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867c9501-3192-46f1-b971-1985ae93c336 service cinder] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:34.270926 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65915bd8-0a2a-4b66-9a78-6ec5ba9c31ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:34.276459 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65915bd8-0a2a-4b66-9a78-6ec5ba9c31ca admin admin] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:34.276459 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65915bd8-0a2a-4b66-9a78-6ec5ba9c31ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:34.276459 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65915bd8-0a2a-4b66-9a78-6ec5ba9c31ca admin admin] PATH_INFO: `/v3/projects` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:34.276459 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65915bd8-0a2a-4b66-9a78-6ec5ba9c31ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:34.276459 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65915bd8-0a2a-4b66-9a78-6ec5ba9c31ca admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:34.304829 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-9b0092cd-ec00-4836-85f6-5c096442575b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5281e94015a4c978c3854389f9294b3', 'request_id': 'req-9b0092cd-ec00-4836-85f6-5c096442575b'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:34.318288 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-9b0092cd-ec00-4836-85f6-5c096442575b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5281e94015a4c978c3854389f9294b3', 'request_id': 'req-9b0092cd-ec00-4836-85f6-5c096442575b'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:34.375054 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1080/2143] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 16 17:26:34 2022] POST /identity/v3/projects => generated 367 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:26:34.376301 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf739120-e334-45f7-a878-fdf119532b26 None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:34.376607 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf739120-e334-45f7-a878-fdf119532b26 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:34.376926 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf739120-e334-45f7-a878-fdf119532b26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:34.402387 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-cf739120-e334-45f7-a878-fdf119532b26 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:26:34.403734 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-cf739120-e334-45f7-a878-fdf119532b26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:34.413703 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-9b0092cd-ec00-4836-85f6-5c096442575b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5281e94015a4c978c3854389f9294b3', 'request_id': 'req-9b0092cd-ec00-4836-85f6-5c096442575b'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:34.428437 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-9b0092cd-ec00-4836-85f6-5c096442575b admin admin] The token cache is being invalidate because project b5281e94015a4c978c3854389f9294b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80874) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 17:26:34.428708 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-9b0092cd-ec00-4836-85f6-5c096442575b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:34.429369 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-9b0092cd-ec00-4836-85f6-5c096442575b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:34.430959 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1064/2144] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 16 17:26:34 2022] DELETE /identity/v3/projects/b5281e94015a4c978c3854389f9294b3 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:26:34.431713 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0092cd-ec00-4836-85f6-5c096442575b admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:34.433508 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-9b0092cd-ec00-4836-85f6-5c096442575b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:34.473727 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1081/2145] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:26:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:26:34.474717 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf739120-e334-45f7-a878-fdf119532b26 None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:34.476021 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-cf739120-e334-45f7-a878-fdf119532b26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:34.488120 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf739120-e334-45f7-a878-fdf119532b26 None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:34.492823 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fd0503-89a0-4ba2-a53f-22961c59c3f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:34.493694 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fd0503-89a0-4ba2-a53f-22961c59c3f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:34.494024 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fd0503-89a0-4ba2-a53f-22961c59c3f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:34.498298 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fd0503-89a0-4ba2-a53f-22961c59c3f4 admin admin] PATH_INFO: `/v3/users/6232b967ebb643c78949e23cf2c96ae2` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:34.498298 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fd0503-89a0-4ba2-a53f-22961c59c3f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6232b967ebb643c78949e23cf2c96ae2)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:34.498298 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fd0503-89a0-4ba2-a53f-22961c59c3f4 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:34.498616 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0092cd-ec00-4836-85f6-5c096442575b admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:34.503414 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3a832a-b4bb-434f-8f7f-56a5153d6ea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:34.504259 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3a832a-b4bb-434f-8f7f-56a5153d6ea2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:34.504543 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3a832a-b4bb-434f-8f7f-56a5153d6ea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:34.504823 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3a832a-b4bb-434f-8f7f-56a5153d6ea2 admin admin] PATH_INFO: `/v3/projects/b514f5eba7b340ddb3766129a1b82f7b` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:34.506069 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3a832a-b4bb-434f-8f7f-56a5153d6ea2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b514f5eba7b340ddb3766129a1b82f7b)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:34.508001 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3a832a-b4bb-434f-8f7f-56a5153d6ea2 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:34.688914 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-ce3a832a-b4bb-434f-8f7f-56a5153d6ea2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b514f5eba7b340ddb3766129a1b82f7b', 'request_id': 'req-ce3a832a-b4bb-434f-8f7f-56a5153d6ea2'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:34.689102 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-85fd0503-89a0-4ba2-a53f-22961c59c3f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6232b967ebb643c78949e23cf2c96ae2'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:34.689889 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-85fd0503-89a0-4ba2-a53f-22961c59c3f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6232b967ebb643c78949e23cf2c96ae2'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:34.690645 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-85fd0503-89a0-4ba2-a53f-22961c59c3f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6232b967ebb643c78949e23cf2c96ae2'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:34.695217 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-ce3a832a-b4bb-434f-8f7f-56a5153d6ea2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b514f5eba7b340ddb3766129a1b82f7b', 'request_id': 'req-ce3a832a-b4bb-434f-8f7f-56a5153d6ea2'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:34.789010 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-85fd0503-89a0-4ba2-a53f-22961c59c3f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6232b967ebb643c78949e23cf2c96ae2'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:34.797121 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-85fd0503-89a0-4ba2-a53f-22961c59c3f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6232b967ebb643c78949e23cf2c96ae2'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:34.814714 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1082/2146] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 16 17:26:34 2022] DELETE /identity/v3/users/6232b967ebb643c78949e23cf2c96ae2 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:26:34.815496 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fd0503-89a0-4ba2-a53f-22961c59c3f4 admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:34.816821 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-85fd0503-89a0-4ba2-a53f-22961c59c3f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:34.882550 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fd0503-89a0-4ba2-a53f-22961c59c3f4 admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:34.887450 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d1e4d6-428b-42f5-ae98-f36176069ed1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:34.887588 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-ce3a832a-b4bb-434f-8f7f-56a5153d6ea2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b514f5eba7b340ddb3766129a1b82f7b', 'request_id': 'req-ce3a832a-b4bb-434f-8f7f-56a5153d6ea2'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:34.888139 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d1e4d6-428b-42f5-ae98-f36176069ed1 admin admin] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:34.888405 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d1e4d6-428b-42f5-ae98-f36176069ed1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:34.888690 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d1e4d6-428b-42f5-ae98-f36176069ed1 admin admin] PATH_INFO: `/v3/users` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:34.889388 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d1e4d6-428b-42f5-ae98-f36176069ed1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:34.891425 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d1e4d6-428b-42f5-ae98-f36176069ed1 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:34.900680 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-ce3a832a-b4bb-434f-8f7f-56a5153d6ea2 admin admin] The token cache is being invalidate because project b514f5eba7b340ddb3766129a1b82f7b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80874) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 17:26:34.900980 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-ce3a832a-b4bb-434f-8f7f-56a5153d6ea2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:34.901678 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-ce3a832a-b4bb-434f-8f7f-56a5153d6ea2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:34.903730 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1065/2147] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 16 17:26:34 2022] DELETE /identity/v3/projects/b514f5eba7b340ddb3766129a1b82f7b => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:26:34.905060 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f0678f-055c-4ed0-8057-47587e54fa06 None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:34.905354 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f0678f-055c-4ed0-8057-47587e54fa06 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:34.905668 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f0678f-055c-4ed0-8057-47587e54fa06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:34.923784 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-72f0678f-055c-4ed0-8057-47587e54fa06 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:26:34.924996 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-72f0678f-055c-4ed0-8057-47587e54fa06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:34.934193 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1066/2148] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:26:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:26:34.936036 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e81865-dbd4-4741-a900-b48bb1355dfd None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:34.938337 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e81865-dbd4-4741-a900-b48bb1355dfd None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:34.938337 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e81865-dbd4-4741-a900-b48bb1355dfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:34.966004 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-22e81865-dbd4-4741-a900-b48bb1355dfd None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:26:34.966377 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-22e81865-dbd4-4741-a900-b48bb1355dfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:34.980667 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1067/2149] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:26:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:26:34.982906 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf43e13-c309-4352-bff3-bec44e3af605 None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:34.983389 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf43e13-c309-4352-bff3-bec44e3af605 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:34.983866 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf43e13-c309-4352-bff3-bec44e3af605 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:34.993034 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1083/2150] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 16 17:26:34 2022] POST /identity/v3/users => generated 284 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:26:34.993661 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d1e4d6-428b-42f5-ae98-f36176069ed1 admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:34.996963 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-86d1e4d6-428b-42f5-ae98-f36176069ed1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:35.015411 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-acf43e13-c309-4352-bff3-bec44e3af605 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:26:35.016826 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-acf43e13-c309-4352-bff3-bec44e3af605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:35.021064 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d1e4d6-428b-42f5-ae98-f36176069ed1 admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:35.025435 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1068/2151] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:26:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:26:35.026933 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f381a96-16a5-4456-9fe7-60f9cfcc1e01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:35.027226 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c175334-6382-4499-a308-817a12a27946 None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:35.027813 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f381a96-16a5-4456-9fe7-60f9cfcc1e01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:35.027967 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c175334-6382-4499-a308-817a12a27946 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:35.028108 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f381a96-16a5-4456-9fe7-60f9cfcc1e01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:35.028270 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c175334-6382-4499-a308-817a12a27946 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:35.028401 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f381a96-16a5-4456-9fe7-60f9cfcc1e01 admin admin] PATH_INFO: `/v3/users/f0e5fc75d0fa4f29a6d441887fd4ed01` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:35.029639 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f381a96-16a5-4456-9fe7-60f9cfcc1e01 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0e5fc75d0fa4f29a6d441887fd4ed01)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:35.031614 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f381a96-16a5-4456-9fe7-60f9cfcc1e01 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:35.051146 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-7c175334-6382-4499-a308-817a12a27946 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:26:35.052338 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-7c175334-6382-4499-a308-817a12a27946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:35.060889 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1069/2152] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:26:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:26:35.061427 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c175334-6382-4499-a308-817a12a27946 None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:35.070667 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c175334-6382-4499-a308-817a12a27946 None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:35.075712 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dd2293-8db8-4e71-81ed-18d0c4c0b0fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:35.076345 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dd2293-8db8-4e71-81ed-18d0c4c0b0fa admin admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:35.076630 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dd2293-8db8-4e71-81ed-18d0c4c0b0fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:35.076914 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dd2293-8db8-4e71-81ed-18d0c4c0b0fa admin admin] PATH_INFO: `/v3/domains` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:35.077634 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dd2293-8db8-4e71-81ed-18d0c4c0b0fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:26:35.077976 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dd2293-8db8-4e71-81ed-18d0c4c0b0fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:35.079565 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dd2293-8db8-4e71-81ed-18d0c4c0b0fa admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:35.093550 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1070/2153] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 16 17:26:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:26:35.094517 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dd2293-8db8-4e71-81ed-18d0c4c0b0fa admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:35.096321 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-76dd2293-8db8-4e71-81ed-18d0c4c0b0fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:35.110094 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dd2293-8db8-4e71-81ed-18d0c4c0b0fa admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:35.114716 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797387f2-b9f1-459b-96e9-8f433ee5cacd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:35.115377 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797387f2-b9f1-459b-96e9-8f433ee5cacd admin admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:35.115663 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797387f2-b9f1-459b-96e9-8f433ee5cacd admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:35.115942 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797387f2-b9f1-459b-96e9-8f433ee5cacd admin admin] PATH_INFO: `/v3/roles` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:35.116665 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797387f2-b9f1-459b-96e9-8f433ee5cacd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:35.118280 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797387f2-b9f1-459b-96e9-8f433ee5cacd admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:35.128619 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1071/2154] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 17:26:35 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:26:35.129421 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797387f2-b9f1-459b-96e9-8f433ee5cacd admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:35.135450 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-797387f2-b9f1-459b-96e9-8f433ee5cacd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:35.191320 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797387f2-b9f1-459b-96e9-8f433ee5cacd admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:35.196087 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ae8fd5-6739-47f3-a0b2-af4bed45616f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5d25bfa8dc042329d57cd55fa7b7b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:35.197116 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ae8fd5-6739-47f3-a0b2-af4bed45616f service neutron] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:35.197579 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ae8fd5-6739-47f3-a0b2-af4bed45616f service neutron] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:35.198123 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ae8fd5-6739-47f3-a0b2-af4bed45616f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:35.205947 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-4f381a96-16a5-4456-9fe7-60f9cfcc1e01 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0e5fc75d0fa4f29a6d441887fd4ed01'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:35.207063 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-4f381a96-16a5-4456-9fe7-60f9cfcc1e01 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0e5fc75d0fa4f29a6d441887fd4ed01'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:35.207931 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-4f381a96-16a5-4456-9fe7-60f9cfcc1e01 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0e5fc75d0fa4f29a6d441887fd4ed01'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:35.215827 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ae8fd5-6739-47f3-a0b2-af4bed45616f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:35.217146 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ae8fd5-6739-47f3-a0b2-af4bed45616f service neutron] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:35.226911 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1072/2155] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:26:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:26:35.227691 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ae8fd5-6739-47f3-a0b2-af4bed45616f service neutron] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:35.237721 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ae8fd5-6739-47f3-a0b2-af4bed45616f service neutron] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:35.242334 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8824a40-8626-4b99-a2ae-8cc9bb518bf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:35.244254 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8824a40-8626-4b99-a2ae-8cc9bb518bf4 admin admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:35.244254 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8824a40-8626-4b99-a2ae-8cc9bb518bf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:35.244254 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8824a40-8626-4b99-a2ae-8cc9bb518bf4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:35.244254 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8824a40-8626-4b99-a2ae-8cc9bb518bf4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:26:35.244673 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8824a40-8626-4b99-a2ae-8cc9bb518bf4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:35.246181 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8824a40-8626-4b99-a2ae-8cc9bb518bf4 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:35.258649 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1073/2156] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 16 17:26:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:26:35.259698 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8824a40-8626-4b99-a2ae-8cc9bb518bf4 admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:35.261713 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-a8824a40-8626-4b99-a2ae-8cc9bb518bf4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:35.265834 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:26:35.278086 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8824a40-8626-4b99-a2ae-8cc9bb518bf4 admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:35.283531 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58520dd-e43c-47b3-8f4c-96e76c1d733e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:35.284212 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58520dd-e43c-47b3-8f4c-96e76c1d733e admin admin] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:35.284653 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58520dd-e43c-47b3-8f4c-96e76c1d733e admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:35.284938 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58520dd-e43c-47b3-8f4c-96e76c1d733e admin admin] PATH_INFO: `/v3/projects` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:35.285647 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58520dd-e43c-47b3-8f4c-96e76c1d733e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:35.287606 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58520dd-e43c-47b3-8f4c-96e76c1d733e admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:35.291765 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-4f381a96-16a5-4456-9fe7-60f9cfcc1e01 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0e5fc75d0fa4f29a6d441887fd4ed01'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:35.300270 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-4f381a96-16a5-4456-9fe7-60f9cfcc1e01 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0e5fc75d0fa4f29a6d441887fd4ed01'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:35.319195 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1084/2157] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 16 17:26:34 2022] DELETE /identity/v3/users/f0e5fc75d0fa4f29a6d441887fd4ed01 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:26:35.319969 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f381a96-16a5-4456-9fe7-60f9cfcc1e01 admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:35.321455 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-4f381a96-16a5-4456-9fe7-60f9cfcc1e01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:35.378035 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:26:35.391017 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f381a96-16a5-4456-9fe7-60f9cfcc1e01 admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:35.395761 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e278a1ac-5e58-4371-8b45-d93f5132fdfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:35.396435 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e278a1ac-5e58-4371-8b45-d93f5132fdfd admin admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:35.396729 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e278a1ac-5e58-4371-8b45-d93f5132fdfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:35.397009 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e278a1ac-5e58-4371-8b45-d93f5132fdfd admin admin] PATH_INFO: `/v3/roles` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:35.397924 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e278a1ac-5e58-4371-8b45-d93f5132fdfd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:35.399768 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e278a1ac-5e58-4371-8b45-d93f5132fdfd admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:35.412138 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1085/2158] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 17:26:35 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:26:35.413073 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e278a1ac-5e58-4371-8b45-d93f5132fdfd admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:35.414810 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-e278a1ac-5e58-4371-8b45-d93f5132fdfd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:35.428541 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1074/2159] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 16 17:26:35 2022] POST /identity/v3/projects => generated 383 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:26:35.428541 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58520dd-e43c-47b3-8f4c-96e76c1d733e admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:35.435781 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e278a1ac-5e58-4371-8b45-d93f5132fdfd admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:35.495452 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09417fb-7650-4671-bd2f-3dd75d9a021f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:35.496109 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09417fb-7650-4671-bd2f-3dd75d9a021f admin admin] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:35.496466 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09417fb-7650-4671-bd2f-3dd75d9a021f admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:35.496890 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09417fb-7650-4671-bd2f-3dd75d9a021f admin admin] PATH_INFO: `/v3/projects` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:35.497921 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09417fb-7650-4671-bd2f-3dd75d9a021f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:35.499764 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09417fb-7650-4671-bd2f-3dd75d9a021f admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:35.513270 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58520dd-e43c-47b3-8f4c-96e76c1d733e admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:35.519211 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2876bb1e-5208-4ae4-925c-acce606ef45d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:35.520520 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2876bb1e-5208-4ae4-925c-acce606ef45d admin admin] REQUEST_METHOD: `PUT` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:35.520883 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2876bb1e-5208-4ae4-925c-acce606ef45d admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:35.521364 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2876bb1e-5208-4ae4-925c-acce606ef45d admin admin] PATH_INFO: `/v3/projects/7847e171f42e49d8b75e9b22b4c31afe/users/0ea8170386604e90904619c4ed5b42f4/roles/896bff49c5d6464eb612a15f4aa9badc` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:35.551034 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2876bb1e-5208-4ae4-925c-acce606ef45d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7847e171f42e49d8b75e9b22b4c31afe, user_id=0ea8170386604e90904619c4ed5b42f4, role_id=896bff49c5d6464eb612a15f4aa9badc)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:35.553983 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2876bb1e-5208-4ae4-925c-acce606ef45d admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:35.628266 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1086/2160] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 16 17:26:35 2022] POST /identity/v3/projects => generated 375 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:26:35.629625 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09417fb-7650-4671-bd2f-3dd75d9a021f admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:35.664902 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1075/2161] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 17:26:35 2022] PUT /identity/v3/projects/7847e171f42e49d8b75e9b22b4c31afe/users/0ea8170386604e90904619c4ed5b42f4/roles/896bff49c5d6464eb612a15f4aa9badc => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:26:35.664902 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2876bb1e-5208-4ae4-925c-acce606ef45d admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:35.728896 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09417fb-7650-4671-bd2f-3dd75d9a021f admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:35.745928 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2876bb1e-5208-4ae4-925c-acce606ef45d admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:35.753953 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c237d9-ecd9-4f8d-a910-b48b66482e0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:35.754833 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c237d9-ecd9-4f8d-a910-b48b66482e0c admin admin] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:35.755125 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c237d9-ecd9-4f8d-a910-b48b66482e0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:35.755415 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c237d9-ecd9-4f8d-a910-b48b66482e0c admin admin] PATH_INFO: `/v3/users` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:35.756126 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c237d9-ecd9-4f8d-a910-b48b66482e0c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:35.758165 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c237d9-ecd9-4f8d-a910-b48b66482e0c admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:35.796033 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309ab441-9d71-4946-81df-8c59ca315616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:35.796813 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309ab441-9d71-4946-81df-8c59ca315616 admin admin] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:35.797021 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309ab441-9d71-4946-81df-8c59ca315616 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:35.797319 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309ab441-9d71-4946-81df-8c59ca315616 admin admin] PATH_INFO: `/v3/users` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:35.798037 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309ab441-9d71-4946-81df-8c59ca315616 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:35.800065 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309ab441-9d71-4946-81df-8c59ca315616 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:35.870547 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1076/2162] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 16 17:26:35 2022] POST /identity/v3/users => generated 288 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:26:35.872309 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fabe40c-2aa9-4b1f-9e98-f44fabf20a6e None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:35.872309 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fabe40c-2aa9-4b1f-9e98-f44fabf20a6e None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:35.872309 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fabe40c-2aa9-4b1f-9e98-f44fabf20a6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:35.907224 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-1fabe40c-2aa9-4b1f-9e98-f44fabf20a6e None None] MFA Rules not processed for user `0ea8170386604e90904619c4ed5b42f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:26:35.908096 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-1fabe40c-2aa9-4b1f-9e98-f44fabf20a6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:35.910800 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1087/2163] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 16 17:26:35 2022] POST /identity/v3/users => generated 292 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:26:35.911768 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309ab441-9d71-4946-81df-8c59ca315616 admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:35.914456 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-309ab441-9d71-4946-81df-8c59ca315616 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:35.926486 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309ab441-9d71-4946-81df-8c59ca315616 admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:35.932581 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5e380e-f8b5-4829-b68a-c561b6e4a11d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:35.936985 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5e380e-f8b5-4829-b68a-c561b6e4a11d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:35.936985 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5e380e-f8b5-4829-b68a-c561b6e4a11d admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:35.936985 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5e380e-f8b5-4829-b68a-c561b6e4a11d admin admin] PATH_INFO: `/v3/projects/9cfa474547a744678171dc5c7c22f6c9` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:35.936985 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5e380e-f8b5-4829-b68a-c561b6e4a11d admin admin] RBAC: Authorizing `identity:delete_project(project_id=9cfa474547a744678171dc5c7c22f6c9)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:35.937331 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5e380e-f8b5-4829-b68a-c561b6e4a11d admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:35.977957 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1077/2164] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:26:35 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:26:35.978870 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fabe40c-2aa9-4b1f-9e98-f44fabf20a6e None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:35.983636 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-1fabe40c-2aa9-4b1f-9e98-f44fabf20a6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:35.999232 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fabe40c-2aa9-4b1f-9e98-f44fabf20a6e None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:36.003855 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6ed855-c679-4df1-bd93-1502899acf44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:36.004746 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6ed855-c679-4df1-bd93-1502899acf44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:36.005030 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6ed855-c679-4df1-bd93-1502899acf44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:36.005335 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6ed855-c679-4df1-bd93-1502899acf44 admin admin] PATH_INFO: `/v3/projects/e72d41116bca4f76adc67b0362ec3ff0` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:36.006560 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6ed855-c679-4df1-bd93-1502899acf44 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e72d41116bca4f76adc67b0362ec3ff0)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:36.011582 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6ed855-c679-4df1-bd93-1502899acf44 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:36.075232 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-cf5e380e-f8b5-4829-b68a-c561b6e4a11d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9cfa474547a744678171dc5c7c22f6c9', 'request_id': 'req-cf5e380e-f8b5-4829-b68a-c561b6e4a11d'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:36.081999 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-cf5e380e-f8b5-4829-b68a-c561b6e4a11d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9cfa474547a744678171dc5c7c22f6c9', 'request_id': 'req-cf5e380e-f8b5-4829-b68a-c561b6e4a11d'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:36.087834 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-cf5e380e-f8b5-4829-b68a-c561b6e4a11d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9cfa474547a744678171dc5c7c22f6c9', 'request_id': 'req-cf5e380e-f8b5-4829-b68a-c561b6e4a11d'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:36.165584 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-9a6ed855-c679-4df1-bd93-1502899acf44 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e72d41116bca4f76adc67b0362ec3ff0', 'request_id': 'req-9a6ed855-c679-4df1-bd93-1502899acf44'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:36.171689 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-9a6ed855-c679-4df1-bd93-1502899acf44 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e72d41116bca4f76adc67b0362ec3ff0', 'request_id': 'req-9a6ed855-c679-4df1-bd93-1502899acf44'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:36.180511 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-cf5e380e-f8b5-4829-b68a-c561b6e4a11d admin admin] The token cache is being invalidate because project 9cfa474547a744678171dc5c7c22f6c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80873) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 17:26:36.180810 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-cf5e380e-f8b5-4829-b68a-c561b6e4a11d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:36.181516 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-cf5e380e-f8b5-4829-b68a-c561b6e4a11d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:36.183813 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1088/2165] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 16 17:26:35 2022] DELETE /identity/v3/projects/9cfa474547a744678171dc5c7c22f6c9 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:26:36.184733 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5e380e-f8b5-4829-b68a-c561b6e4a11d admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:36.186096 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-cf5e380e-f8b5-4829-b68a-c561b6e4a11d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:36.249873 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5e380e-f8b5-4829-b68a-c561b6e4a11d admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:36.270329 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-9a6ed855-c679-4df1-bd93-1502899acf44 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e72d41116bca4f76adc67b0362ec3ff0', 'request_id': 'req-9a6ed855-c679-4df1-bd93-1502899acf44'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:36.282159 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-9a6ed855-c679-4df1-bd93-1502899acf44 admin admin] The token cache is being invalidate because project e72d41116bca4f76adc67b0362ec3ff0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80874) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 17:26:36.282452 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-9a6ed855-c679-4df1-bd93-1502899acf44 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:36.283116 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-9a6ed855-c679-4df1-bd93-1502899acf44 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:36.284682 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1078/2166] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 16 17:26:35 2022] DELETE /identity/v3/projects/e72d41116bca4f76adc67b0362ec3ff0 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:26:36.285524 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6ed855-c679-4df1-bd93-1502899acf44 admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:36.286920 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-9a6ed855-c679-4df1-bd93-1502899acf44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:36.309064 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4e6043-db2d-4f6f-93e6-3c8e11898d32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:36.309751 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4e6043-db2d-4f6f-93e6-3c8e11898d32 admin admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:36.310084 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4e6043-db2d-4f6f-93e6-3c8e11898d32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:36.310364 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4e6043-db2d-4f6f-93e6-3c8e11898d32 admin admin] PATH_INFO: `/v3/roles` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:36.311122 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4e6043-db2d-4f6f-93e6-3c8e11898d32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:36.312784 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4e6043-db2d-4f6f-93e6-3c8e11898d32 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:36.322992 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1089/2167] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 17:26:36 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:26:36.324066 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4e6043-db2d-4f6f-93e6-3c8e11898d32 admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:36.325895 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-2b4e6043-db2d-4f6f-93e6-3c8e11898d32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:36.355837 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6ed855-c679-4df1-bd93-1502899acf44 admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:36.360634 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d4d2c0-9d3e-4ec0-a4b9-926453ce77db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:36.361310 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d4d2c0-9d3e-4ec0-a4b9-926453ce77db admin admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:36.361600 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d4d2c0-9d3e-4ec0-a4b9-926453ce77db admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:36.361921 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d4d2c0-9d3e-4ec0-a4b9-926453ce77db admin admin] PATH_INFO: `/v3/roles` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:36.362659 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d4d2c0-9d3e-4ec0-a4b9-926453ce77db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:36.364287 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d4d2c0-9d3e-4ec0-a4b9-926453ce77db admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:36.378389 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1079/2168] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 17:26:36 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:26:36.378389 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d4d2c0-9d3e-4ec0-a4b9-926453ce77db admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:36.378389 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-27d4d2c0-9d3e-4ec0-a4b9-926453ce77db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:36.384103 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4e6043-db2d-4f6f-93e6-3c8e11898d32 admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:36.388910 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55753458-1409-43de-9a9f-d39f92821f72 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef37136b89d34edc9cd94c7aa81b2095', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:36.389665 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55753458-1409-43de-9a9f-d39f92821f72 service cinder] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:36.389983 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55753458-1409-43de-9a9f-d39f92821f72 service cinder] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:36.390265 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55753458-1409-43de-9a9f-d39f92821f72 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:36.391922 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d4d2c0-9d3e-4ec0-a4b9-926453ce77db admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:36.392101 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-55753458-1409-43de-9a9f-d39f92821f72 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:36.396665 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865c52cd-d451-41ca-bdb3-564073744f76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:36.397592 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865c52cd-d451-41ca-bdb3-564073744f76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:36.397925 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865c52cd-d451-41ca-bdb3-564073744f76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:36.398210 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865c52cd-d451-41ca-bdb3-564073744f76 admin admin] PATH_INFO: `/v3/users/6ade9bf545224023ab992241895c15b7` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:36.399733 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865c52cd-d451-41ca-bdb3-564073744f76 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ade9bf545224023ab992241895c15b7)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:36.401695 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865c52cd-d451-41ca-bdb3-564073744f76 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:36.452220 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55753458-1409-43de-9a9f-d39f92821f72 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:36.453689 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55753458-1409-43de-9a9f-d39f92821f72 service cinder] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:36.462473 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1090/2169] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:26:36 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:26:36.463954 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55753458-1409-43de-9a9f-d39f92821f72 service cinder] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:36.465819 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-55753458-1409-43de-9a9f-d39f92821f72 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:36.486398 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55753458-1409-43de-9a9f-d39f92821f72 service cinder] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:36.491213 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6f81ba-7479-4d62-bc08-ae8f3b6992ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:36.492225 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6f81ba-7479-4d62-bc08-ae8f3b6992ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:36.492571 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6f81ba-7479-4d62-bc08-ae8f3b6992ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:36.492861 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6f81ba-7479-4d62-bc08-ae8f3b6992ac admin admin] PATH_INFO: `/v3/users/52feb3bb630541de864adabe8a496c29` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:36.494381 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6f81ba-7479-4d62-bc08-ae8f3b6992ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=52feb3bb630541de864adabe8a496c29)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:36.496336 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6f81ba-7479-4d62-bc08-ae8f3b6992ac admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:36.606203 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-865c52cd-d451-41ca-bdb3-564073744f76 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ade9bf545224023ab992241895c15b7'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:36.613529 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-865c52cd-d451-41ca-bdb3-564073744f76 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ade9bf545224023ab992241895c15b7'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:36.715292 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-865c52cd-d451-41ca-bdb3-564073744f76 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ade9bf545224023ab992241895c15b7'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:36.716583 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-865c52cd-d451-41ca-bdb3-564073744f76 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ade9bf545224023ab992241895c15b7'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:36.719026 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:26:36.731380 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-865c52cd-d451-41ca-bdb3-564073744f76 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ade9bf545224023ab992241895c15b7'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:36.740428 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1080/2170] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 16 17:26:36 2022] DELETE /identity/v3/users/6ade9bf545224023ab992241895c15b7 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:26:36.740428 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865c52cd-d451-41ca-bdb3-564073744f76 admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:36.740428 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-865c52cd-d451-41ca-bdb3-564073744f76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:36.758206 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-1a6f81ba-7479-4d62-bc08-ae8f3b6992ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52feb3bb630541de864adabe8a496c29'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:36.759354 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-1a6f81ba-7479-4d62-bc08-ae8f3b6992ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52feb3bb630541de864adabe8a496c29'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:36.760128 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-1a6f81ba-7479-4d62-bc08-ae8f3b6992ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52feb3bb630541de864adabe8a496c29'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:36.842658 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-1a6f81ba-7479-4d62-bc08-ae8f3b6992ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52feb3bb630541de864adabe8a496c29'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:36.843831 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865c52cd-d451-41ca-bdb3-564073744f76 admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:36.850746 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e231031-0695-4e96-9f66-e83b8fcf61d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:36.851802 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e231031-0695-4e96-9f66-e83b8fcf61d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:36.852196 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-1a6f81ba-7479-4d62-bc08-ae8f3b6992ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52feb3bb630541de864adabe8a496c29'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:36.852426 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e231031-0695-4e96-9f66-e83b8fcf61d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:36.852864 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e231031-0695-4e96-9f66-e83b8fcf61d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:36.853842 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e231031-0695-4e96-9f66-e83b8fcf61d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:36.855760 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e231031-0695-4e96-9f66-e83b8fcf61d4 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:36.872180 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1081/2171] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 17:26:36 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:26:36.873400 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e231031-0695-4e96-9f66-e83b8fcf61d4 admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:36.875517 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-1e231031-0695-4e96-9f66-e83b8fcf61d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:36.887841 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1091/2172] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 16 17:26:36 2022] DELETE /identity/v3/users/52feb3bb630541de864adabe8a496c29 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:26:36.887841 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6f81ba-7479-4d62-bc08-ae8f3b6992ac admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:36.894515 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e231031-0695-4e96-9f66-e83b8fcf61d4 admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:36.898261 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-1a6f81ba-7479-4d62-bc08-ae8f3b6992ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:36.956504 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:26:36.980921 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6f81ba-7479-4d62-bc08-ae8f3b6992ac admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:36.981165 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e73068d-6305-4ce7-b378-4155044a49ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:36.982066 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e73068d-6305-4ce7-b378-4155044a49ad admin admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:36.982602 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e73068d-6305-4ce7-b378-4155044a49ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:36.983113 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e73068d-6305-4ce7-b378-4155044a49ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:36.984105 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e73068d-6305-4ce7-b378-4155044a49ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:36.986022 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e73068d-6305-4ce7-b378-4155044a49ad admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:36.988566 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f30e320-8156-48b8-b62c-95c6cd23c536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:36.989741 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f30e320-8156-48b8-b62c-95c6cd23c536 admin admin] REQUEST_METHOD: `PUT` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:36.990151 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f30e320-8156-48b8-b62c-95c6cd23c536 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:36.992237 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f30e320-8156-48b8-b62c-95c6cd23c536 admin admin] PATH_INFO: `/v3/projects/869b414172dd4b4e9d9714c66649504d/users/02d127629ea242bdacf759fe8cd84e9c/roles/896bff49c5d6464eb612a15f4aa9badc` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:37.021011 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1082/2173] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 17:26:36 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:26:37.022806 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e73068d-6305-4ce7-b378-4155044a49ad admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:37.023107 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f30e320-8156-48b8-b62c-95c6cd23c536 admin admin] RBAC: Authorizing `identity:create_grant(project_id=869b414172dd4b4e9d9714c66649504d, user_id=02d127629ea242bdacf759fe8cd84e9c, role_id=896bff49c5d6464eb612a15f4aa9badc)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:37.027303 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f30e320-8156-48b8-b62c-95c6cd23c536 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:37.036489 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e73068d-6305-4ce7-b378-4155044a49ad admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:37.041865 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1450c3e2-b69e-483a-b233-03f1995865f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:37.042943 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1450c3e2-b69e-483a-b233-03f1995865f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:37.055392 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1450c3e2-b69e-483a-b233-03f1995865f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:37.055392 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1450c3e2-b69e-483a-b233-03f1995865f3 admin admin] PATH_INFO: `/v3/projects/ab6b0ff045a64f98af0bfefb7a81ac60/users/dd571fd2e9c94cce8350a1f0fc4abc95/roles/896bff49c5d6464eb612a15f4aa9badc` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:37.062694 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1450c3e2-b69e-483a-b233-03f1995865f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab6b0ff045a64f98af0bfefb7a81ac60, user_id=dd571fd2e9c94cce8350a1f0fc4abc95, role_id=896bff49c5d6464eb612a15f4aa9badc)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:37.065392 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1450c3e2-b69e-483a-b233-03f1995865f3 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:37.111431 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1092/2174] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 17:26:36 2022] PUT /identity/v3/projects/869b414172dd4b4e9d9714c66649504d/users/02d127629ea242bdacf759fe8cd84e9c/roles/896bff49c5d6464eb612a15f4aa9badc => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:26:37.125109 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a3d71a-61f3-40cf-8701-82f262144dbf None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:37.125109 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a3d71a-61f3-40cf-8701-82f262144dbf None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:37.125109 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a3d71a-61f3-40cf-8701-82f262144dbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:37.158970 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1083/2175] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 17:26:37 2022] PUT /identity/v3/projects/ab6b0ff045a64f98af0bfefb7a81ac60/users/dd571fd2e9c94cce8350a1f0fc4abc95/roles/896bff49c5d6464eb612a15f4aa9badc => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:26:37.170191 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50afe42c-fc21-4543-8231-9b8cf19ad1b6 None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:37.170670 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50afe42c-fc21-4543-8231-9b8cf19ad1b6 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:37.171112 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50afe42c-fc21-4543-8231-9b8cf19ad1b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:37.179368 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-20a3d71a-61f3-40cf-8701-82f262144dbf None None] MFA Rules not processed for user `02d127629ea242bdacf759fe8cd84e9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:26:37.179368 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-20a3d71a-61f3-40cf-8701-82f262144dbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:37.209454 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-50afe42c-fc21-4543-8231-9b8cf19ad1b6 None None] MFA Rules not processed for user `dd571fd2e9c94cce8350a1f0fc4abc95`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:26:37.210978 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-50afe42c-fc21-4543-8231-9b8cf19ad1b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:37.311243 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1093/2176] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:26:37 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 17:26:37.317975 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1084/2177] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:26:37 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:26:37.322134 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a3d71a-61f3-40cf-8701-82f262144dbf None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:37.328296 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50afe42c-fc21-4543-8231-9b8cf19ad1b6 None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:37.330361 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-50afe42c-fc21-4543-8231-9b8cf19ad1b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:37.409620 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a3d71a-61f3-40cf-8701-82f262144dbf None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:37.410376 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50afe42c-fc21-4543-8231-9b8cf19ad1b6 None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:37.416515 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16175c14-6eea-4ba1-815c-defc2d2bc22e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef37136b89d34edc9cd94c7aa81b2095', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:37.417296 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16175c14-6eea-4ba1-815c-defc2d2bc22e service cinder] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:37.417694 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16175c14-6eea-4ba1-815c-defc2d2bc22e service cinder] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:37.418108 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16175c14-6eea-4ba1-815c-defc2d2bc22e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:37.419954 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b802b1-d810-4225-a2df-e5dd2d84c61f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:37.422717 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b802b1-d810-4225-a2df-e5dd2d84c61f admin admin] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:37.423007 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b802b1-d810-4225-a2df-e5dd2d84c61f admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:37.424135 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b802b1-d810-4225-a2df-e5dd2d84c61f admin admin] PATH_INFO: `/v3/projects` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:37.424730 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b802b1-d810-4225-a2df-e5dd2d84c61f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:37.426882 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b802b1-d810-4225-a2df-e5dd2d84c61f admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:37.433629 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16175c14-6eea-4ba1-815c-defc2d2bc22e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:37.435203 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16175c14-6eea-4ba1-815c-defc2d2bc22e service cinder] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:37.444921 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1085/2178] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:26:37 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 17:26:37.506048 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16175c14-6eea-4ba1-815c-defc2d2bc22e service cinder] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:37.512829 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-16175c14-6eea-4ba1-815c-defc2d2bc22e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:37.527822 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16175c14-6eea-4ba1-815c-defc2d2bc22e service cinder] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:37.533438 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de06658-dad8-4b12-8094-0853a205fe33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:37.534548 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de06658-dad8-4b12-8094-0853a205fe33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:37.534931 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de06658-dad8-4b12-8094-0853a205fe33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:37.535347 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de06658-dad8-4b12-8094-0853a205fe33 admin admin] PATH_INFO: `/v3/projects/19c688179dc94b38b9c54b8c03dd7da9` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:37.537043 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de06658-dad8-4b12-8094-0853a205fe33 admin admin] RBAC: Authorizing `identity:delete_project(project_id=19c688179dc94b38b9c54b8c03dd7da9)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:37.539312 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de06658-dad8-4b12-8094-0853a205fe33 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:37.582165 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1094/2179] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 16 17:26:37 2022] POST /identity/v3/projects => generated 383 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:26:37.585929 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b802b1-d810-4225-a2df-e5dd2d84c61f admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:37.592089 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-38b802b1-d810-4225-a2df-e5dd2d84c61f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:37.665033 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b802b1-d810-4225-a2df-e5dd2d84c61f admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:37.671075 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-3de06658-dad8-4b12-8094-0853a205fe33 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19c688179dc94b38b9c54b8c03dd7da9', 'request_id': 'req-3de06658-dad8-4b12-8094-0853a205fe33'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:37.676938 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-3de06658-dad8-4b12-8094-0853a205fe33 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19c688179dc94b38b9c54b8c03dd7da9', 'request_id': 'req-3de06658-dad8-4b12-8094-0853a205fe33'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:37.721946 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab0256a-6657-48b9-bbb4-e18deebce53d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:37.722800 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab0256a-6657-48b9-bbb4-e18deebce53d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:37.723083 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab0256a-6657-48b9-bbb4-e18deebce53d admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:37.723361 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab0256a-6657-48b9-bbb4-e18deebce53d admin admin] PATH_INFO: `/v3/projects/1a6c7786df004232aa9d78f818932256` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:37.724556 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab0256a-6657-48b9-bbb4-e18deebce53d admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a6c7786df004232aa9d78f818932256)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:37.726511 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab0256a-6657-48b9-bbb4-e18deebce53d admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:37.763134 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-3de06658-dad8-4b12-8094-0853a205fe33 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19c688179dc94b38b9c54b8c03dd7da9', 'request_id': 'req-3de06658-dad8-4b12-8094-0853a205fe33'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:37.775607 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-3de06658-dad8-4b12-8094-0853a205fe33 admin admin] The token cache is being invalidate because project 19c688179dc94b38b9c54b8c03dd7da9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80874) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 17:26:37.775959 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-3de06658-dad8-4b12-8094-0853a205fe33 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:37.776638 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-3de06658-dad8-4b12-8094-0853a205fe33 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:37.778243 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1086/2180] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 16 17:26:37 2022] DELETE /identity/v3/projects/19c688179dc94b38b9c54b8c03dd7da9 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 17:26:37.779098 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de06658-dad8-4b12-8094-0853a205fe33 admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:37.780514 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-3de06658-dad8-4b12-8094-0853a205fe33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:37.796329 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de06658-dad8-4b12-8094-0853a205fe33 admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:37.801142 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff711ea-8afd-4705-bfe8-86e8dc52a102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:37.801838 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff711ea-8afd-4705-bfe8-86e8dc52a102 admin admin] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:37.802133 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff711ea-8afd-4705-bfe8-86e8dc52a102 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:37.802896 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff711ea-8afd-4705-bfe8-86e8dc52a102 admin admin] PATH_INFO: `/v3/users` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:37.803654 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff711ea-8afd-4705-bfe8-86e8dc52a102 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:37.805578 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff711ea-8afd-4705-bfe8-86e8dc52a102 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:37.915406 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-aab0256a-6657-48b9-bbb4-e18deebce53d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a6c7786df004232aa9d78f818932256', 'request_id': 'req-aab0256a-6657-48b9-bbb4-e18deebce53d'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:37.923012 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-aab0256a-6657-48b9-bbb4-e18deebce53d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a6c7786df004232aa9d78f818932256', 'request_id': 'req-aab0256a-6657-48b9-bbb4-e18deebce53d'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:37.929103 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-aab0256a-6657-48b9-bbb4-e18deebce53d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a6c7786df004232aa9d78f818932256', 'request_id': 'req-aab0256a-6657-48b9-bbb4-e18deebce53d'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:37.965156 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1087/2181] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 16 17:26:37 2022] POST /identity/v3/users => generated 298 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:26:37.966931 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1136edee-ea17-48ae-8ba9-1b3abc21d2e0 None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:37.967230 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1136edee-ea17-48ae-8ba9-1b3abc21d2e0 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:37.967516 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1136edee-ea17-48ae-8ba9-1b3abc21d2e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:37.988775 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-1136edee-ea17-48ae-8ba9-1b3abc21d2e0 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:26:37.990027 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-1136edee-ea17-48ae-8ba9-1b3abc21d2e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:38.053263 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1088/2182] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:26:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:26:38.054073 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1136edee-ea17-48ae-8ba9-1b3abc21d2e0 None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:38.064430 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1136edee-ea17-48ae-8ba9-1b3abc21d2e0 None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:38.065372 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-aab0256a-6657-48b9-bbb4-e18deebce53d admin admin] The token cache is being invalidate because project 1a6c7786df004232aa9d78f818932256 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80873) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 17:26:38.065793 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-aab0256a-6657-48b9-bbb4-e18deebce53d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:38.066631 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-aab0256a-6657-48b9-bbb4-e18deebce53d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:38.069000 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1095/2183] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 16 17:26:37 2022] DELETE /identity/v3/projects/1a6c7786df004232aa9d78f818932256 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:26:38.069624 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7dccc4-fb73-4f3a-b9c3-668d1363a138 None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:38.070290 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f622291c-fffa-476e-8e7e-43180301748b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:38.070459 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7dccc4-fb73-4f3a-b9c3-668d1363a138 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:38.070459 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7dccc4-fb73-4f3a-b9c3-668d1363a138 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:38.071246 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f622291c-fffa-476e-8e7e-43180301748b admin admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:38.071246 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f622291c-fffa-476e-8e7e-43180301748b admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:38.071649 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f622291c-fffa-476e-8e7e-43180301748b admin admin] PATH_INFO: `/v3/roles` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:38.072519 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f622291c-fffa-476e-8e7e-43180301748b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:38.074593 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f622291c-fffa-476e-8e7e-43180301748b admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:38.086669 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1089/2184] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 17:26:38 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:26:38.088731 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727c2259-0962-4f2f-a3d7-089900e2b762 None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:38.089018 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727c2259-0962-4f2f-a3d7-089900e2b762 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:38.089303 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727c2259-0962-4f2f-a3d7-089900e2b762 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:38.106384 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-fe7dccc4-fb73-4f3a-b9c3-668d1363a138 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:26:38.106384 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-fe7dccc4-fb73-4f3a-b9c3-668d1363a138 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:38.115992 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1096/2185] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:26:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:26:38.120375 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7dccc4-fb73-4f3a-b9c3-668d1363a138 None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:38.121750 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-fe7dccc4-fb73-4f3a-b9c3-668d1363a138 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:38.126062 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-727c2259-0962-4f2f-a3d7-089900e2b762 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:26:38.129988 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-727c2259-0962-4f2f-a3d7-089900e2b762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:38.136150 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7dccc4-fb73-4f3a-b9c3-668d1363a138 None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:38.141544 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1090/2186] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:26:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:26:38.142671 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727c2259-0962-4f2f-a3d7-089900e2b762 None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:38.150252 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f602cec8-78e1-4ef0-953a-a53482c03bf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:38.151849 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f602cec8-78e1-4ef0-953a-a53482c03bf7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:38.152136 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f602cec8-78e1-4ef0-953a-a53482c03bf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:38.155511 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f602cec8-78e1-4ef0-953a-a53482c03bf7 admin admin] PATH_INFO: `/v3/projects/930640de49154968a4ae0f2f97bf76dd/users/683da3ddf95741e49520a4da0816a832/roles/dba744f8ab2a4c45b9d3212f8d203aba` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:38.157172 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727c2259-0962-4f2f-a3d7-089900e2b762 None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:38.163339 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5902a6-8ef7-4d3f-8d4d-dde40e32587a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:38.164992 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5902a6-8ef7-4d3f-8d4d-dde40e32587a admin admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:38.164992 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5902a6-8ef7-4d3f-8d4d-dde40e32587a admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:38.165311 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5902a6-8ef7-4d3f-8d4d-dde40e32587a admin admin] PATH_INFO: `/v3/domains` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:38.167923 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5902a6-8ef7-4d3f-8d4d-dde40e32587a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:26:38.168178 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5902a6-8ef7-4d3f-8d4d-dde40e32587a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:38.170558 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5902a6-8ef7-4d3f-8d4d-dde40e32587a admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:38.188239 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1091/2187] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 16 17:26:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:26:38.190149 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a49f5ea-6f52-410a-8188-3efd111765b2 None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:38.190862 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a49f5ea-6f52-410a-8188-3efd111765b2 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:38.193525 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a49f5ea-6f52-410a-8188-3efd111765b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:38.194400 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f602cec8-78e1-4ef0-953a-a53482c03bf7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=930640de49154968a4ae0f2f97bf76dd, user_id=683da3ddf95741e49520a4da0816a832, role_id=dba744f8ab2a4c45b9d3212f8d203aba)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:38.198924 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f602cec8-78e1-4ef0-953a-a53482c03bf7 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:38.219263 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-7a49f5ea-6f52-410a-8188-3efd111765b2 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:26:38.219263 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-7a49f5ea-6f52-410a-8188-3efd111765b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:38.226194 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1092/2188] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:26:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:26:38.227185 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a49f5ea-6f52-410a-8188-3efd111765b2 None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:38.245533 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a49f5ea-6f52-410a-8188-3efd111765b2 None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:38.251560 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b36044d-b8bd-406d-9bce-86ae7382f393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:38.252625 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b36044d-b8bd-406d-9bce-86ae7382f393 admin admin] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:38.252625 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b36044d-b8bd-406d-9bce-86ae7382f393 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:38.252625 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b36044d-b8bd-406d-9bce-86ae7382f393 admin admin] PATH_INFO: `/v3/projects` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:38.253452 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b36044d-b8bd-406d-9bce-86ae7382f393 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:38.255550 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b36044d-b8bd-406d-9bce-86ae7382f393 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:38.334769 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1097/2189] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 17:26:38 2022] PUT /identity/v3/projects/930640de49154968a4ae0f2f97bf76dd/users/683da3ddf95741e49520a4da0816a832/roles/dba744f8ab2a4c45b9d3212f8d203aba => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:26:38.334769 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f602cec8-78e1-4ef0-953a-a53482c03bf7 admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:38.364889 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1093/2190] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 16 17:26:38 2022] POST /identity/v3/projects => generated 365 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:26:38.364889 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b36044d-b8bd-406d-9bce-86ae7382f393 admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:38.432060 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:26:38.451552 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f602cec8-78e1-4ef0-953a-a53482c03bf7 admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:38.456322 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b36044d-b8bd-406d-9bce-86ae7382f393 admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:38.458818 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c5ad99-f7c2-48cb-88d9-4250de78ea01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:38.459887 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c5ad99-f7c2-48cb-88d9-4250de78ea01 admin admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:38.460471 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c5ad99-f7c2-48cb-88d9-4250de78ea01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:38.460756 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c5ad99-f7c2-48cb-88d9-4250de78ea01 admin admin] PATH_INFO: `/v3/domains` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:38.461501 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c5ad99-f7c2-48cb-88d9-4250de78ea01 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80873) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:26:38.461854 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c5ad99-f7c2-48cb-88d9-4250de78ea01 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:38.462860 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bceb358-8cfb-425c-a0bd-d82a1111acec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:38.464101 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c5ad99-f7c2-48cb-88d9-4250de78ea01 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:38.464740 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bceb358-8cfb-425c-a0bd-d82a1111acec admin admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:38.465387 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bceb358-8cfb-425c-a0bd-d82a1111acec admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:38.465961 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bceb358-8cfb-425c-a0bd-d82a1111acec admin admin] PATH_INFO: `/v3/roles` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:38.466910 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bceb358-8cfb-425c-a0bd-d82a1111acec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:38.469039 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bceb358-8cfb-425c-a0bd-d82a1111acec admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:38.482581 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1098/2191] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 16 17:26:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:26:38.482581 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c5ad99-f7c2-48cb-88d9-4250de78ea01 admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:38.488735 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:26:38.490350 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1094/2192] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 17:26:38 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:26:38.491381 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bceb358-8cfb-425c-a0bd-d82a1111acec admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:38.497497 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c5ad99-f7c2-48cb-88d9-4250de78ea01 admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:38.501878 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bceb358-8cfb-425c-a0bd-d82a1111acec admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:38.504366 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870a6371-91cd-4b03-a6d5-98fd1ef005eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:38.505036 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870a6371-91cd-4b03-a6d5-98fd1ef005eb admin admin] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:38.505481 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870a6371-91cd-4b03-a6d5-98fd1ef005eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:38.505935 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870a6371-91cd-4b03-a6d5-98fd1ef005eb admin admin] PATH_INFO: `/v3/users` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:38.506641 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870a6371-91cd-4b03-a6d5-98fd1ef005eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:38.507547 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc221596-4689-4410-a744-1edfa8ad0ba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:38.508311 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc221596-4689-4410-a744-1edfa8ad0ba8 admin admin] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:38.508669 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc221596-4689-4410-a744-1edfa8ad0ba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:38.509019 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc221596-4689-4410-a744-1edfa8ad0ba8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:38.509537 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870a6371-91cd-4b03-a6d5-98fd1ef005eb admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:38.509889 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc221596-4689-4410-a744-1edfa8ad0ba8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:38.512605 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc221596-4689-4410-a744-1edfa8ad0ba8 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:38.591652 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1099/2193] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 16 17:26:38 2022] POST /identity/v3/users => generated 283 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:26:38.592459 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870a6371-91cd-4b03-a6d5-98fd1ef005eb admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:38.602460 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870a6371-91cd-4b03-a6d5-98fd1ef005eb admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:38.607222 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba212223-bc0b-41a1-8846-ae82bf05266f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:38.608143 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba212223-bc0b-41a1-8846-ae82bf05266f admin admin] REQUEST_METHOD: `PUT` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:38.608399 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba212223-bc0b-41a1-8846-ae82bf05266f admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:38.608680 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba212223-bc0b-41a1-8846-ae82bf05266f admin admin] PATH_INFO: `/v3/projects/930640de49154968a4ae0f2f97bf76dd/users/683da3ddf95741e49520a4da0816a832/roles/dba744f8ab2a4c45b9d3212f8d203aba` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:38.610958 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba212223-bc0b-41a1-8846-ae82bf05266f admin admin] RBAC: Authorizing `identity:create_grant(project_id=930640de49154968a4ae0f2f97bf76dd, user_id=683da3ddf95741e49520a4da0816a832, role_id=dba744f8ab2a4c45b9d3212f8d203aba)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:38.613691 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba212223-bc0b-41a1-8846-ae82bf05266f admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:38.619712 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1095/2194] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 16 17:26:38 2022] POST /identity/v3/projects => generated 365 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:26:38.620987 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc221596-4689-4410-a744-1edfa8ad0ba8 admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:38.627154 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1100/2195] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 17:26:38 2022] PUT /identity/v3/projects/930640de49154968a4ae0f2f97bf76dd/users/683da3ddf95741e49520a4da0816a832/roles/dba744f8ab2a4c45b9d3212f8d203aba => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:26:38.627597 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba212223-bc0b-41a1-8846-ae82bf05266f admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:38.692336 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba212223-bc0b-41a1-8846-ae82bf05266f admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:38.699076 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0403c61b-4de0-4bc1-a6f1-9d965c900c5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:38.700185 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0403c61b-4de0-4bc1-a6f1-9d965c900c5d admin admin] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:38.700475 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0403c61b-4de0-4bc1-a6f1-9d965c900c5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:38.700766 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0403c61b-4de0-4bc1-a6f1-9d965c900c5d admin admin] PATH_INFO: `/v3/users` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:38.700878 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc221596-4689-4410-a744-1edfa8ad0ba8 admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:38.701465 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0403c61b-4de0-4bc1-a6f1-9d965c900c5d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:38.703428 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0403c61b-4de0-4bc1-a6f1-9d965c900c5d admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:38.708025 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ff2f3e-59ba-46c1-b351-8d7e7cc7b166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:38.708758 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ff2f3e-59ba-46c1-b351-8d7e7cc7b166 admin admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:38.709384 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ff2f3e-59ba-46c1-b351-8d7e7cc7b166 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:38.709717 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ff2f3e-59ba-46c1-b351-8d7e7cc7b166 admin admin] PATH_INFO: `/v3/roles` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:38.710483 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ff2f3e-59ba-46c1-b351-8d7e7cc7b166 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:38.712089 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ff2f3e-59ba-46c1-b351-8d7e7cc7b166 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:38.724191 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1096/2196] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 17:26:38 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:26:38.725296 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b946716c-5740-4b18-935f-255b353480b4 None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:38.725597 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b946716c-5740-4b18-935f-255b353480b4 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:38.725909 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b946716c-5740-4b18-935f-255b353480b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:38.752402 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-b946716c-5740-4b18-935f-255b353480b4 None None] MFA Rules not processed for user `683da3ddf95741e49520a4da0816a832`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:26:38.753611 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-b946716c-5740-4b18-935f-255b353480b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:38.795556 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1101/2197] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 16 17:26:38 2022] POST /identity/v3/users => generated 283 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:26:38.796641 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0403c61b-4de0-4bc1-a6f1-9d965c900c5d admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:38.806679 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0403c61b-4de0-4bc1-a6f1-9d965c900c5d admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:38.811836 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43abe6fb-b4b3-4500-9bb2-0348f60e26ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:38.812645 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43abe6fb-b4b3-4500-9bb2-0348f60e26ec admin admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:38.812940 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43abe6fb-b4b3-4500-9bb2-0348f60e26ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:38.813407 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43abe6fb-b4b3-4500-9bb2-0348f60e26ec admin admin] PATH_INFO: `/v3/roles` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:38.813991 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43abe6fb-b4b3-4500-9bb2-0348f60e26ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:38.815592 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43abe6fb-b4b3-4500-9bb2-0348f60e26ec admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:38.826214 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1097/2198] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:26:38 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:26:38.826214 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b946716c-5740-4b18-935f-255b353480b4 None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:38.833483 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1102/2199] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 17:26:38 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:26:38.834756 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43abe6fb-b4b3-4500-9bb2-0348f60e26ec admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:38.840605 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b946716c-5740-4b18-935f-255b353480b4 None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:38.845725 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6547bc1d-018d-4cc8-b44e-332bf2d3a2a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:38.846449 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43abe6fb-b4b3-4500-9bb2-0348f60e26ec admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:38.846571 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6547bc1d-018d-4cc8-b44e-332bf2d3a2a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:38.846764 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6547bc1d-018d-4cc8-b44e-332bf2d3a2a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:38.847065 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6547bc1d-018d-4cc8-b44e-332bf2d3a2a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:38.847952 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6547bc1d-018d-4cc8-b44e-332bf2d3a2a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:38.849558 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6547bc1d-018d-4cc8-b44e-332bf2d3a2a7 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:38.851195 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0ff6e6-a5fc-4290-9cbf-92f368ec2508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:38.852118 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0ff6e6-a5fc-4290-9cbf-92f368ec2508 admin admin] REQUEST_METHOD: `PUT` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:38.852371 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0ff6e6-a5fc-4290-9cbf-92f368ec2508 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:38.855666 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0ff6e6-a5fc-4290-9cbf-92f368ec2508 admin admin] PATH_INFO: `/v3/projects/45b77585c8e64eb9b6659393742a5b82/users/c965234a5efc44cb89b8990935f0287f/roles/896bff49c5d6464eb612a15f4aa9badc` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:38.864934 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1098/2200] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 17:26:38 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:26:38.865793 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6547bc1d-018d-4cc8-b44e-332bf2d3a2a7 admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:38.867817 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-6547bc1d-018d-4cc8-b44e-332bf2d3a2a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:38.871252 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0ff6e6-a5fc-4290-9cbf-92f368ec2508 admin admin] RBAC: Authorizing `identity:create_grant(project_id=45b77585c8e64eb9b6659393742a5b82, user_id=c965234a5efc44cb89b8990935f0287f, role_id=896bff49c5d6464eb612a15f4aa9badc)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:38.874115 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0ff6e6-a5fc-4290-9cbf-92f368ec2508 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:38.926424 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6547bc1d-018d-4cc8-b44e-332bf2d3a2a7 admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:38.930142 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21aeef1a-f6f7-4ced-b957-2242700fc554 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef37136b89d34edc9cd94c7aa81b2095', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:38.930850 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aeef1a-f6f7-4ced-b957-2242700fc554 service cinder] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:38.931143 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aeef1a-f6f7-4ced-b957-2242700fc554 service cinder] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:38.931426 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aeef1a-f6f7-4ced-b957-2242700fc554 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:38.943101 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21aeef1a-f6f7-4ced-b957-2242700fc554 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:38.944881 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21aeef1a-f6f7-4ced-b957-2242700fc554 service cinder] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:38.956403 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1099/2201] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:26:38 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:26:38.957249 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21aeef1a-f6f7-4ced-b957-2242700fc554 service cinder] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:38.978724 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21aeef1a-f6f7-4ced-b957-2242700fc554 service cinder] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:38.991163 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1cb8e8-4367-4253-9299-35211fd6bba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:38.992044 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1cb8e8-4367-4253-9299-35211fd6bba0 admin admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:38.992334 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1cb8e8-4367-4253-9299-35211fd6bba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:38.992620 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1cb8e8-4367-4253-9299-35211fd6bba0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:38.993385 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1cb8e8-4367-4253-9299-35211fd6bba0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:38.995625 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1cb8e8-4367-4253-9299-35211fd6bba0 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:38.999425 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1103/2202] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 17:26:38 2022] PUT /identity/v3/projects/45b77585c8e64eb9b6659393742a5b82/users/c965234a5efc44cb89b8990935f0287f/roles/896bff49c5d6464eb612a15f4aa9badc => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 17:26:39.008473 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1100/2203] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 17:26:38 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:26:39.014321 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0ff6e6-a5fc-4290-9cbf-92f368ec2508 admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:39.016408 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadfb597-3413-44fc-9ba7-38c08bdaf12f None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:39.017907 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadfb597-3413-44fc-9ba7-38c08bdaf12f None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:39.017907 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadfb597-3413-44fc-9ba7-38c08bdaf12f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:39.049537 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-aadfb597-3413-44fc-9ba7-38c08bdaf12f None None] MFA Rules not processed for user `c965234a5efc44cb89b8990935f0287f`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:26:39.050820 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-aadfb597-3413-44fc-9ba7-38c08bdaf12f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:39.088223 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:26:39.094681 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0ff6e6-a5fc-4290-9cbf-92f368ec2508 admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:39.100967 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bbb113-039b-4c91-b5ad-6be6b791b57b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:39.102143 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bbb113-039b-4c91-b5ad-6be6b791b57b admin admin] REQUEST_METHOD: `PUT` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:39.102435 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bbb113-039b-4c91-b5ad-6be6b791b57b admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:39.102875 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bbb113-039b-4c91-b5ad-6be6b791b57b admin admin] PATH_INFO: `/v3/projects/e22dd4c8816a45918e70cbfa916728ea/users/0a2ca5d5699b481aa3b0274f74195aca/roles/896bff49c5d6464eb612a15f4aa9badc` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:39.124262 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bbb113-039b-4c91-b5ad-6be6b791b57b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e22dd4c8816a45918e70cbfa916728ea, user_id=0a2ca5d5699b481aa3b0274f74195aca, role_id=896bff49c5d6464eb612a15f4aa9badc)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:39.127307 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1101/2204] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:26:39 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:26:39.127590 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bbb113-039b-4c91-b5ad-6be6b791b57b admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:39.138095 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadfb597-3413-44fc-9ba7-38c08bdaf12f None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:39.139617 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-aadfb597-3413-44fc-9ba7-38c08bdaf12f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:39.206535 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadfb597-3413-44fc-9ba7-38c08bdaf12f None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:39.210486 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13dabdd-9a55-401e-bf38-196938d111b5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef37136b89d34edc9cd94c7aa81b2095', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:39.211087 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13dabdd-9a55-401e-bf38-196938d111b5 service cinder] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:39.211374 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13dabdd-9a55-401e-bf38-196938d111b5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:39.211700 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13dabdd-9a55-401e-bf38-196938d111b5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:39.223952 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13dabdd-9a55-401e-bf38-196938d111b5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:39.225395 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13dabdd-9a55-401e-bf38-196938d111b5 service cinder] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:39.225811 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1104/2205] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 17:26:39 2022] PUT /identity/v3/projects/e22dd4c8816a45918e70cbfa916728ea/users/0a2ca5d5699b481aa3b0274f74195aca/roles/896bff49c5d6464eb612a15f4aa9badc => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:26:39.226677 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bbb113-039b-4c91-b5ad-6be6b791b57b admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:39.240420 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1102/2206] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:26:39 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 17:26:39.241631 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415a9ce4-c36c-4d46-a72a-ce8134ca524a None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:39.241970 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415a9ce4-c36c-4d46-a72a-ce8134ca524a None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:39.242255 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415a9ce4-c36c-4d46-a72a-ce8134ca524a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:39.274939 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-415a9ce4-c36c-4d46-a72a-ce8134ca524a None None] MFA Rules not processed for user `0a2ca5d5699b481aa3b0274f74195aca`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:26:39.276757 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-415a9ce4-c36c-4d46-a72a-ce8134ca524a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:39.300179 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bbb113-039b-4c91-b5ad-6be6b791b57b admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:39.306815 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bafb631-573a-4d1f-a2eb-25f880542c59 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef37136b89d34edc9cd94c7aa81b2095', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:39.309909 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bafb631-573a-4d1f-a2eb-25f880542c59 service cinder] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:39.309909 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bafb631-573a-4d1f-a2eb-25f880542c59 service cinder] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:39.309909 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bafb631-573a-4d1f-a2eb-25f880542c59 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:39.313183 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-8bafb631-573a-4d1f-a2eb-25f880542c59 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:39.357874 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1103/2207] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:26:39 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:26:39.362181 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415a9ce4-c36c-4d46-a72a-ce8134ca524a None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:39.396687 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bafb631-573a-4d1f-a2eb-25f880542c59 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:39.399274 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bafb631-573a-4d1f-a2eb-25f880542c59 service cinder] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:39.417150 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1105/2208] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:26:39 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:26:39.440277 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415a9ce4-c36c-4d46-a72a-ce8134ca524a None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:39.445424 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbfc808-3673-47c2-9685-8881b0a76842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:39.446280 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbfc808-3673-47c2-9685-8881b0a76842 admin admin] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:39.446471 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbfc808-3673-47c2-9685-8881b0a76842 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:39.446759 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbfc808-3673-47c2-9685-8881b0a76842 admin admin] PATH_INFO: `/v3/projects` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:39.448258 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbfc808-3673-47c2-9685-8881b0a76842 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:39.450548 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbfc808-3673-47c2-9685-8881b0a76842 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:39.566942 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1104/2209] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 16 17:26:39 2022] POST /identity/v3/projects => generated 367 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 17:26:39.567790 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bafb631-573a-4d1f-a2eb-25f880542c59 service cinder] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:39.581006 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bafb631-573a-4d1f-a2eb-25f880542c59 service cinder] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:39.642041 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e93bc40-5d31-49e0-ad55-24e656deeb4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:39.642808 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e93bc40-5d31-49e0-ad55-24e656deeb4a admin admin] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:39.643163 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e93bc40-5d31-49e0-ad55-24e656deeb4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:39.643509 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e93bc40-5d31-49e0-ad55-24e656deeb4a admin admin] PATH_INFO: `/v3/users` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:39.644276 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e93bc40-5d31-49e0-ad55-24e656deeb4a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:39.646222 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e93bc40-5d31-49e0-ad55-24e656deeb4a admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:39.751820 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1106/2210] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 16 17:26:39 2022] POST /identity/v3/users => generated 290 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:26:39.755710 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbfc808-3673-47c2-9685-8881b0a76842 admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:39.769398 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbfc808-3673-47c2-9685-8881b0a76842 admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:39.776427 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adb7093-f311-4d59-9b93-4cf3d59332c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:39.777586 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adb7093-f311-4d59-9b93-4cf3d59332c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:39.778077 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adb7093-f311-4d59-9b93-4cf3d59332c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:39.778440 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adb7093-f311-4d59-9b93-4cf3d59332c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:39.779236 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adb7093-f311-4d59-9b93-4cf3d59332c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:39.780934 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adb7093-f311-4d59-9b93-4cf3d59332c7 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:39.794183 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1105/2211] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 17:26:39 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:26:39.798503 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e93bc40-5d31-49e0-ad55-24e656deeb4a admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:39.809132 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e93bc40-5d31-49e0-ad55-24e656deeb4a admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:39.814143 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d525bc45-addc-4df3-a9d8-66afc73fdd9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:39.815059 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d525bc45-addc-4df3-a9d8-66afc73fdd9f admin admin] REQUEST_METHOD: `PUT` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:39.815350 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d525bc45-addc-4df3-a9d8-66afc73fdd9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:39.815632 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d525bc45-addc-4df3-a9d8-66afc73fdd9f admin admin] PATH_INFO: `/v3/projects/17a0856ef6f742868310badf743ae2fa/users/ac584e7766b640a597b668ce6695989a/roles/dba744f8ab2a4c45b9d3212f8d203aba` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:39.830973 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d525bc45-addc-4df3-a9d8-66afc73fdd9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=17a0856ef6f742868310badf743ae2fa, user_id=ac584e7766b640a597b668ce6695989a, role_id=dba744f8ab2a4c45b9d3212f8d203aba)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:39.833709 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d525bc45-addc-4df3-a9d8-66afc73fdd9f admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:39.900218 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1107/2212] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 17:26:39 2022] PUT /identity/v3/projects/17a0856ef6f742868310badf743ae2fa/users/ac584e7766b640a597b668ce6695989a/roles/dba744f8ab2a4c45b9d3212f8d203aba => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:26:39.904326 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adb7093-f311-4d59-9b93-4cf3d59332c7 admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:39.914447 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adb7093-f311-4d59-9b93-4cf3d59332c7 admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:39.971533 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06118f77-d0c2-46a3-8b81-8bd2434deb73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:39.972297 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06118f77-d0c2-46a3-8b81-8bd2434deb73 admin admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:39.972493 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06118f77-d0c2-46a3-8b81-8bd2434deb73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:39.972779 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06118f77-d0c2-46a3-8b81-8bd2434deb73 admin admin] PATH_INFO: `/v3/roles` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:39.973555 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06118f77-d0c2-46a3-8b81-8bd2434deb73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:39.975206 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06118f77-d0c2-46a3-8b81-8bd2434deb73 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:39.987772 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1106/2213] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 17:26:39 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:26:39.991233 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d525bc45-addc-4df3-a9d8-66afc73fdd9f admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:40.003260 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d525bc45-addc-4df3-a9d8-66afc73fdd9f admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:40.008360 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d24935-d8a8-4eae-ba52-891a1df71e83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:40.009262 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d24935-d8a8-4eae-ba52-891a1df71e83 admin admin] REQUEST_METHOD: `PUT` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:40.009549 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d24935-d8a8-4eae-ba52-891a1df71e83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:40.009880 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d24935-d8a8-4eae-ba52-891a1df71e83 admin admin] PATH_INFO: `/v3/projects/17a0856ef6f742868310badf743ae2fa/users/ac584e7766b640a597b668ce6695989a/roles/dba744f8ab2a4c45b9d3212f8d203aba` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:40.016118 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d24935-d8a8-4eae-ba52-891a1df71e83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=17a0856ef6f742868310badf743ae2fa, user_id=ac584e7766b640a597b668ce6695989a, role_id=dba744f8ab2a4c45b9d3212f8d203aba)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:40.018742 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d24935-d8a8-4eae-ba52-891a1df71e83 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:40.029431 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1108/2214] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 17:26:39 2022] PUT /identity/v3/projects/17a0856ef6f742868310badf743ae2fa/users/ac584e7766b640a597b668ce6695989a/roles/dba744f8ab2a4c45b9d3212f8d203aba => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:26:40.039991 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7294e26d-38ab-457b-9ebb-a5a7fa0cc48e None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:40.040365 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7294e26d-38ab-457b-9ebb-a5a7fa0cc48e None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:40.040616 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7294e26d-38ab-457b-9ebb-a5a7fa0cc48e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:40.079814 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-7294e26d-38ab-457b-9ebb-a5a7fa0cc48e None None] MFA Rules not processed for user `ac584e7766b640a597b668ce6695989a`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:26:40.081121 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-7294e26d-38ab-457b-9ebb-a5a7fa0cc48e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:40.185316 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1107/2215] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:26:40 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:26:40.362063 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d24935-d8a8-4eae-ba52-891a1df71e83 admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:40.438989 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d24935-d8a8-4eae-ba52-891a1df71e83 admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:40.442785 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b582386-e243-423e-95ca-ca66f5731bf0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef37136b89d34edc9cd94c7aa81b2095', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:40.443463 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b582386-e243-423e-95ca-ca66f5731bf0 service cinder] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:40.443637 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b582386-e243-423e-95ca-ca66f5731bf0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:40.443916 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b582386-e243-423e-95ca-ca66f5731bf0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:40.454360 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b582386-e243-423e-95ca-ca66f5731bf0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:40.455799 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b582386-e243-423e-95ca-ca66f5731bf0 service cinder] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:40.466095 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1109/2216] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:26:40 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:26:40.954321 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7294e26d-38ab-457b-9ebb-a5a7fa0cc48e None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:40.957184 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b582386-e243-423e-95ca-ca66f5731bf0 service cinder] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:40.966010 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b582386-e243-423e-95ca-ca66f5731bf0 service cinder] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:40.969911 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66c38c4-5f36-43ed-b0a0-4f0e666c1020 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef37136b89d34edc9cd94c7aa81b2095', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:40.970562 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66c38c4-5f36-43ed-b0a0-4f0e666c1020 service cinder] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:40.970851 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66c38c4-5f36-43ed-b0a0-4f0e666c1020 service cinder] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:40.971130 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66c38c4-5f36-43ed-b0a0-4f0e666c1020 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:41.030247 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7294e26d-38ab-457b-9ebb-a5a7fa0cc48e None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:41.036795 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13cfbba-9203-4576-95b4-6e420dbbaac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:41.037728 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13cfbba-9203-4576-95b4-6e420dbbaac6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:41.038048 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13cfbba-9203-4576-95b4-6e420dbbaac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:41.038659 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13cfbba-9203-4576-95b4-6e420dbbaac6 admin admin] PATH_INFO: `/v3/users/dd571fd2e9c94cce8350a1f0fc4abc95` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:41.040231 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66c38c4-5f36-43ed-b0a0-4f0e666c1020 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:41.041995 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66c38c4-5f36-43ed-b0a0-4f0e666c1020 service cinder] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:41.043149 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13cfbba-9203-4576-95b4-6e420dbbaac6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd571fd2e9c94cce8350a1f0fc4abc95)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:41.045246 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13cfbba-9203-4576-95b4-6e420dbbaac6 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:41.054346 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1110/2217] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:26:40 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 17:26:41.073495 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:26:41.278991 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-b13cfbba-9203-4576-95b4-6e420dbbaac6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd571fd2e9c94cce8350a1f0fc4abc95'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:41.286528 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-b13cfbba-9203-4576-95b4-6e420dbbaac6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd571fd2e9c94cce8350a1f0fc4abc95'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:41.401924 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-b13cfbba-9203-4576-95b4-6e420dbbaac6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd571fd2e9c94cce8350a1f0fc4abc95'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:41.402771 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-b13cfbba-9203-4576-95b4-6e420dbbaac6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd571fd2e9c94cce8350a1f0fc4abc95'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:41.423732 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-b13cfbba-9203-4576-95b4-6e420dbbaac6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd571fd2e9c94cce8350a1f0fc4abc95'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:41.435529 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1108/2218] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 16 17:26:40 2022] DELETE /identity/v3/users/dd571fd2e9c94cce8350a1f0fc4abc95 => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:26:41.440176 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1156f0-f85f-4545-a4ce-394f8692ea6e None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:41.440404 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1156f0-f85f-4545-a4ce-394f8692ea6e None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:41.440719 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1156f0-f85f-4545-a4ce-394f8692ea6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:41.459298 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-7a1156f0-f85f-4545-a4ce-394f8692ea6e None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:26:41.464937 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-7a1156f0-f85f-4545-a4ce-394f8692ea6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:41.522357 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1111/2219] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:26:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:26:41.536808 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13cfbba-9203-4576-95b4-6e420dbbaac6 admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:41.536808 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-b13cfbba-9203-4576-95b4-6e420dbbaac6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:41.594605 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13cfbba-9203-4576-95b4-6e420dbbaac6 admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:41.598587 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4976ae-397d-44d8-bd44-6426a21feb43 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5d25bfa8dc042329d57cd55fa7b7b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:41.599242 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4976ae-397d-44d8-bd44-6426a21feb43 service neutron] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:41.599530 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4976ae-397d-44d8-bd44-6426a21feb43 service neutron] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:41.599812 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4976ae-397d-44d8-bd44-6426a21feb43 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:41.610071 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4976ae-397d-44d8-bd44-6426a21feb43 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:41.611500 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4976ae-397d-44d8-bd44-6426a21feb43 service neutron] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:41.622871 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1109/2220] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:26:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:26:41.664777 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:26:42.178383 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1156f0-f85f-4545-a4ce-394f8692ea6e None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:42.180643 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-7a1156f0-f85f-4545-a4ce-394f8692ea6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:42.195344 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1156f0-f85f-4545-a4ce-394f8692ea6e None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:42.201162 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b953928e-4386-491a-857d-3565a3e924fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:42.205071 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b953928e-4386-491a-857d-3565a3e924fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:42.205674 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b953928e-4386-491a-857d-3565a3e924fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:42.206128 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b953928e-4386-491a-857d-3565a3e924fd admin admin] PATH_INFO: `/v3/projects/ab6b0ff045a64f98af0bfefb7a81ac60` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:42.207695 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b953928e-4386-491a-857d-3565a3e924fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab6b0ff045a64f98af0bfefb7a81ac60)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:42.213684 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b953928e-4386-491a-857d-3565a3e924fd admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:42.335820 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-b953928e-4386-491a-857d-3565a3e924fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab6b0ff045a64f98af0bfefb7a81ac60', 'request_id': 'req-b953928e-4386-491a-857d-3565a3e924fd'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:42.342751 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-b953928e-4386-491a-857d-3565a3e924fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab6b0ff045a64f98af0bfefb7a81ac60', 'request_id': 'req-b953928e-4386-491a-857d-3565a3e924fd'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:42.349950 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-b953928e-4386-491a-857d-3565a3e924fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab6b0ff045a64f98af0bfefb7a81ac60', 'request_id': 'req-b953928e-4386-491a-857d-3565a3e924fd'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:42.435004 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-b953928e-4386-491a-857d-3565a3e924fd admin admin] The token cache is being invalidate because project ab6b0ff045a64f98af0bfefb7a81ac60 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80873) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 17:26:42.435303 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-b953928e-4386-491a-857d-3565a3e924fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:42.435968 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-b953928e-4386-491a-857d-3565a3e924fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:42.440427 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1112/2221] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 16 17:26:42 2022] DELETE /identity/v3/projects/ab6b0ff045a64f98af0bfefb7a81ac60 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:26:42.441869 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4976ae-397d-44d8-bd44-6426a21feb43 service neutron] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:42.452861 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4976ae-397d-44d8-bd44-6426a21feb43 service neutron] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:42.512002 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71226b2d-ec1d-4b0d-8fb3-bfa4a3fa653b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:42.513003 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71226b2d-ec1d-4b0d-8fb3-bfa4a3fa653b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:42.513245 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71226b2d-ec1d-4b0d-8fb3-bfa4a3fa653b admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:42.513536 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71226b2d-ec1d-4b0d-8fb3-bfa4a3fa653b admin admin] PATH_INFO: `/v3/users/683da3ddf95741e49520a4da0816a832` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:42.514811 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71226b2d-ec1d-4b0d-8fb3-bfa4a3fa653b admin admin] RBAC: Authorizing `identity:delete_user(user_id=683da3ddf95741e49520a4da0816a832)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:42.516731 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71226b2d-ec1d-4b0d-8fb3-bfa4a3fa653b admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:42.825262 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-71226b2d-ec1d-4b0d-8fb3-bfa4a3fa653b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '683da3ddf95741e49520a4da0816a832'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:42.837646 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-71226b2d-ec1d-4b0d-8fb3-bfa4a3fa653b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '683da3ddf95741e49520a4da0816a832'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:43.051980 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-71226b2d-ec1d-4b0d-8fb3-bfa4a3fa653b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '683da3ddf95741e49520a4da0816a832'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:43.051980 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-71226b2d-ec1d-4b0d-8fb3-bfa4a3fa653b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '683da3ddf95741e49520a4da0816a832'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:43.059713 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-71226b2d-ec1d-4b0d-8fb3-bfa4a3fa653b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '683da3ddf95741e49520a4da0816a832'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:43.080070 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1110/2222] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 16 17:26:42 2022] DELETE /identity/v3/users/683da3ddf95741e49520a4da0816a832 => generated 0 bytes in 626 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:26:43.668081 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b953928e-4386-491a-857d-3565a3e924fd admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:43.670165 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-b953928e-4386-491a-857d-3565a3e924fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:43.684951 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b953928e-4386-491a-857d-3565a3e924fd admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:43.747037 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:26:43.749470 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde8741a-4cf5-4a75-9da6-d6de2ef5f595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:43.750411 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde8741a-4cf5-4a75-9da6-d6de2ef5f595 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:43.750703 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde8741a-4cf5-4a75-9da6-d6de2ef5f595 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:43.750987 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde8741a-4cf5-4a75-9da6-d6de2ef5f595 admin admin] PATH_INFO: `/v3/projects/930640de49154968a4ae0f2f97bf76dd` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:43.754618 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde8741a-4cf5-4a75-9da6-d6de2ef5f595 admin admin] RBAC: Authorizing `identity:delete_project(project_id=930640de49154968a4ae0f2f97bf76dd)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:43.754618 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde8741a-4cf5-4a75-9da6-d6de2ef5f595 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:43.834951 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:26:43.921598 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-fde8741a-4cf5-4a75-9da6-d6de2ef5f595 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '930640de49154968a4ae0f2f97bf76dd', 'request_id': 'req-fde8741a-4cf5-4a75-9da6-d6de2ef5f595'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:43.928124 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-fde8741a-4cf5-4a75-9da6-d6de2ef5f595 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '930640de49154968a4ae0f2f97bf76dd', 'request_id': 'req-fde8741a-4cf5-4a75-9da6-d6de2ef5f595'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:43.934733 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-fde8741a-4cf5-4a75-9da6-d6de2ef5f595 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '930640de49154968a4ae0f2f97bf76dd', 'request_id': 'req-fde8741a-4cf5-4a75-9da6-d6de2ef5f595'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:44.065958 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-fde8741a-4cf5-4a75-9da6-d6de2ef5f595 admin admin] The token cache is being invalidate because project 930640de49154968a4ae0f2f97bf76dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80873) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 17:26:44.066911 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-fde8741a-4cf5-4a75-9da6-d6de2ef5f595 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:44.067932 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-fde8741a-4cf5-4a75-9da6-d6de2ef5f595 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:44.070459 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1113/2223] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 16 17:26:43 2022] DELETE /identity/v3/projects/930640de49154968a4ae0f2f97bf76dd => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:26:44.075934 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a82200-db70-4b90-937c-82e9f1e54107 None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:44.076466 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a82200-db70-4b90-937c-82e9f1e54107 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:44.076967 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a82200-db70-4b90-937c-82e9f1e54107 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:44.098677 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-f3a82200-db70-4b90-937c-82e9f1e54107 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:26:44.100073 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-f3a82200-db70-4b90-937c-82e9f1e54107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:44.173795 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1111/2224] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:26:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:26:44.182800 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3009555-de35-4667-bb2a-2dd4d37882b2 None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:44.183314 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3009555-de35-4667-bb2a-2dd4d37882b2 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:44.183508 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3009555-de35-4667-bb2a-2dd4d37882b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:44.203387 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-d3009555-de35-4667-bb2a-2dd4d37882b2 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:26:44.204617 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-d3009555-de35-4667-bb2a-2dd4d37882b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:44.214934 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1114/2225] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:26:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:26:44.221888 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a82200-db70-4b90-937c-82e9f1e54107 None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:44.235240 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a82200-db70-4b90-937c-82e9f1e54107 None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:44.240217 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfd07d9-9f87-458e-a68b-92b304afd0de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:44.241505 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfd07d9-9f87-458e-a68b-92b304afd0de admin admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:44.241835 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfd07d9-9f87-458e-a68b-92b304afd0de admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:44.242130 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfd07d9-9f87-458e-a68b-92b304afd0de admin admin] PATH_INFO: `/v3/domains` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:44.242879 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfd07d9-9f87-458e-a68b-92b304afd0de admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:26:44.243196 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfd07d9-9f87-458e-a68b-92b304afd0de admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:44.245227 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfd07d9-9f87-458e-a68b-92b304afd0de admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:44.263700 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1112/2226] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 16 17:26:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:26:44.267517 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3009555-de35-4667-bb2a-2dd4d37882b2 None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:44.279399 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3009555-de35-4667-bb2a-2dd4d37882b2 None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:44.298515 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a305ef-84fc-46a2-9def-64cc056cdcf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:44.298515 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a305ef-84fc-46a2-9def-64cc056cdcf0 admin admin] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:44.298515 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a305ef-84fc-46a2-9def-64cc056cdcf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:44.298515 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a305ef-84fc-46a2-9def-64cc056cdcf0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:44.298880 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a305ef-84fc-46a2-9def-64cc056cdcf0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:44.298880 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a305ef-84fc-46a2-9def-64cc056cdcf0 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:44.401709 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1115/2227] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 16 17:26:44 2022] POST /identity/v3/projects => generated 385 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:26:44.402928 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfd07d9-9f87-458e-a68b-92b304afd0de admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:44.415014 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfd07d9-9f87-458e-a68b-92b304afd0de admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:44.482012 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a62b60f-05bc-4ff8-8266-6ec9d8670b8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:44.482700 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a62b60f-05bc-4ff8-8266-6ec9d8670b8c admin admin] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:44.482989 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a62b60f-05bc-4ff8-8266-6ec9d8670b8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:44.483269 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a62b60f-05bc-4ff8-8266-6ec9d8670b8c admin admin] PATH_INFO: `/v3/users` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:44.483975 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a62b60f-05bc-4ff8-8266-6ec9d8670b8c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:44.485923 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a62b60f-05bc-4ff8-8266-6ec9d8670b8c admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:44.568556 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1113/2228] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 16 17:26:44 2022] POST /identity/v3/users => generated 293 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 17:26:44.578251 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a305ef-84fc-46a2-9def-64cc056cdcf0 admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:44.584377 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a305ef-84fc-46a2-9def-64cc056cdcf0 admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:44.590254 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2476ddff-4727-4761-98a1-782f63615b94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:44.591341 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2476ddff-4727-4761-98a1-782f63615b94 admin admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:44.591574 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2476ddff-4727-4761-98a1-782f63615b94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:44.591853 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2476ddff-4727-4761-98a1-782f63615b94 admin admin] PATH_INFO: `/v3/roles` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:44.592734 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2476ddff-4727-4761-98a1-782f63615b94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:44.594283 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2476ddff-4727-4761-98a1-782f63615b94 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:44.607407 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1116/2229] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 17:26:44 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 17:26:44.615595 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a62b60f-05bc-4ff8-8266-6ec9d8670b8c admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:44.626147 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a62b60f-05bc-4ff8-8266-6ec9d8670b8c admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:44.630956 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80959e4-52ee-423c-89cb-ee4c381cee00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:44.631626 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80959e4-52ee-423c-89cb-ee4c381cee00 admin admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:44.631915 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80959e4-52ee-423c-89cb-ee4c381cee00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:44.632200 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80959e4-52ee-423c-89cb-ee4c381cee00 admin admin] PATH_INFO: `/v3/roles` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:44.632934 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80959e4-52ee-423c-89cb-ee4c381cee00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:44.635120 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80959e4-52ee-423c-89cb-ee4c381cee00 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:44.647150 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1114/2230] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 17:26:44 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:26:44.653830 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2476ddff-4727-4761-98a1-782f63615b94 admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:44.674752 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2476ddff-4727-4761-98a1-782f63615b94 admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:44.679502 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d176ea0a-d4d5-41b6-8af1-703ac66f760b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:44.680352 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d176ea0a-d4d5-41b6-8af1-703ac66f760b admin admin] REQUEST_METHOD: `PUT` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:44.680640 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d176ea0a-d4d5-41b6-8af1-703ac66f760b admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:44.681056 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d176ea0a-d4d5-41b6-8af1-703ac66f760b admin admin] PATH_INFO: `/v3/projects/d8381a9e5fd84311807a1ff4f973af0d/users/7632ca9541e442ec81f116e45836691c/roles/896bff49c5d6464eb612a15f4aa9badc` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:44.703108 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d176ea0a-d4d5-41b6-8af1-703ac66f760b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8381a9e5fd84311807a1ff4f973af0d, user_id=7632ca9541e442ec81f116e45836691c, role_id=896bff49c5d6464eb612a15f4aa9badc)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:44.706055 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d176ea0a-d4d5-41b6-8af1-703ac66f760b admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:44.835399 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1117/2231] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 17:26:44 2022] PUT /identity/v3/projects/d8381a9e5fd84311807a1ff4f973af0d/users/7632ca9541e442ec81f116e45836691c/roles/896bff49c5d6464eb612a15f4aa9badc => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:26:44.847600 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7501ac9-6bca-4e83-810b-394e3d1d6161 None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:44.848367 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7501ac9-6bca-4e83-810b-394e3d1d6161 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:44.848519 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7501ac9-6bca-4e83-810b-394e3d1d6161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:44.886286 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-f7501ac9-6bca-4e83-810b-394e3d1d6161 None None] MFA Rules not processed for user `7632ca9541e442ec81f116e45836691c`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:26:44.887525 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-f7501ac9-6bca-4e83-810b-394e3d1d6161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:44.973448 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1115/2232] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:26:44 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:26:45.022518 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d176ea0a-d4d5-41b6-8af1-703ac66f760b admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:45.024251 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-d176ea0a-d4d5-41b6-8af1-703ac66f760b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:45.105080 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d176ea0a-d4d5-41b6-8af1-703ac66f760b admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:45.109414 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:26:45.111842 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e8c779-a136-4a7d-b64a-68fea772796e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef37136b89d34edc9cd94c7aa81b2095', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:45.112501 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e8c779-a136-4a7d-b64a-68fea772796e service cinder] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:45.112793 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e8c779-a136-4a7d-b64a-68fea772796e service cinder] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:45.113193 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e8c779-a136-4a7d-b64a-68fea772796e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:45.122413 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e8c779-a136-4a7d-b64a-68fea772796e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:45.124155 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e8c779-a136-4a7d-b64a-68fea772796e service cinder] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:45.139005 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1118/2233] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:26:45 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:26:45.929139 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:26:46.756828 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:26:47.343420 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:26:47.708922 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7501ac9-6bca-4e83-810b-394e3d1d6161 None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:47.710560 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-f7501ac9-6bca-4e83-810b-394e3d1d6161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:47.797572 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7501ac9-6bca-4e83-810b-394e3d1d6161 None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:47.802969 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503af73a-0528-4d6a-a3d7-a726055a2140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:47.804069 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503af73a-0528-4d6a-a3d7-a726055a2140 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:47.804361 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503af73a-0528-4d6a-a3d7-a726055a2140 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:47.804651 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503af73a-0528-4d6a-a3d7-a726055a2140 admin admin] PATH_INFO: `/v3/users/0ea8170386604e90904619c4ed5b42f4` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:47.806202 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503af73a-0528-4d6a-a3d7-a726055a2140 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ea8170386604e90904619c4ed5b42f4)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:47.812095 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503af73a-0528-4d6a-a3d7-a726055a2140 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:47.895925 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:26:48.068038 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-503af73a-0528-4d6a-a3d7-a726055a2140 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ea8170386604e90904619c4ed5b42f4'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:48.077667 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-503af73a-0528-4d6a-a3d7-a726055a2140 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ea8170386604e90904619c4ed5b42f4'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:48.195711 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-503af73a-0528-4d6a-a3d7-a726055a2140 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ea8170386604e90904619c4ed5b42f4'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:48.196464 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-503af73a-0528-4d6a-a3d7-a726055a2140 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ea8170386604e90904619c4ed5b42f4'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:48.214577 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-503af73a-0528-4d6a-a3d7-a726055a2140 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ea8170386604e90904619c4ed5b42f4'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:48.227602 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1116/2234] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 16 17:26:47 2022] DELETE /identity/v3/users/0ea8170386604e90904619c4ed5b42f4 => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:26:48.233500 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0249daab-ca29-42ca-bd71-b6838d209639 None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:48.234552 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0249daab-ca29-42ca-bd71-b6838d209639 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:48.234941 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0249daab-ca29-42ca-bd71-b6838d209639 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:48.253868 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=92,keystone:DELETE=3,keystone:INSERT=5 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:26:48.256008 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-0249daab-ca29-42ca-bd71-b6838d209639 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:26:48.257363 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-0249daab-ca29-42ca-bd71-b6838d209639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:48.317747 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1119/2235] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:26:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:26:48.336559 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503af73a-0528-4d6a-a3d7-a726055a2140 admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:48.338512 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-503af73a-0528-4d6a-a3d7-a726055a2140 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:48.399037 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503af73a-0528-4d6a-a3d7-a726055a2140 admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:48.403685 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de16b05-6b70-472a-8072-858da34f343e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5d25bfa8dc042329d57cd55fa7b7b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:48.404352 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de16b05-6b70-472a-8072-858da34f343e service neutron] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:48.404671 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de16b05-6b70-472a-8072-858da34f343e service neutron] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:48.404947 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de16b05-6b70-472a-8072-858da34f343e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:48.415353 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de16b05-6b70-472a-8072-858da34f343e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:48.417085 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de16b05-6b70-472a-8072-858da34f343e service neutron] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:48.431017 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1117/2236] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:26:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 17:26:48.866734 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0249daab-ca29-42ca-bd71-b6838d209639 None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:48.868576 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-0249daab-ca29-42ca-bd71-b6838d209639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:48.884927 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0249daab-ca29-42ca-bd71-b6838d209639 None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:48.892980 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c16e7c-9242-40f4-b73d-249143d4f34f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:48.894879 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c16e7c-9242-40f4-b73d-249143d4f34f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:48.895427 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c16e7c-9242-40f4-b73d-249143d4f34f admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:48.895892 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c16e7c-9242-40f4-b73d-249143d4f34f admin admin] PATH_INFO: `/v3/projects/7847e171f42e49d8b75e9b22b4c31afe` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:48.897819 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c16e7c-9242-40f4-b73d-249143d4f34f admin admin] RBAC: Authorizing `identity:delete_project(project_id=7847e171f42e49d8b75e9b22b4c31afe)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:48.902014 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c16e7c-9242-40f4-b73d-249143d4f34f admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:49.094019 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-90c16e7c-9242-40f4-b73d-249143d4f34f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7847e171f42e49d8b75e9b22b4c31afe', 'request_id': 'req-90c16e7c-9242-40f4-b73d-249143d4f34f'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:49.103146 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-90c16e7c-9242-40f4-b73d-249143d4f34f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7847e171f42e49d8b75e9b22b4c31afe', 'request_id': 'req-90c16e7c-9242-40f4-b73d-249143d4f34f'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:49.110835 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-90c16e7c-9242-40f4-b73d-249143d4f34f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7847e171f42e49d8b75e9b22b4c31afe', 'request_id': 'req-90c16e7c-9242-40f4-b73d-249143d4f34f'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:49.116596 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:26:49.256745 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-90c16e7c-9242-40f4-b73d-249143d4f34f admin admin] The token cache is being invalidate because project 7847e171f42e49d8b75e9b22b4c31afe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80873) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 17:26:49.260011 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-90c16e7c-9242-40f4-b73d-249143d4f34f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:49.260011 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-90c16e7c-9242-40f4-b73d-249143d4f34f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:49.260011 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1120/2237] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 16 17:26:48 2022] DELETE /identity/v3/projects/7847e171f42e49d8b75e9b22b4c31afe => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:26:49.265585 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5ce78e-2eb5-4172-98c3-63abc4ffabc7 None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:49.265919 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5ce78e-2eb5-4172-98c3-63abc4ffabc7 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:49.266203 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5ce78e-2eb5-4172-98c3-63abc4ffabc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:49.288753 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-8e5ce78e-2eb5-4172-98c3-63abc4ffabc7 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:26:49.290072 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-8e5ce78e-2eb5-4172-98c3-63abc4ffabc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:49.384088 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1118/2238] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:26:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:26:49.392489 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27520239-a378-44c9-85ea-d4ed95f36ab8 None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:49.392786 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27520239-a378-44c9-85ea-d4ed95f36ab8 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:49.393078 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27520239-a378-44c9-85ea-d4ed95f36ab8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:49.402552 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:26:49.414183 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-27520239-a378-44c9-85ea-d4ed95f36ab8 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:26:49.415448 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-27520239-a378-44c9-85ea-d4ed95f36ab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:49.424034 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1121/2239] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:26:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:26:49.428453 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5ce78e-2eb5-4172-98c3-63abc4ffabc7 None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:49.438654 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5ce78e-2eb5-4172-98c3-63abc4ffabc7 None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:49.443514 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcd3131-bba3-43f5-a167-55540b979636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:49.444116 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcd3131-bba3-43f5-a167-55540b979636 admin admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:49.444411 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcd3131-bba3-43f5-a167-55540b979636 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:49.444696 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcd3131-bba3-43f5-a167-55540b979636 admin admin] PATH_INFO: `/v3/domains` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:49.445467 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcd3131-bba3-43f5-a167-55540b979636 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:26:49.445810 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcd3131-bba3-43f5-a167-55540b979636 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:49.447425 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcd3131-bba3-43f5-a167-55540b979636 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:49.461092 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1119/2240] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 16 17:26:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 17:26:49.465145 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27520239-a378-44c9-85ea-d4ed95f36ab8 None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:49.474436 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27520239-a378-44c9-85ea-d4ed95f36ab8 None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:49.479268 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dee5a2a-d40e-4b9d-a92b-28f2076846de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:49.479954 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dee5a2a-d40e-4b9d-a92b-28f2076846de admin admin] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:49.480412 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dee5a2a-d40e-4b9d-a92b-28f2076846de admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:49.480701 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dee5a2a-d40e-4b9d-a92b-28f2076846de admin admin] PATH_INFO: `/v3/projects` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:49.481402 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dee5a2a-d40e-4b9d-a92b-28f2076846de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:49.483363 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dee5a2a-d40e-4b9d-a92b-28f2076846de admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:49.586306 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1122/2241] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 16 17:26:49 2022] POST /identity/v3/projects => generated 357 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:26:49.590681 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcd3131-bba3-43f5-a167-55540b979636 admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:49.600948 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcd3131-bba3-43f5-a167-55540b979636 admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:49.665970 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb42e00-d5ef-4247-b5e7-e27f9ee3fb4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:49.666658 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb42e00-d5ef-4247-b5e7-e27f9ee3fb4f admin admin] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:49.667526 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb42e00-d5ef-4247-b5e7-e27f9ee3fb4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:49.667815 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb42e00-d5ef-4247-b5e7-e27f9ee3fb4f admin admin] PATH_INFO: `/v3/users` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:49.668525 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb42e00-d5ef-4247-b5e7-e27f9ee3fb4f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:49.670566 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb42e00-d5ef-4247-b5e7-e27f9ee3fb4f admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:49.750421 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1120/2242] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 16 17:26:49 2022] POST /identity/v3/users => generated 279 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 17:26:49.761410 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dee5a2a-d40e-4b9d-a92b-28f2076846de admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:49.772044 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dee5a2a-d40e-4b9d-a92b-28f2076846de admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:49.777093 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58067ea7-7c6e-4a52-8037-542b3b7d2457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:49.778001 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58067ea7-7c6e-4a52-8037-542b3b7d2457 admin admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:49.778438 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58067ea7-7c6e-4a52-8037-542b3b7d2457 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:49.778925 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58067ea7-7c6e-4a52-8037-542b3b7d2457 admin admin] PATH_INFO: `/v3/roles` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:49.781095 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58067ea7-7c6e-4a52-8037-542b3b7d2457 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:49.781281 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58067ea7-7c6e-4a52-8037-542b3b7d2457 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:49.793192 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1123/2243] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 17:26:49 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:26:49.797367 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb42e00-d5ef-4247-b5e7-e27f9ee3fb4f admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:49.809483 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb42e00-d5ef-4247-b5e7-e27f9ee3fb4f admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:49.814313 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac72e041-9438-4609-aaf1-26c5de3bd21f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:49.814976 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac72e041-9438-4609-aaf1-26c5de3bd21f admin admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:49.815260 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac72e041-9438-4609-aaf1-26c5de3bd21f admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:49.816147 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac72e041-9438-4609-aaf1-26c5de3bd21f admin admin] PATH_INFO: `/v3/roles` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:49.816876 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac72e041-9438-4609-aaf1-26c5de3bd21f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:49.818617 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac72e041-9438-4609-aaf1-26c5de3bd21f admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:49.830037 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1121/2244] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 17:26:49 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:26:49.838595 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58067ea7-7c6e-4a52-8037-542b3b7d2457 admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:49.844144 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58067ea7-7c6e-4a52-8037-542b3b7d2457 admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:49.848923 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961238e7-c403-4582-9104-a13ea4d2ccd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:49.849841 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961238e7-c403-4582-9104-a13ea4d2ccd2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:49.850132 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961238e7-c403-4582-9104-a13ea4d2ccd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:49.850415 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961238e7-c403-4582-9104-a13ea4d2ccd2 admin admin] PATH_INFO: `/v3/projects/1334ab378fab45a1b7de0f37d0563a31/users/1d19aa8713f34803b0239d3a64c220bc/roles/896bff49c5d6464eb612a15f4aa9badc` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:49.866859 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961238e7-c403-4582-9104-a13ea4d2ccd2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1334ab378fab45a1b7de0f37d0563a31, user_id=1d19aa8713f34803b0239d3a64c220bc, role_id=896bff49c5d6464eb612a15f4aa9badc)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:49.869575 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961238e7-c403-4582-9104-a13ea4d2ccd2 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:49.949360 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1124/2245] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 17:26:49 2022] PUT /identity/v3/projects/1334ab378fab45a1b7de0f37d0563a31/users/1d19aa8713f34803b0239d3a64c220bc/roles/896bff49c5d6464eb612a15f4aa9badc => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:26:49.959925 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537aaf2f-5b6c-49a9-8664-4920c9e56e6f None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:49.960332 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537aaf2f-5b6c-49a9-8664-4920c9e56e6f None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:49.960690 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537aaf2f-5b6c-49a9-8664-4920c9e56e6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:49.989632 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-537aaf2f-5b6c-49a9-8664-4920c9e56e6f None None] MFA Rules not processed for user `1d19aa8713f34803b0239d3a64c220bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:26:49.990917 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-537aaf2f-5b6c-49a9-8664-4920c9e56e6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:50.061919 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1122/2246] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:26:49 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:26:50.077203 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961238e7-c403-4582-9104-a13ea4d2ccd2 admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:50.142172 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961238e7-c403-4582-9104-a13ea4d2ccd2 admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:50.147022 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364f7f78-1379-45cd-8ee5-284f3baf5b5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:50.147681 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364f7f78-1379-45cd-8ee5-284f3baf5b5e admin admin] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:50.147977 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364f7f78-1379-45cd-8ee5-284f3baf5b5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:50.148244 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364f7f78-1379-45cd-8ee5-284f3baf5b5e admin admin] PATH_INFO: `/v3/projects` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:50.148933 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364f7f78-1379-45cd-8ee5-284f3baf5b5e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:50.150869 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364f7f78-1379-45cd-8ee5-284f3baf5b5e admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:50.251741 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1125/2247] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 16 17:26:50 2022] POST /identity/v3/projects => generated 357 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:26:50.256264 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537aaf2f-5b6c-49a9-8664-4920c9e56e6f None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:50.267962 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537aaf2f-5b6c-49a9-8664-4920c9e56e6f None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:50.325552 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292be1d6-e586-4e20-91d0-bdbc055a1b3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:50.326398 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292be1d6-e586-4e20-91d0-bdbc055a1b3d admin admin] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:50.326690 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292be1d6-e586-4e20-91d0-bdbc055a1b3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:50.326971 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292be1d6-e586-4e20-91d0-bdbc055a1b3d admin admin] PATH_INFO: `/v3/users` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:50.327686 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292be1d6-e586-4e20-91d0-bdbc055a1b3d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:50.329606 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292be1d6-e586-4e20-91d0-bdbc055a1b3d admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:50.339489 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:26:50.456831 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:26:50.461881 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1123/2248] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 16 17:26:50 2022] POST /identity/v3/users => generated 285 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:26:50.466912 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364f7f78-1379-45cd-8ee5-284f3baf5b5e admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:50.477697 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364f7f78-1379-45cd-8ee5-284f3baf5b5e admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:50.482521 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548fc5cd-0333-4312-8cbf-bb761c998e37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:50.483192 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548fc5cd-0333-4312-8cbf-bb761c998e37 admin admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:50.483486 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548fc5cd-0333-4312-8cbf-bb761c998e37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:50.483770 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548fc5cd-0333-4312-8cbf-bb761c998e37 admin admin] PATH_INFO: `/v3/roles` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:50.484539 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548fc5cd-0333-4312-8cbf-bb761c998e37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:50.486174 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548fc5cd-0333-4312-8cbf-bb761c998e37 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:50.497466 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1126/2249] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 17:26:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:26:50.502522 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292be1d6-e586-4e20-91d0-bdbc055a1b3d admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:50.513851 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292be1d6-e586-4e20-91d0-bdbc055a1b3d admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:50.518891 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196035fe-c50a-4554-9c7a-e1ace29651e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:50.519819 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196035fe-c50a-4554-9c7a-e1ace29651e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:50.520148 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196035fe-c50a-4554-9c7a-e1ace29651e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:50.520455 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196035fe-c50a-4554-9c7a-e1ace29651e1 admin admin] PATH_INFO: `/v3/projects/56ac111c8eec45c1a81138fc253548a6/users/7745dea329a3447d982dc216fa9ccbef/roles/dba744f8ab2a4c45b9d3212f8d203aba` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:50.535986 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196035fe-c50a-4554-9c7a-e1ace29651e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=56ac111c8eec45c1a81138fc253548a6, user_id=7745dea329a3447d982dc216fa9ccbef, role_id=dba744f8ab2a4c45b9d3212f8d203aba)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:50.538699 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196035fe-c50a-4554-9c7a-e1ace29651e1 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:50.653870 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548fc5cd-0333-4312-8cbf-bb761c998e37 admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:50.658014 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-548fc5cd-0333-4312-8cbf-bb761c998e37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:50.671911 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548fc5cd-0333-4312-8cbf-bb761c998e37 admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:50.683860 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1f09f9-ca5d-4c6a-a227-9a0b5219b898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:50.684754 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1f09f9-ca5d-4c6a-a227-9a0b5219b898 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:50.685037 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1f09f9-ca5d-4c6a-a227-9a0b5219b898 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:50.685617 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1f09f9-ca5d-4c6a-a227-9a0b5219b898 admin admin] PATH_INFO: `/v3/users/0a2ca5d5699b481aa3b0274f74195aca` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:50.686751 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1f09f9-ca5d-4c6a-a227-9a0b5219b898 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a2ca5d5699b481aa3b0274f74195aca)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:50.688678 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1f09f9-ca5d-4c6a-a227-9a0b5219b898 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:50.787497 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1124/2250] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 17:26:50 2022] PUT /identity/v3/projects/56ac111c8eec45c1a81138fc253548a6/users/7745dea329a3447d982dc216fa9ccbef/roles/dba744f8ab2a4c45b9d3212f8d203aba => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:26:50.789816 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196035fe-c50a-4554-9c7a-e1ace29651e1 admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:50.870483 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196035fe-c50a-4554-9c7a-e1ace29651e1 admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:50.875444 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bac431d-7b18-4a37-8336-1f17b5c43b85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:50.881866 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bac431d-7b18-4a37-8336-1f17b5c43b85 admin admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:50.881866 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bac431d-7b18-4a37-8336-1f17b5c43b85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:50.881866 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bac431d-7b18-4a37-8336-1f17b5c43b85 admin admin] PATH_INFO: `/v3/roles` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:50.881866 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bac431d-7b18-4a37-8336-1f17b5c43b85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:50.881866 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bac431d-7b18-4a37-8336-1f17b5c43b85 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:50.890798 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1125/2251] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 17:26:50 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:26:50.894736 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bac431d-7b18-4a37-8336-1f17b5c43b85 admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:50.920839 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bac431d-7b18-4a37-8336-1f17b5c43b85 admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:50.930381 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-8a1f09f9-ca5d-4c6a-a227-9a0b5219b898 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a2ca5d5699b481aa3b0274f74195aca'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:50.931531 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-8a1f09f9-ca5d-4c6a-a227-9a0b5219b898 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a2ca5d5699b481aa3b0274f74195aca'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:50.931680 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28369e13-746d-440e-8cfd-110ae71adc12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:50.932348 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-8a1f09f9-ca5d-4c6a-a227-9a0b5219b898 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a2ca5d5699b481aa3b0274f74195aca'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:50.933574 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28369e13-746d-440e-8cfd-110ae71adc12 admin admin] REQUEST_METHOD: `PUT` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:50.934302 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28369e13-746d-440e-8cfd-110ae71adc12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:50.935011 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28369e13-746d-440e-8cfd-110ae71adc12 admin admin] PATH_INFO: `/v3/projects/56ac111c8eec45c1a81138fc253548a6/users/7745dea329a3447d982dc216fa9ccbef/roles/dba744f8ab2a4c45b9d3212f8d203aba` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:50.938569 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28369e13-746d-440e-8cfd-110ae71adc12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=56ac111c8eec45c1a81138fc253548a6, user_id=7745dea329a3447d982dc216fa9ccbef, role_id=dba744f8ab2a4c45b9d3212f8d203aba)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:50.942283 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28369e13-746d-440e-8cfd-110ae71adc12 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:50.956018 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1126/2252] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 17:26:50 2022] PUT /identity/v3/projects/56ac111c8eec45c1a81138fc253548a6/users/7745dea329a3447d982dc216fa9ccbef/roles/dba744f8ab2a4c45b9d3212f8d203aba => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:26:50.967749 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bcdc03-66e7-43db-bf71-6066de2ca497 None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:50.967959 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bcdc03-66e7-43db-bf71-6066de2ca497 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:50.968232 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bcdc03-66e7-43db-bf71-6066de2ca497 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:50.995595 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-95bcdc03-66e7-43db-bf71-6066de2ca497 None None] MFA Rules not processed for user `7745dea329a3447d982dc216fa9ccbef`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:26:50.997400 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-95bcdc03-66e7-43db-bf71-6066de2ca497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:51.067150 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1127/2253] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:26:50 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:26:51.096687 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-8a1f09f9-ca5d-4c6a-a227-9a0b5219b898 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a2ca5d5699b481aa3b0274f74195aca'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:51.109193 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-8a1f09f9-ca5d-4c6a-a227-9a0b5219b898 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a2ca5d5699b481aa3b0274f74195aca'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:51.134916 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1127/2254] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 16 17:26:50 2022] DELETE /identity/v3/users/0a2ca5d5699b481aa3b0274f74195aca => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:26:51.135227 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bcdc03-66e7-43db-bf71-6066de2ca497 None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:51.136817 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-95bcdc03-66e7-43db-bf71-6066de2ca497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:51.139501 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa34850d-bfa9-4ecd-abf7-ab92775bc194 None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:51.139991 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa34850d-bfa9-4ecd-abf7-ab92775bc194 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:51.140427 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa34850d-bfa9-4ecd-abf7-ab92775bc194 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:51.164637 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-fa34850d-bfa9-4ecd-abf7-ab92775bc194 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:26:51.165898 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-fa34850d-bfa9-4ecd-abf7-ab92775bc194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:51.200612 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bcdc03-66e7-43db-bf71-6066de2ca497 None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:51.228398 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1128/2255] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:26:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 17:26:51.238926 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa34850d-bfa9-4ecd-abf7-ab92775bc194 None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:51.240342 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-fa34850d-bfa9-4ecd-abf7-ab92775bc194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:51.254330 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f8d620-fe3f-4b29-b68e-b79362a635df service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef37136b89d34edc9cd94c7aa81b2095', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:51.254623 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f8d620-fe3f-4b29-b68e-b79362a635df service cinder] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:51.254877 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f8d620-fe3f-4b29-b68e-b79362a635df service cinder] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:51.255157 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f8d620-fe3f-4b29-b68e-b79362a635df service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:51.297840 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa34850d-bfa9-4ecd-abf7-ab92775bc194 None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:51.301618 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d214b64-b513-4956-9eb9-f45185378d08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5d25bfa8dc042329d57cd55fa7b7b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:51.302353 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d214b64-b513-4956-9eb9-f45185378d08 service neutron] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:51.302957 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d214b64-b513-4956-9eb9-f45185378d08 service neutron] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:51.302957 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d214b64-b513-4956-9eb9-f45185378d08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:51.314418 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d214b64-b513-4956-9eb9-f45185378d08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:51.316105 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d214b64-b513-4956-9eb9-f45185378d08 service neutron] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:51.318136 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f8d620-fe3f-4b29-b68e-b79362a635df service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:51.319604 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f8d620-fe3f-4b29-b68e-b79362a635df service cinder] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:51.326421 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1129/2256] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:26:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 17:26:51.334132 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1128/2257] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:26:51 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:26:51.390590 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:26:51.665597 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:26:51.756015 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d214b64-b513-4956-9eb9-f45185378d08 service neutron] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:51.758302 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-6d214b64-b513-4956-9eb9-f45185378d08 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:51.773047 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d214b64-b513-4956-9eb9-f45185378d08 service neutron] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:51.779369 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad8844d-c121-4fe5-9bb8-245795a3b5ff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef37136b89d34edc9cd94c7aa81b2095', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:51.783297 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad8844d-c121-4fe5-9bb8-245795a3b5ff service cinder] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:51.783297 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad8844d-c121-4fe5-9bb8-245795a3b5ff service cinder] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:51.783297 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad8844d-c121-4fe5-9bb8-245795a3b5ff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:51.784396 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-9ad8844d-c121-4fe5-9bb8-245795a3b5ff service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:51.827646 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f8d620-fe3f-4b29-b68e-b79362a635df service cinder] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:51.829308 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-56f8d620-fe3f-4b29-b68e-b79362a635df service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:51.847311 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f8d620-fe3f-4b29-b68e-b79362a635df service cinder] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:51.854578 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0909b5d-c8fb-444d-a245-ff817cdf6fd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:51.855647 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0909b5d-c8fb-444d-a245-ff817cdf6fd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:51.856002 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0909b5d-c8fb-444d-a245-ff817cdf6fd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:51.856474 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0909b5d-c8fb-444d-a245-ff817cdf6fd1 admin admin] PATH_INFO: `/v3/users/02d127629ea242bdacf759fe8cd84e9c` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:51.857994 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0909b5d-c8fb-444d-a245-ff817cdf6fd1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=02d127629ea242bdacf759fe8cd84e9c)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:51.860518 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0909b5d-c8fb-444d-a245-ff817cdf6fd1 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:51.892339 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad8844d-c121-4fe5-9bb8-245795a3b5ff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:51.894027 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad8844d-c121-4fe5-9bb8-245795a3b5ff service cinder] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:51.910134 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1130/2258] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:26:51 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:26:51.911281 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad8844d-c121-4fe5-9bb8-245795a3b5ff service cinder] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:51.913395 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-9ad8844d-c121-4fe5-9bb8-245795a3b5ff service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:51.954380 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad8844d-c121-4fe5-9bb8-245795a3b5ff service cinder] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:51.959542 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2d41a8-7ed8-493e-b258-02f5f055304a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:51.960809 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2d41a8-7ed8-493e-b258-02f5f055304a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:51.961250 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2d41a8-7ed8-493e-b258-02f5f055304a admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:51.961933 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2d41a8-7ed8-493e-b258-02f5f055304a admin admin] PATH_INFO: `/v3/projects/e22dd4c8816a45918e70cbfa916728ea` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:51.963474 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2d41a8-7ed8-493e-b258-02f5f055304a admin admin] RBAC: Authorizing `identity:delete_project(project_id=e22dd4c8816a45918e70cbfa916728ea)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:51.965949 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2d41a8-7ed8-493e-b258-02f5f055304a admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:52.205313 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-a0909b5d-c8fb-444d-a245-ff817cdf6fd1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02d127629ea242bdacf759fe8cd84e9c'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:52.205547 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-1d2d41a8-7ed8-493e-b258-02f5f055304a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e22dd4c8816a45918e70cbfa916728ea', 'request_id': 'req-1d2d41a8-7ed8-493e-b258-02f5f055304a'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:52.213358 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-a0909b5d-c8fb-444d-a245-ff817cdf6fd1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02d127629ea242bdacf759fe8cd84e9c'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:52.216393 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-1d2d41a8-7ed8-493e-b258-02f5f055304a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e22dd4c8816a45918e70cbfa916728ea', 'request_id': 'req-1d2d41a8-7ed8-493e-b258-02f5f055304a'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:52.223205 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-1d2d41a8-7ed8-493e-b258-02f5f055304a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e22dd4c8816a45918e70cbfa916728ea', 'request_id': 'req-1d2d41a8-7ed8-493e-b258-02f5f055304a'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:52.305120 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-a0909b5d-c8fb-444d-a245-ff817cdf6fd1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02d127629ea242bdacf759fe8cd84e9c'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:52.308502 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-a0909b5d-c8fb-444d-a245-ff817cdf6fd1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02d127629ea242bdacf759fe8cd84e9c'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:52.340953 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-a0909b5d-c8fb-444d-a245-ff817cdf6fd1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02d127629ea242bdacf759fe8cd84e9c'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:52.342414 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1129/2259] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 16 17:26:51 2022] DELETE /identity/v3/users/02d127629ea242bdacf759fe8cd84e9c => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:26:52.349380 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a1b713-d764-4ecd-af89-f13bfaef3182 None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:52.349854 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a1b713-d764-4ecd-af89-f13bfaef3182 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:52.350334 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a1b713-d764-4ecd-af89-f13bfaef3182 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:52.368010 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-91a1b713-d764-4ecd-af89-f13bfaef3182 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:26:52.369384 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-91a1b713-d764-4ecd-af89-f13bfaef3182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:52.395842 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-1d2d41a8-7ed8-493e-b258-02f5f055304a admin admin] The token cache is being invalidate because project e22dd4c8816a45918e70cbfa916728ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80873) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 17:26:52.396249 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-1d2d41a8-7ed8-493e-b258-02f5f055304a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:52.396887 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-1d2d41a8-7ed8-493e-b258-02f5f055304a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:52.399057 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1131/2260] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 16 17:26:51 2022] DELETE /identity/v3/projects/e22dd4c8816a45918e70cbfa916728ea => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:26:52.403464 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2d41a8-7ed8-493e-b258-02f5f055304a admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:52.405819 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-1d2d41a8-7ed8-493e-b258-02f5f055304a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:52.445587 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1130/2261] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:26:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:26:52.456332 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a1b713-d764-4ecd-af89-f13bfaef3182 None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:52.458704 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-91a1b713-d764-4ecd-af89-f13bfaef3182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:52.487943 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2d41a8-7ed8-493e-b258-02f5f055304a admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:52.493598 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbd1749-b7c0-4827-b564-bd0ac526bb92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:52.495118 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbd1749-b7c0-4827-b564-bd0ac526bb92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:52.501018 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbd1749-b7c0-4827-b564-bd0ac526bb92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:52.501018 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbd1749-b7c0-4827-b564-bd0ac526bb92 admin admin] PATH_INFO: `/v3/users/ac584e7766b640a597b668ce6695989a` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:52.501018 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbd1749-b7c0-4827-b564-bd0ac526bb92 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac584e7766b640a597b668ce6695989a)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:52.501018 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbd1749-b7c0-4827-b564-bd0ac526bb92 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:52.530998 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a1b713-d764-4ecd-af89-f13bfaef3182 None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:52.540460 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b6bf4d-c806-4f08-8898-76c5abc971a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5d25bfa8dc042329d57cd55fa7b7b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:52.541012 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b6bf4d-c806-4f08-8898-76c5abc971a8 service neutron] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:52.541312 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b6bf4d-c806-4f08-8898-76c5abc971a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:52.541597 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b6bf4d-c806-4f08-8898-76c5abc971a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:52.553401 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b6bf4d-c806-4f08-8898-76c5abc971a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:52.555361 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b6bf4d-c806-4f08-8898-76c5abc971a8 service neutron] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:52.586162 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1131/2262] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:26:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:26:52.729190 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-ddbd1749-b7c0-4827-b564-bd0ac526bb92 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac584e7766b640a597b668ce6695989a'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:52.729983 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-ddbd1749-b7c0-4827-b564-bd0ac526bb92 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac584e7766b640a597b668ce6695989a'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:52.730831 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-ddbd1749-b7c0-4827-b564-bd0ac526bb92 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac584e7766b640a597b668ce6695989a'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:52.817621 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-ddbd1749-b7c0-4827-b564-bd0ac526bb92 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac584e7766b640a597b668ce6695989a'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:52.832950 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-ddbd1749-b7c0-4827-b564-bd0ac526bb92 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac584e7766b640a597b668ce6695989a'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:52.851802 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1132/2263] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 16 17:26:52 2022] DELETE /identity/v3/users/ac584e7766b640a597b668ce6695989a => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:26:53.192826 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b6bf4d-c806-4f08-8898-76c5abc971a8 service neutron] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:53.195568 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-a8b6bf4d-c806-4f08-8898-76c5abc971a8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:53.212881 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b6bf4d-c806-4f08-8898-76c5abc971a8 service neutron] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:53.285026 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:26:53.288158 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde9869b-7be4-47cf-8093-f6c3ab6a1e55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:53.290358 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde9869b-7be4-47cf-8093-f6c3ab6a1e55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:53.290358 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde9869b-7be4-47cf-8093-f6c3ab6a1e55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:53.290358 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde9869b-7be4-47cf-8093-f6c3ab6a1e55 admin admin] PATH_INFO: `/v3/projects/869b414172dd4b4e9d9714c66649504d` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:53.291064 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde9869b-7be4-47cf-8093-f6c3ab6a1e55 admin admin] RBAC: Authorizing `identity:delete_project(project_id=869b414172dd4b4e9d9714c66649504d)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:53.293559 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde9869b-7be4-47cf-8093-f6c3ab6a1e55 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:53.468732 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-fde9869b-7be4-47cf-8093-f6c3ab6a1e55 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '869b414172dd4b4e9d9714c66649504d', 'request_id': 'req-fde9869b-7be4-47cf-8093-f6c3ab6a1e55'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:53.474393 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-fde9869b-7be4-47cf-8093-f6c3ab6a1e55 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '869b414172dd4b4e9d9714c66649504d', 'request_id': 'req-fde9869b-7be4-47cf-8093-f6c3ab6a1e55'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:53.494931 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbd1749-b7c0-4827-b564-bd0ac526bb92 admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:53.496620 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-ddbd1749-b7c0-4827-b564-bd0ac526bb92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:53.513574 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbd1749-b7c0-4827-b564-bd0ac526bb92 admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:53.571028 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a7e5e5-2dcb-46f7-b072-13ae13e08326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:53.572261 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a7e5e5-2dcb-46f7-b072-13ae13e08326 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:53.572568 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a7e5e5-2dcb-46f7-b072-13ae13e08326 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:53.573367 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a7e5e5-2dcb-46f7-b072-13ae13e08326 admin admin] PATH_INFO: `/v3/projects/17a0856ef6f742868310badf743ae2fa` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:53.575068 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a7e5e5-2dcb-46f7-b072-13ae13e08326 admin admin] RBAC: Authorizing `identity:delete_project(project_id=17a0856ef6f742868310badf743ae2fa)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:53.577505 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a7e5e5-2dcb-46f7-b072-13ae13e08326 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:53.607744 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-fde9869b-7be4-47cf-8093-f6c3ab6a1e55 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '869b414172dd4b4e9d9714c66649504d', 'request_id': 'req-fde9869b-7be4-47cf-8093-f6c3ab6a1e55'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:53.621680 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-fde9869b-7be4-47cf-8093-f6c3ab6a1e55 admin admin] The token cache is being invalidate because project 869b414172dd4b4e9d9714c66649504d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80874) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 17:26:53.621921 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-fde9869b-7be4-47cf-8093-f6c3ab6a1e55 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:53.623059 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-fde9869b-7be4-47cf-8093-f6c3ab6a1e55 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:53.624396 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1132/2264] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 16 17:26:53 2022] DELETE /identity/v3/projects/869b414172dd4b4e9d9714c66649504d => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:26:53.629045 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b8cd9d-3d08-48d6-82d1-b6059d427482 None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:53.629352 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b8cd9d-3d08-48d6-82d1-b6059d427482 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:53.629705 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b8cd9d-3d08-48d6-82d1-b6059d427482 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:53.658661 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-49b8cd9d-3d08-48d6-82d1-b6059d427482 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:26:53.658661 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-49b8cd9d-3d08-48d6-82d1-b6059d427482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:53.662337 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1133/2265] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:26:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:26:53.672087 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55930340-e727-44a1-a8dc-b44ce4a963e6 None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:53.672401 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55930340-e727-44a1-a8dc-b44ce4a963e6 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:53.673266 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55930340-e727-44a1-a8dc-b44ce4a963e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:53.701119 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-55930340-e727-44a1-a8dc-b44ce4a963e6 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:26:53.702468 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-55930340-e727-44a1-a8dc-b44ce4a963e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:53.732969 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1134/2266] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:26:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:26:53.734008 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55930340-e727-44a1-a8dc-b44ce4a963e6 None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:53.738453 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-54a7e5e5-2dcb-46f7-b072-13ae13e08326 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17a0856ef6f742868310badf743ae2fa', 'request_id': 'req-54a7e5e5-2dcb-46f7-b072-13ae13e08326'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:53.745305 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-54a7e5e5-2dcb-46f7-b072-13ae13e08326 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17a0856ef6f742868310badf743ae2fa', 'request_id': 'req-54a7e5e5-2dcb-46f7-b072-13ae13e08326'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:53.751564 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-54a7e5e5-2dcb-46f7-b072-13ae13e08326 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17a0856ef6f742868310badf743ae2fa', 'request_id': 'req-54a7e5e5-2dcb-46f7-b072-13ae13e08326'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:53.755046 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55930340-e727-44a1-a8dc-b44ce4a963e6 None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:53.815373 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44149d2-9226-47ea-9b41-5c80ead5d432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:53.816045 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44149d2-9226-47ea-9b41-5c80ead5d432 admin admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:53.816341 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44149d2-9226-47ea-9b41-5c80ead5d432 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:53.816627 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44149d2-9226-47ea-9b41-5c80ead5d432 admin admin] PATH_INFO: `/v3/domains` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:53.817433 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44149d2-9226-47ea-9b41-5c80ead5d432 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:26:53.817749 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44149d2-9226-47ea-9b41-5c80ead5d432 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:53.819380 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44149d2-9226-47ea-9b41-5c80ead5d432 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:53.834279 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1135/2267] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 16 17:26:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:26:53.835233 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44149d2-9226-47ea-9b41-5c80ead5d432 admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:53.835425 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-54a7e5e5-2dcb-46f7-b072-13ae13e08326 admin admin] The token cache is being invalidate because project 17a0856ef6f742868310badf743ae2fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80873) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 17:26:53.835831 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-54a7e5e5-2dcb-46f7-b072-13ae13e08326 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:53.836481 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-54a7e5e5-2dcb-46f7-b072-13ae13e08326 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:53.838082 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1133/2268] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 16 17:26:53 2022] DELETE /identity/v3/projects/17a0856ef6f742868310badf743ae2fa => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 17:26:53.844278 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9391218e-be6d-41f7-b45b-2fe471abb0ef None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:53.844582 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9391218e-be6d-41f7-b45b-2fe471abb0ef None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:53.844857 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9391218e-be6d-41f7-b45b-2fe471abb0ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:53.845361 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44149d2-9226-47ea-9b41-5c80ead5d432 admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:53.850200 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd75bba-a310-4f45-92ef-b16cd0907325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:53.850852 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd75bba-a310-4f45-92ef-b16cd0907325 admin admin] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:53.851154 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd75bba-a310-4f45-92ef-b16cd0907325 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:53.851436 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd75bba-a310-4f45-92ef-b16cd0907325 admin admin] PATH_INFO: `/v3/projects` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:53.852131 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd75bba-a310-4f45-92ef-b16cd0907325 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:53.854627 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd75bba-a310-4f45-92ef-b16cd0907325 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:53.863881 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-9391218e-be6d-41f7-b45b-2fe471abb0ef None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:26:53.869804 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-9391218e-be6d-41f7-b45b-2fe471abb0ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:53.873996 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1134/2269] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:26:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:26:53.883315 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d546a508-08e9-4876-b316-6abaf993b2bf None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:53.883618 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d546a508-08e9-4876-b316-6abaf993b2bf None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:53.883904 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d546a508-08e9-4876-b316-6abaf993b2bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:53.906766 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:26:53.912282 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-d546a508-08e9-4876-b316-6abaf993b2bf None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:26:53.913509 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-d546a508-08e9-4876-b316-6abaf993b2bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:53.922649 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1135/2270] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:26:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 17:26:53.926904 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d546a508-08e9-4876-b316-6abaf993b2bf None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:53.937920 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d546a508-08e9-4876-b316-6abaf993b2bf None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:53.942844 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f4c04a-8bbe-4899-8ce7-afac8b26a58a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:53.943504 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f4c04a-8bbe-4899-8ce7-afac8b26a58a admin admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:53.943791 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f4c04a-8bbe-4899-8ce7-afac8b26a58a admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:53.944071 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f4c04a-8bbe-4899-8ce7-afac8b26a58a admin admin] PATH_INFO: `/v3/domains` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:53.944813 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f4c04a-8bbe-4899-8ce7-afac8b26a58a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80873) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:26:53.945166 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f4c04a-8bbe-4899-8ce7-afac8b26a58a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:53.946807 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f4c04a-8bbe-4899-8ce7-afac8b26a58a admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:53.959930 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1136/2271] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 16 17:26:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 17:26:53.964208 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f4c04a-8bbe-4899-8ce7-afac8b26a58a admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:53.974176 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f4c04a-8bbe-4899-8ce7-afac8b26a58a admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:53.982505 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1136/2272] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 16 17:26:53 2022] POST /identity/v3/projects => generated 391 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:26:53.982734 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dbc361-fea1-462b-ac70-7e45e86a3477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:53.982734 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dbc361-fea1-462b-ac70-7e45e86a3477 admin admin] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:53.982734 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dbc361-fea1-462b-ac70-7e45e86a3477 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:53.982734 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dbc361-fea1-462b-ac70-7e45e86a3477 admin admin] PATH_INFO: `/v3/projects` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:53.983097 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dbc361-fea1-462b-ac70-7e45e86a3477 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:53.983462 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd75bba-a310-4f45-92ef-b16cd0907325 admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:53.983573 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dbc361-fea1-462b-ac70-7e45e86a3477 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:53.985155 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-3cd75bba-a310-4f45-92ef-b16cd0907325 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:54.049040 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd75bba-a310-4f45-92ef-b16cd0907325 admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:54.053968 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc2631c-ba35-4bbf-b9de-8dd7111550c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:54.054753 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc2631c-ba35-4bbf-b9de-8dd7111550c6 admin admin] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:54.055052 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc2631c-ba35-4bbf-b9de-8dd7111550c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:54.055339 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc2631c-ba35-4bbf-b9de-8dd7111550c6 admin admin] PATH_INFO: `/v3/users` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:54.056047 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc2631c-ba35-4bbf-b9de-8dd7111550c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:54.058620 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc2631c-ba35-4bbf-b9de-8dd7111550c6 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:54.099902 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1137/2273] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 16 17:26:53 2022] POST /identity/v3/projects => generated 377 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 17:26:54.112246 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dbc361-fea1-462b-ac70-7e45e86a3477 admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:54.180175 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dbc361-fea1-462b-ac70-7e45e86a3477 admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:54.186213 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e17e5e8-00e6-41c1-b414-802f0e7ba972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:54.186953 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e17e5e8-00e6-41c1-b414-802f0e7ba972 admin admin] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:54.187246 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e17e5e8-00e6-41c1-b414-802f0e7ba972 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:54.187669 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e17e5e8-00e6-41c1-b414-802f0e7ba972 admin admin] PATH_INFO: `/v3/users` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:54.188321 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e17e5e8-00e6-41c1-b414-802f0e7ba972 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:54.190336 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e17e5e8-00e6-41c1-b414-802f0e7ba972 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:54.238264 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1137/2274] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 16 17:26:53 2022] POST /identity/v3/users => generated 296 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 17:26:54.251772 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc2631c-ba35-4bbf-b9de-8dd7111550c6 admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:54.262039 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc2631c-ba35-4bbf-b9de-8dd7111550c6 admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:54.266835 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f746596-1ef3-4057-8dc1-ea220778a2ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:54.267496 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f746596-1ef3-4057-8dc1-ea220778a2ee admin admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:54.267808 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f746596-1ef3-4057-8dc1-ea220778a2ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:54.268150 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f746596-1ef3-4057-8dc1-ea220778a2ee admin admin] PATH_INFO: `/v3/roles` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:54.270135 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f746596-1ef3-4057-8dc1-ea220778a2ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:54.272379 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f746596-1ef3-4057-8dc1-ea220778a2ee admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:54.283583 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1138/2275] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 17:26:54 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 17:26:54.287517 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f746596-1ef3-4057-8dc1-ea220778a2ee admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:54.297926 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f746596-1ef3-4057-8dc1-ea220778a2ee admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:54.302646 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b2078c-33a0-4587-b997-430e831333cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:54.303280 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b2078c-33a0-4587-b997-430e831333cf admin admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:54.303568 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b2078c-33a0-4587-b997-430e831333cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:54.303850 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b2078c-33a0-4587-b997-430e831333cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:54.304571 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b2078c-33a0-4587-b997-430e831333cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:54.306180 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b2078c-33a0-4587-b997-430e831333cf admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:54.317527 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1139/2276] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 17:26:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 17:26:54.325197 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b2078c-33a0-4587-b997-430e831333cf admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:54.335156 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b2078c-33a0-4587-b997-430e831333cf admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:54.340741 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56927bc9-5146-4141-b3ce-d0fa959c9862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:54.341651 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56927bc9-5146-4141-b3ce-d0fa959c9862 admin admin] REQUEST_METHOD: `PUT` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:54.341958 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56927bc9-5146-4141-b3ce-d0fa959c9862 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:54.342407 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56927bc9-5146-4141-b3ce-d0fa959c9862 admin admin] PATH_INFO: `/v3/projects/d93522c6d85a4f8f9bcac0c50ace5f30/users/205f8092521e47ad8eb63f837ea4ba9e/roles/896bff49c5d6464eb612a15f4aa9badc` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:54.352637 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1138/2277] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 16 17:26:54 2022] POST /identity/v3/users => generated 289 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 17:26:54.360540 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56927bc9-5146-4141-b3ce-d0fa959c9862 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d93522c6d85a4f8f9bcac0c50ace5f30, user_id=205f8092521e47ad8eb63f837ea4ba9e, role_id=896bff49c5d6464eb612a15f4aa9badc)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:54.360540 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56927bc9-5146-4141-b3ce-d0fa959c9862 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:54.361933 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e17e5e8-00e6-41c1-b414-802f0e7ba972 admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:54.372803 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e17e5e8-00e6-41c1-b414-802f0e7ba972 admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:54.377654 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816f1707-0fae-464e-8933-b03072f174d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:54.378345 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816f1707-0fae-464e-8933-b03072f174d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:54.378639 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816f1707-0fae-464e-8933-b03072f174d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:54.378967 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816f1707-0fae-464e-8933-b03072f174d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:54.379671 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816f1707-0fae-464e-8933-b03072f174d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:54.381256 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816f1707-0fae-464e-8933-b03072f174d2 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:54.393728 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1139/2278] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 17:26:54 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 17:26:54.397676 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816f1707-0fae-464e-8933-b03072f174d2 admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:54.408056 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816f1707-0fae-464e-8933-b03072f174d2 admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:54.412799 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5121a523-a7c3-4fbc-9e8a-992a6211a417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:54.413434 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5121a523-a7c3-4fbc-9e8a-992a6211a417 admin admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:54.413726 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5121a523-a7c3-4fbc-9e8a-992a6211a417 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:54.414045 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5121a523-a7c3-4fbc-9e8a-992a6211a417 admin admin] PATH_INFO: `/v3/roles` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:54.414765 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5121a523-a7c3-4fbc-9e8a-992a6211a417 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:54.416361 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5121a523-a7c3-4fbc-9e8a-992a6211a417 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:54.427107 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1140/2279] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 17:26:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 17:26:54.432492 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5121a523-a7c3-4fbc-9e8a-992a6211a417 admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:54.442159 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5121a523-a7c3-4fbc-9e8a-992a6211a417 admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:54.447002 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e30afe-eeb1-4501-b820-0434c3c0c94e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:54.448646 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e30afe-eeb1-4501-b820-0434c3c0c94e admin admin] REQUEST_METHOD: `PUT` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:54.448939 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e30afe-eeb1-4501-b820-0434c3c0c94e admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:54.449220 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e30afe-eeb1-4501-b820-0434c3c0c94e admin admin] PATH_INFO: `/v3/projects/fe0179a15c2d4aef8caf25bc5cfa45dd/users/53dd0f55ea154ec9942dd6aa4a9e4329/roles/896bff49c5d6464eb612a15f4aa9badc` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:54.464951 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1140/2280] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 17:26:54 2022] PUT /identity/v3/projects/d93522c6d85a4f8f9bcac0c50ace5f30/users/205f8092521e47ad8eb63f837ea4ba9e/roles/896bff49c5d6464eb612a15f4aa9badc => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 17:26:54.468439 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e30afe-eeb1-4501-b820-0434c3c0c94e admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe0179a15c2d4aef8caf25bc5cfa45dd, user_id=53dd0f55ea154ec9942dd6aa4a9e4329, role_id=896bff49c5d6464eb612a15f4aa9badc)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:54.468569 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e30afe-eeb1-4501-b820-0434c3c0c94e admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:54.478550 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f1c333-28fc-484c-8edf-8c077b468d1d None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:54.478751 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f1c333-28fc-484c-8edf-8c077b468d1d None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:54.479069 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f1c333-28fc-484c-8edf-8c077b468d1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:54.505812 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-02f1c333-28fc-484c-8edf-8c077b468d1d None None] MFA Rules not processed for user `205f8092521e47ad8eb63f837ea4ba9e`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:26:54.507025 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-02f1c333-28fc-484c-8edf-8c077b468d1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:54.577471 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1141/2282] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:26:54 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:26:54.578429 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1141/2282] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 17:26:54 2022] PUT /identity/v3/projects/fe0179a15c2d4aef8caf25bc5cfa45dd/users/53dd0f55ea154ec9942dd6aa4a9e4329/roles/896bff49c5d6464eb612a15f4aa9badc => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 17:26:54.579525 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88d4363-641c-4fb9-909d-9c516f7be965 None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:54.579914 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88d4363-641c-4fb9-909d-9c516f7be965 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:54.580312 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88d4363-641c-4fb9-909d-9c516f7be965 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:54.611682 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-e88d4363-641c-4fb9-909d-9c516f7be965 None None] MFA Rules not processed for user `53dd0f55ea154ec9942dd6aa4a9e4329`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:26:54.612998 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-e88d4363-641c-4fb9-909d-9c516f7be965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:54.621978 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e30afe-eeb1-4501-b820-0434c3c0c94e admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:54.623742 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-b0e30afe-eeb1-4501-b820-0434c3c0c94e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:54.688601 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e30afe-eeb1-4501-b820-0434c3c0c94e admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:54.691919 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1142/2283] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:26:54 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:26:54.692692 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227db54b-2536-4c83-b30c-5a4c42530498 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef37136b89d34edc9cd94c7aa81b2095', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:54.693421 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227db54b-2536-4c83-b30c-5a4c42530498 service cinder] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:54.693743 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227db54b-2536-4c83-b30c-5a4c42530498 service cinder] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:54.694056 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227db54b-2536-4c83-b30c-5a4c42530498 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:54.755278 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227db54b-2536-4c83-b30c-5a4c42530498 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:54.758140 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227db54b-2536-4c83-b30c-5a4c42530498 service cinder] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:54.766892 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1142/2284] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:26:54 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:26:54.859518 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88d4363-641c-4fb9-909d-9c516f7be965 None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:54.861476 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-e88d4363-641c-4fb9-909d-9c516f7be965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:54.874446 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88d4363-641c-4fb9-909d-9c516f7be965 None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:54.878790 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bcaf6a-5e11-4371-8b17-38633291d4f3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef37136b89d34edc9cd94c7aa81b2095', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:54.879283 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bcaf6a-5e11-4371-8b17-38633291d4f3 service cinder] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:54.879786 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bcaf6a-5e11-4371-8b17-38633291d4f3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:54.880161 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bcaf6a-5e11-4371-8b17-38633291d4f3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:54.911946 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bcaf6a-5e11-4371-8b17-38633291d4f3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:54.913403 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bcaf6a-5e11-4371-8b17-38633291d4f3 service cinder] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:54.923355 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1143/2285] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:26:54 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:26:55.024972 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:26:55.588558 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:26:55.979015 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227db54b-2536-4c83-b30c-5a4c42530498 service cinder] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:55.981412 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-227db54b-2536-4c83-b30c-5a4c42530498 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:56.071591 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227db54b-2536-4c83-b30c-5a4c42530498 service cinder] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:56.077819 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd315a8c-93d4-410e-97ab-84a17e7182de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:56.079027 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd315a8c-93d4-410e-97ab-84a17e7182de admin admin] REQUEST_METHOD: `DELETE` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:56.079415 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd315a8c-93d4-410e-97ab-84a17e7182de admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:56.079803 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd315a8c-93d4-410e-97ab-84a17e7182de admin admin] PATH_INFO: `/v3/users/7632ca9541e442ec81f116e45836691c` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:56.081436 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd315a8c-93d4-410e-97ab-84a17e7182de admin admin] RBAC: Authorizing `identity:delete_user(user_id=7632ca9541e442ec81f116e45836691c)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:56.083516 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd315a8c-93d4-410e-97ab-84a17e7182de admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:56.204386 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:26:56.317131 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-dd315a8c-93d4-410e-97ab-84a17e7182de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7632ca9541e442ec81f116e45836691c'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:56.317987 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-dd315a8c-93d4-410e-97ab-84a17e7182de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7632ca9541e442ec81f116e45836691c'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:56.318863 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-dd315a8c-93d4-410e-97ab-84a17e7182de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7632ca9541e442ec81f116e45836691c'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:56.395386 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-dd315a8c-93d4-410e-97ab-84a17e7182de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7632ca9541e442ec81f116e45836691c'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:56.403555 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-dd315a8c-93d4-410e-97ab-84a17e7182de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7632ca9541e442ec81f116e45836691c'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:56.421925 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1143/2286] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 16 17:26:55 2022] DELETE /identity/v3/users/7632ca9541e442ec81f116e45836691c => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:26:56.426508 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3203726-6a02-47c0-87b1-90c64f4eecdb None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:56.426803 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3203726-6a02-47c0-87b1-90c64f4eecdb None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:56.427086 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3203726-6a02-47c0-87b1-90c64f4eecdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:56.445700 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-a3203726-6a02-47c0-87b1-90c64f4eecdb None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:26:56.447061 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-a3203726-6a02-47c0-87b1-90c64f4eecdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:56.513208 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1144/2287] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:26:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 17:26:56.520250 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd315a8c-93d4-410e-97ab-84a17e7182de admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:56.521746 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-dd315a8c-93d4-410e-97ab-84a17e7182de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:56.585421 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd315a8c-93d4-410e-97ab-84a17e7182de admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:56.589115 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b41bfc-0b58-40ad-ba5f-2c951e48fb6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5d25bfa8dc042329d57cd55fa7b7b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:56.592023 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b41bfc-0b58-40ad-ba5f-2c951e48fb6c service neutron] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:56.592023 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b41bfc-0b58-40ad-ba5f-2c951e48fb6c service neutron] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:56.592023 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b41bfc-0b58-40ad-ba5f-2c951e48fb6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:56.609475 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b41bfc-0b58-40ad-ba5f-2c951e48fb6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:56.610924 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b41bfc-0b58-40ad-ba5f-2c951e48fb6c service neutron] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:56.623711 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1144/2288] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:26:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:26:56.669976 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:26:56.771203 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:26:57.085243 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3203726-6a02-47c0-87b1-90c64f4eecdb None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:57.087087 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-a3203726-6a02-47c0-87b1-90c64f4eecdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:57.111630 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3203726-6a02-47c0-87b1-90c64f4eecdb None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:57.117336 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d40c42-0c88-4953-8dd4-4ab2d1b3272e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:57.118473 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d40c42-0c88-4953-8dd4-4ab2d1b3272e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:57.119390 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d40c42-0c88-4953-8dd4-4ab2d1b3272e admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:57.119832 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d40c42-0c88-4953-8dd4-4ab2d1b3272e admin admin] PATH_INFO: `/v3/projects/d8381a9e5fd84311807a1ff4f973af0d` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:57.121388 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d40c42-0c88-4953-8dd4-4ab2d1b3272e admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8381a9e5fd84311807a1ff4f973af0d)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:57.124983 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d40c42-0c88-4953-8dd4-4ab2d1b3272e admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:57.252189 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-42d40c42-0c88-4953-8dd4-4ab2d1b3272e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8381a9e5fd84311807a1ff4f973af0d', 'request_id': 'req-42d40c42-0c88-4953-8dd4-4ab2d1b3272e'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:57.258754 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-42d40c42-0c88-4953-8dd4-4ab2d1b3272e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8381a9e5fd84311807a1ff4f973af0d', 'request_id': 'req-42d40c42-0c88-4953-8dd4-4ab2d1b3272e'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:57.308306 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:26:57.359519 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-42d40c42-0c88-4953-8dd4-4ab2d1b3272e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8381a9e5fd84311807a1ff4f973af0d', 'request_id': 'req-42d40c42-0c88-4953-8dd4-4ab2d1b3272e'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:57.372091 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-42d40c42-0c88-4953-8dd4-4ab2d1b3272e admin admin] The token cache is being invalidate because project d8381a9e5fd84311807a1ff4f973af0d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80874) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 17:26:57.372375 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-42d40c42-0c88-4953-8dd4-4ab2d1b3272e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:57.373003 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-42d40c42-0c88-4953-8dd4-4ab2d1b3272e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:26:57.374610 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1145/2289] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 16 17:26:57 2022] DELETE /identity/v3/projects/d8381a9e5fd84311807a1ff4f973af0d => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:26:57.379546 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ea720c-a2bb-4b65-8a34-a4946d44167e None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:57.379837 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ea720c-a2bb-4b65-8a34-a4946d44167e None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:57.380121 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ea720c-a2bb-4b65-8a34-a4946d44167e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:57.398717 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-83ea720c-a2bb-4b65-8a34-a4946d44167e None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:26:57.399930 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-83ea720c-a2bb-4b65-8a34-a4946d44167e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:57.458599 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1145/2290] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:26:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:26:57.467456 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c916a9-1ba4-48b6-9338-a3f4bcf73877 None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:57.467777 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c916a9-1ba4-48b6-9338-a3f4bcf73877 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:57.468085 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c916a9-1ba4-48b6-9338-a3f4bcf73877 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:57.486985 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-08c916a9-1ba4-48b6-9338-a3f4bcf73877 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:26:57.488214 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-08c916a9-1ba4-48b6-9338-a3f4bcf73877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:57.497176 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1146/2291] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:26:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:26:57.501478 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ea720c-a2bb-4b65-8a34-a4946d44167e None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:57.511382 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ea720c-a2bb-4b65-8a34-a4946d44167e None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:57.515982 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0f5591-d737-4e87-a212-75a2672b68c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:57.516645 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0f5591-d737-4e87-a212-75a2672b68c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:57.516936 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0f5591-d737-4e87-a212-75a2672b68c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:57.517222 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0f5591-d737-4e87-a212-75a2672b68c6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:57.517990 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0f5591-d737-4e87-a212-75a2672b68c6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80873) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:26:57.518310 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0f5591-d737-4e87-a212-75a2672b68c6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:57.519981 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0f5591-d737-4e87-a212-75a2672b68c6 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:57.536416 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1146/2292] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 16 17:26:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:26:57.541289 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c916a9-1ba4-48b6-9338-a3f4bcf73877 None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:57.551369 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c916a9-1ba4-48b6-9338-a3f4bcf73877 None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:57.556093 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39878fc-14a5-459f-adb7-e2c939ed4786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:57.556746 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39878fc-14a5-459f-adb7-e2c939ed4786 admin admin] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:57.557031 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39878fc-14a5-459f-adb7-e2c939ed4786 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:57.557311 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39878fc-14a5-459f-adb7-e2c939ed4786 admin admin] PATH_INFO: `/v3/projects` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:57.558931 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39878fc-14a5-459f-adb7-e2c939ed4786 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:57.560612 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39878fc-14a5-459f-adb7-e2c939ed4786 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:57.694544 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1147/2293] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 16 17:26:57 2022] POST /identity/v3/projects => generated 373 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:26:57.699071 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0f5591-d737-4e87-a212-75a2672b68c6 admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:57.709517 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0f5591-d737-4e87-a212-75a2672b68c6 admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:57.710076 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:26:57.765334 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095a575c-0f29-41e9-b2d1-c07a06fcb85f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:57.765961 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095a575c-0f29-41e9-b2d1-c07a06fcb85f admin admin] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:57.766255 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095a575c-0f29-41e9-b2d1-c07a06fcb85f admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:57.766537 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095a575c-0f29-41e9-b2d1-c07a06fcb85f admin admin] PATH_INFO: `/v3/users` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:57.767229 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095a575c-0f29-41e9-b2d1-c07a06fcb85f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:57.769151 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095a575c-0f29-41e9-b2d1-c07a06fcb85f admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:57.939069 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1147/2294] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 16 17:26:57 2022] POST /identity/v3/users => generated 287 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:26:57.942144 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39878fc-14a5-459f-adb7-e2c939ed4786 admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:57.954756 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39878fc-14a5-459f-adb7-e2c939ed4786 admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:57.959994 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70b1a5a-6968-44d1-8303-87e6cadc10ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:57.960720 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70b1a5a-6968-44d1-8303-87e6cadc10ac admin admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:57.961012 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70b1a5a-6968-44d1-8303-87e6cadc10ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:57.961298 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70b1a5a-6968-44d1-8303-87e6cadc10ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:57.962071 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70b1a5a-6968-44d1-8303-87e6cadc10ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:57.963826 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70b1a5a-6968-44d1-8303-87e6cadc10ac admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:57.974896 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1148/2295] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 17:26:57 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:26:57.981948 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095a575c-0f29-41e9-b2d1-c07a06fcb85f admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:57.992584 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095a575c-0f29-41e9-b2d1-c07a06fcb85f admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:57.998220 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b803c680-9ec3-4e93-8da5-9906769c8b5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:57.998934 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b803c680-9ec3-4e93-8da5-9906769c8b5e admin admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:57.999224 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b803c680-9ec3-4e93-8da5-9906769c8b5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:57.999575 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b803c680-9ec3-4e93-8da5-9906769c8b5e admin admin] PATH_INFO: `/v3/roles` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:58.000385 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b803c680-9ec3-4e93-8da5-9906769c8b5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:58.002049 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b803c680-9ec3-4e93-8da5-9906769c8b5e admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:58.013435 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1148/2296] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 17:26:57 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:26:58.018446 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70b1a5a-6968-44d1-8303-87e6cadc10ac admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:58.018718 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:26:58.031081 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70b1a5a-6968-44d1-8303-87e6cadc10ac admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:58.034572 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f126c01d-5679-4363-a517-4bbe3d92ee2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:58.035500 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f126c01d-5679-4363-a517-4bbe3d92ee2c admin admin] REQUEST_METHOD: `PUT` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:58.035796 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f126c01d-5679-4363-a517-4bbe3d92ee2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:58.036138 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f126c01d-5679-4363-a517-4bbe3d92ee2c admin admin] PATH_INFO: `/v3/projects/1b7b401ec4b04a77986825916bad359c/users/d909ee5c33094b47bd5ed948905d2372/roles/896bff49c5d6464eb612a15f4aa9badc` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:58.062199 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f126c01d-5679-4363-a517-4bbe3d92ee2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b7b401ec4b04a77986825916bad359c, user_id=d909ee5c33094b47bd5ed948905d2372, role_id=896bff49c5d6464eb612a15f4aa9badc)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:58.062199 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f126c01d-5679-4363-a517-4bbe3d92ee2c admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:58.148453 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1149/2297] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 17:26:58 2022] PUT /identity/v3/projects/1b7b401ec4b04a77986825916bad359c/users/d909ee5c33094b47bd5ed948905d2372/roles/896bff49c5d6464eb612a15f4aa9badc => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 17:26:58.155793 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b45992-d064-473e-b6cb-a432af14725f None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:58.156219 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b45992-d064-473e-b6cb-a432af14725f None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:58.156581 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b45992-d064-473e-b6cb-a432af14725f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:58.186488 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-80b45992-d064-473e-b6cb-a432af14725f None None] MFA Rules not processed for user `d909ee5c33094b47bd5ed948905d2372`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:26:58.187702 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-80b45992-d064-473e-b6cb-a432af14725f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:58.258371 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1149/2298] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:26:58 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 17:26:58.301427 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f126c01d-5679-4363-a517-4bbe3d92ee2c admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:26:58.303353 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-f126c01d-5679-4363-a517-4bbe3d92ee2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:26:58.363532 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f126c01d-5679-4363-a517-4bbe3d92ee2c admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:26:58.367896 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f802b0-8651-4684-8878-0beef319ebcc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef37136b89d34edc9cd94c7aa81b2095', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:26:58.368607 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f802b0-8651-4684-8878-0beef319ebcc service cinder] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:26:58.368903 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f802b0-8651-4684-8878-0beef319ebcc service cinder] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:26:58.369200 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f802b0-8651-4684-8878-0beef319ebcc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:26:58.378924 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f802b0-8651-4684-8878-0beef319ebcc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:26:58.380541 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f802b0-8651-4684-8878-0beef319ebcc service cinder] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:26:58.391769 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1150/2299] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:26:58 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:26:58.967460 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:26:59.357638 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:26:59.794166 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:26:59.891437 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:27:00.651243 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:27:00.973642 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:27:01.650243 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b45992-d064-473e-b6cb-a432af14725f None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:27:01.650243 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-80b45992-d064-473e-b6cb-a432af14725f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:27:01.743784 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b45992-d064-473e-b6cb-a432af14725f None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:27:01.749023 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc863bf0-cea9-491b-8a1d-ae202a9d3bac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:27:01.750349 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc863bf0-cea9-491b-8a1d-ae202a9d3bac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:27:01.750694 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc863bf0-cea9-491b-8a1d-ae202a9d3bac admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:27:01.750985 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc863bf0-cea9-491b-8a1d-ae202a9d3bac admin admin] PATH_INFO: `/v3/users/1609f46dc6214756ba27539f82ae81d6` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:27:01.752201 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc863bf0-cea9-491b-8a1d-ae202a9d3bac admin admin] RBAC: Authorizing `identity:delete_user(user_id=1609f46dc6214756ba27539f82ae81d6)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:27:01.754715 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc863bf0-cea9-491b-8a1d-ae202a9d3bac admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:27:01.967886 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-dc863bf0-cea9-491b-8a1d-ae202a9d3bac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1609f46dc6214756ba27539f82ae81d6'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:27:01.968594 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-dc863bf0-cea9-491b-8a1d-ae202a9d3bac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1609f46dc6214756ba27539f82ae81d6'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:27:01.969201 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-dc863bf0-cea9-491b-8a1d-ae202a9d3bac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1609f46dc6214756ba27539f82ae81d6'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:27:02.087116 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-dc863bf0-cea9-491b-8a1d-ae202a9d3bac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1609f46dc6214756ba27539f82ae81d6'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:27:02.101514 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-dc863bf0-cea9-491b-8a1d-ae202a9d3bac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1609f46dc6214756ba27539f82ae81d6'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:27:02.116749 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1150/2300] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 16 17:27:01 2022] DELETE /identity/v3/users/1609f46dc6214756ba27539f82ae81d6 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:27:02.126955 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4e6633-ef6b-4174-853d-6767e3b3bd88 None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:27:02.127482 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4e6633-ef6b-4174-853d-6767e3b3bd88 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:27:02.127656 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4e6633-ef6b-4174-853d-6767e3b3bd88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:27:02.142374 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:27:02.146716 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-7d4e6633-ef6b-4174-853d-6767e3b3bd88 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:27:02.147943 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-7d4e6633-ef6b-4174-853d-6767e3b3bd88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:27:02.208838 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1151/2301] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:27:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:27:02.216836 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:27:02.219532 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc863bf0-cea9-491b-8a1d-ae202a9d3bac admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:27:02.221177 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-dc863bf0-cea9-491b-8a1d-ae202a9d3bac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:27:02.292269 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc863bf0-cea9-491b-8a1d-ae202a9d3bac admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:27:02.298780 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db3f48a-8dbe-4522-b171-64fcad5c8d88 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5d25bfa8dc042329d57cd55fa7b7b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:27:02.299449 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db3f48a-8dbe-4522-b171-64fcad5c8d88 service neutron] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:27:02.299988 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db3f48a-8dbe-4522-b171-64fcad5c8d88 service neutron] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:27:02.300669 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db3f48a-8dbe-4522-b171-64fcad5c8d88 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:27:02.315916 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db3f48a-8dbe-4522-b171-64fcad5c8d88 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:27:02.317609 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db3f48a-8dbe-4522-b171-64fcad5c8d88 service neutron] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:27:02.331234 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1151/2302] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:27:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:27:02.736774 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4e6633-ef6b-4174-853d-6767e3b3bd88 None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:27:02.739118 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-7d4e6633-ef6b-4174-853d-6767e3b3bd88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:27:02.772495 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4e6633-ef6b-4174-853d-6767e3b3bd88 None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:27:02.783201 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb7afe6-b653-4568-814c-d2b33d98e481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:27:02.801490 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb7afe6-b653-4568-814c-d2b33d98e481 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:27:02.801490 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb7afe6-b653-4568-814c-d2b33d98e481 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:27:02.801490 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb7afe6-b653-4568-814c-d2b33d98e481 admin admin] PATH_INFO: `/v3/projects/5e42defbdf734583b6b7c760f8ac34e7` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:27:02.801490 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb7afe6-b653-4568-814c-d2b33d98e481 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e42defbdf734583b6b7c760f8ac34e7)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:27:02.803963 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb7afe6-b653-4568-814c-d2b33d98e481 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:27:02.990591 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-0bb7afe6-b653-4568-814c-d2b33d98e481 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e42defbdf734583b6b7c760f8ac34e7', 'request_id': 'req-0bb7afe6-b653-4568-814c-d2b33d98e481'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:27:02.997078 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-0bb7afe6-b653-4568-814c-d2b33d98e481 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e42defbdf734583b6b7c760f8ac34e7', 'request_id': 'req-0bb7afe6-b653-4568-814c-d2b33d98e481'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:27:03.072949 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-0bb7afe6-b653-4568-814c-d2b33d98e481 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e42defbdf734583b6b7c760f8ac34e7', 'request_id': 'req-0bb7afe6-b653-4568-814c-d2b33d98e481'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:27:03.086593 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-0bb7afe6-b653-4568-814c-d2b33d98e481 admin admin] The token cache is being invalidate because project 5e42defbdf734583b6b7c760f8ac34e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80874) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 17:27:03.086918 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-0bb7afe6-b653-4568-814c-d2b33d98e481 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:27:03.087675 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-0bb7afe6-b653-4568-814c-d2b33d98e481 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:27:03.089320 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1152/2303] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 16 17:27:02 2022] DELETE /identity/v3/projects/5e42defbdf734583b6b7c760f8ac34e7 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:27:03.846028 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db3f48a-8dbe-4522-b171-64fcad5c8d88 service neutron] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:27:03.847625 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-8db3f48a-8dbe-4522-b171-64fcad5c8d88 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:27:03.863319 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db3f48a-8dbe-4522-b171-64fcad5c8d88 service neutron] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:27:03.891813 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:27:03.951442 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7139ef64-d021-45ad-85c2-b2d866d73bc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:27:03.952612 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7139ef64-d021-45ad-85c2-b2d866d73bc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:27:03.952906 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7139ef64-d021-45ad-85c2-b2d866d73bc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:27:03.953295 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7139ef64-d021-45ad-85c2-b2d866d73bc4 admin admin] PATH_INFO: `/v3/users/d909ee5c33094b47bd5ed948905d2372` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:27:03.954535 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7139ef64-d021-45ad-85c2-b2d866d73bc4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d909ee5c33094b47bd5ed948905d2372)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:27:03.956604 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7139ef64-d021-45ad-85c2-b2d866d73bc4 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:27:04.012736 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:27:04.102961 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-7139ef64-d021-45ad-85c2-b2d866d73bc4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd909ee5c33094b47bd5ed948905d2372'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:27:04.103790 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-7139ef64-d021-45ad-85c2-b2d866d73bc4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd909ee5c33094b47bd5ed948905d2372'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:27:04.105217 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-7139ef64-d021-45ad-85c2-b2d866d73bc4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd909ee5c33094b47bd5ed948905d2372'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:27:04.200764 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-7139ef64-d021-45ad-85c2-b2d866d73bc4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd909ee5c33094b47bd5ed948905d2372'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:27:04.208196 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-7139ef64-d021-45ad-85c2-b2d866d73bc4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd909ee5c33094b47bd5ed948905d2372'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:27:04.228522 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1152/2304] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 16 17:27:03 2022] DELETE /identity/v3/users/d909ee5c33094b47bd5ed948905d2372 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:27:04.233214 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4e4812-dd8b-4c8c-a591-aec8639cf7fe None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:27:04.233505 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4e4812-dd8b-4c8c-a591-aec8639cf7fe None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:27:04.233814 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4e4812-dd8b-4c8c-a591-aec8639cf7fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:27:04.254596 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-9d4e4812-dd8b-4c8c-a591-aec8639cf7fe None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:27:04.256082 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-9d4e4812-dd8b-4c8c-a591-aec8639cf7fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:27:04.331049 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1153/2305] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:27:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:27:04.342704 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7139ef64-d021-45ad-85c2-b2d866d73bc4 admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:27:04.345318 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-7139ef64-d021-45ad-85c2-b2d866d73bc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:27:04.441284 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7139ef64-d021-45ad-85c2-b2d866d73bc4 admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:27:04.445957 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf014b30-e945-4cb1-9694-498ce905d7b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5d25bfa8dc042329d57cd55fa7b7b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:27:04.448118 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf014b30-e945-4cb1-9694-498ce905d7b5 service neutron] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:27:04.448991 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf014b30-e945-4cb1-9694-498ce905d7b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:27:04.454751 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf014b30-e945-4cb1-9694-498ce905d7b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:27:04.474368 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf014b30-e945-4cb1-9694-498ce905d7b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:27:04.476753 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf014b30-e945-4cb1-9694-498ce905d7b5 service neutron] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:27:04.495748 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1153/2306] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:27:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 17:27:04.772712 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:27:04.941395 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4e4812-dd8b-4c8c-a591-aec8639cf7fe None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:27:04.943194 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-9d4e4812-dd8b-4c8c-a591-aec8639cf7fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:27:04.958030 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4e4812-dd8b-4c8c-a591-aec8639cf7fe None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:27:04.964572 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d311ab0-09bd-40ca-883c-d53ec819a25a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:27:04.965524 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d311ab0-09bd-40ca-883c-d53ec819a25a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:27:04.974871 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d311ab0-09bd-40ca-883c-d53ec819a25a admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:27:04.974871 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d311ab0-09bd-40ca-883c-d53ec819a25a admin admin] PATH_INFO: `/v3/projects/1b7b401ec4b04a77986825916bad359c` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:27:04.974871 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d311ab0-09bd-40ca-883c-d53ec819a25a admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b7b401ec4b04a77986825916bad359c)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:27:04.974871 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d311ab0-09bd-40ca-883c-d53ec819a25a admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:27:05.124912 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-9d311ab0-09bd-40ca-883c-d53ec819a25a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b7b401ec4b04a77986825916bad359c', 'request_id': 'req-9d311ab0-09bd-40ca-883c-d53ec819a25a'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:27:05.130427 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-9d311ab0-09bd-40ca-883c-d53ec819a25a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b7b401ec4b04a77986825916bad359c', 'request_id': 'req-9d311ab0-09bd-40ca-883c-d53ec819a25a'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:27:05.132811 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:27:05.244748 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-9d311ab0-09bd-40ca-883c-d53ec819a25a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b7b401ec4b04a77986825916bad359c', 'request_id': 'req-9d311ab0-09bd-40ca-883c-d53ec819a25a'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:27:05.257099 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-9d311ab0-09bd-40ca-883c-d53ec819a25a admin admin] The token cache is being invalidate because project 1b7b401ec4b04a77986825916bad359c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80874) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 17:27:05.257392 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-9d311ab0-09bd-40ca-883c-d53ec819a25a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:27:05.258074 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-9d311ab0-09bd-40ca-883c-d53ec819a25a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:27:05.259631 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1154/2307] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 16 17:27:04 2022] DELETE /identity/v3/projects/1b7b401ec4b04a77986825916bad359c => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:27:05.264797 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39909ad7-3883-4dc1-80e2-f6699a4bf390 None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:27:05.265099 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39909ad7-3883-4dc1-80e2-f6699a4bf390 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:27:05.265392 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39909ad7-3883-4dc1-80e2-f6699a4bf390 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:27:05.285155 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-39909ad7-3883-4dc1-80e2-f6699a4bf390 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:27:05.286511 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-39909ad7-3883-4dc1-80e2-f6699a4bf390 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:27:05.373819 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1154/2308] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:27:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:27:05.381837 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a75e33-a78e-4dfd-85d1-f381157de2e1 None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:27:05.382133 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a75e33-a78e-4dfd-85d1-f381157de2e1 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:27:05.382420 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a75e33-a78e-4dfd-85d1-f381157de2e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:27:05.401228 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-44a75e33-a78e-4dfd-85d1-f381157de2e1 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:27:05.403192 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-44a75e33-a78e-4dfd-85d1-f381157de2e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:27:05.411494 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1155/2309] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:27:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:27:05.415865 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39909ad7-3883-4dc1-80e2-f6699a4bf390 None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:27:05.426431 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39909ad7-3883-4dc1-80e2-f6699a4bf390 None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:27:05.431298 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7df374-51ad-46d1-9419-3a02ed0f4e1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:27:05.431952 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7df374-51ad-46d1-9419-3a02ed0f4e1d admin admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:27:05.432243 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7df374-51ad-46d1-9419-3a02ed0f4e1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:27:05.432548 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7df374-51ad-46d1-9419-3a02ed0f4e1d admin admin] PATH_INFO: `/v3/domains` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:27:05.433387 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7df374-51ad-46d1-9419-3a02ed0f4e1d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80873) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:27:05.433726 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7df374-51ad-46d1-9419-3a02ed0f4e1d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:27:05.435361 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7df374-51ad-46d1-9419-3a02ed0f4e1d admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:27:05.446780 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1155/2310] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 16 17:27:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 17:27:05.451445 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a75e33-a78e-4dfd-85d1-f381157de2e1 None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:27:05.460565 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a75e33-a78e-4dfd-85d1-f381157de2e1 None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:27:05.466228 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dfcbb6-eb85-45c3-977c-844f9500da4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:27:05.476388 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dfcbb6-eb85-45c3-977c-844f9500da4b admin admin] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:27:05.476388 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dfcbb6-eb85-45c3-977c-844f9500da4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:27:05.476388 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dfcbb6-eb85-45c3-977c-844f9500da4b admin admin] PATH_INFO: `/v3/projects` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:27:05.476388 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dfcbb6-eb85-45c3-977c-844f9500da4b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:27:05.476388 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dfcbb6-eb85-45c3-977c-844f9500da4b admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:27:05.592992 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1156/2311] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 16 17:27:05 2022] POST /identity/v3/projects => generated 385 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:27:05.594398 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7df374-51ad-46d1-9419-3a02ed0f4e1d admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:27:05.605808 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7df374-51ad-46d1-9419-3a02ed0f4e1d admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:27:05.610805 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:27:05.687981 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8609448-de12-4688-9d41-ae37c8895967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:27:05.688826 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8609448-de12-4688-9d41-ae37c8895967 admin admin] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:27:05.689192 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8609448-de12-4688-9d41-ae37c8895967 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:27:05.689913 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8609448-de12-4688-9d41-ae37c8895967 admin admin] PATH_INFO: `/v3/users` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:27:05.690550 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8609448-de12-4688-9d41-ae37c8895967 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:27:05.692883 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8609448-de12-4688-9d41-ae37c8895967 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:27:05.836471 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1156/2312] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 16 17:27:05 2022] POST /identity/v3/users => generated 293 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:27:05.840704 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dfcbb6-eb85-45c3-977c-844f9500da4b admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:27:05.853213 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dfcbb6-eb85-45c3-977c-844f9500da4b admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:27:05.858892 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602b28b4-0159-4e5c-b988-b355e026b2be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:27:05.859593 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602b28b4-0159-4e5c-b988-b355e026b2be admin admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:27:05.859884 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602b28b4-0159-4e5c-b988-b355e026b2be admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:27:05.860168 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602b28b4-0159-4e5c-b988-b355e026b2be admin admin] PATH_INFO: `/v3/roles` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:27:05.860911 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602b28b4-0159-4e5c-b988-b355e026b2be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:27:05.862918 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602b28b4-0159-4e5c-b988-b355e026b2be admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:27:05.873612 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1157/2313] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 17:27:05 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 17:27:05.878135 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8609448-de12-4688-9d41-ae37c8895967 admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:27:05.888936 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8609448-de12-4688-9d41-ae37c8895967 admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:27:05.895048 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00978d0-2f74-4c8e-a94f-1cc0d6e051bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:27:05.896017 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00978d0-2f74-4c8e-a94f-1cc0d6e051bd admin admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:27:05.896134 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00978d0-2f74-4c8e-a94f-1cc0d6e051bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:27:05.896367 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00978d0-2f74-4c8e-a94f-1cc0d6e051bd admin admin] PATH_INFO: `/v3/roles` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:27:05.897129 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00978d0-2f74-4c8e-a94f-1cc0d6e051bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:27:05.898856 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00978d0-2f74-4c8e-a94f-1cc0d6e051bd admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:27:05.909992 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1157/2314] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 17:27:05 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:27:05.914538 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602b28b4-0159-4e5c-b988-b355e026b2be admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:27:05.925587 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602b28b4-0159-4e5c-b988-b355e026b2be admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:27:05.930612 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45792278-fb50-40f7-acd2-ac3b8095eb24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:27:05.931510 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45792278-fb50-40f7-acd2-ac3b8095eb24 admin admin] REQUEST_METHOD: `PUT` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:27:05.931798 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45792278-fb50-40f7-acd2-ac3b8095eb24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:27:05.932085 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45792278-fb50-40f7-acd2-ac3b8095eb24 admin admin] PATH_INFO: `/v3/projects/ae99da376fc84c30b7c0b82718bb9edb/users/159509d122e34effb8ffc7cdae41cd40/roles/896bff49c5d6464eb612a15f4aa9badc` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:27:05.948242 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45792278-fb50-40f7-acd2-ac3b8095eb24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae99da376fc84c30b7c0b82718bb9edb, user_id=159509d122e34effb8ffc7cdae41cd40, role_id=896bff49c5d6464eb612a15f4aa9badc)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:27:05.950967 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45792278-fb50-40f7-acd2-ac3b8095eb24 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:27:05.989890 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:27:06.094264 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1158/2315] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 17:27:05 2022] PUT /identity/v3/projects/ae99da376fc84c30b7c0b82718bb9edb/users/159509d122e34effb8ffc7cdae41cd40/roles/896bff49c5d6464eb612a15f4aa9badc => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 17:27:06.106286 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6224c13c-6865-4e89-9ea9-e38b4ec82801 None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:27:06.106718 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6224c13c-6865-4e89-9ea9-e38b4ec82801 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:27:06.107090 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6224c13c-6865-4e89-9ea9-e38b4ec82801 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:27:06.138140 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-6224c13c-6865-4e89-9ea9-e38b4ec82801 None None] MFA Rules not processed for user `159509d122e34effb8ffc7cdae41cd40`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:27:06.139373 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-6224c13c-6865-4e89-9ea9-e38b4ec82801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:27:06.214637 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1158/2316] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:27:06 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:27:06.277374 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45792278-fb50-40f7-acd2-ac3b8095eb24 admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:27:06.279197 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-45792278-fb50-40f7-acd2-ac3b8095eb24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:27:06.347154 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45792278-fb50-40f7-acd2-ac3b8095eb24 admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:27:06.350834 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5ff19a-67e6-4dd5-a444-e197fcfede0f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef37136b89d34edc9cd94c7aa81b2095', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:27:06.351480 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5ff19a-67e6-4dd5-a444-e197fcfede0f service cinder] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:27:06.351766 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5ff19a-67e6-4dd5-a444-e197fcfede0f service cinder] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:27:06.352045 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5ff19a-67e6-4dd5-a444-e197fcfede0f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:27:06.361789 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5ff19a-67e6-4dd5-a444-e197fcfede0f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:27:06.363254 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5ff19a-67e6-4dd5-a444-e197fcfede0f service cinder] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:27:06.373784 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1159/2317] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:27:06 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:27:06.456481 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:27:06.641274 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:27:07.001523 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:27:07.411511 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:27:08.334886 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:27:08.413356 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:27:09.766436 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:27:09.794967 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:27:10.263432 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6224c13c-6865-4e89-9ea9-e38b4ec82801 None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:27:10.264969 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-6224c13c-6865-4e89-9ea9-e38b4ec82801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:27:10.319873 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5ff19a-67e6-4dd5-a444-e197fcfede0f service cinder] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:27:10.356703 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6224c13c-6865-4e89-9ea9-e38b4ec82801 None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:27:10.363292 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae5d79d-2f2e-4537-8249-adc393222d13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:27:10.363963 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae5d79d-2f2e-4537-8249-adc393222d13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:27:10.364993 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae5d79d-2f2e-4537-8249-adc393222d13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:27:10.365334 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae5d79d-2f2e-4537-8249-adc393222d13 admin admin] PATH_INFO: `/v3/users/205f8092521e47ad8eb63f837ea4ba9e` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:27:10.366862 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae5d79d-2f2e-4537-8249-adc393222d13 admin admin] RBAC: Authorizing `identity:delete_user(user_id=205f8092521e47ad8eb63f837ea4ba9e)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:27:10.369597 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae5d79d-2f2e-4537-8249-adc393222d13 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:27:10.418847 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5ff19a-67e6-4dd5-a444-e197fcfede0f service cinder] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:27:10.423879 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c470098-e8f5-47ac-8f7d-a79aefd86781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:27:10.424763 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c470098-e8f5-47ac-8f7d-a79aefd86781 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:27:10.426802 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c470098-e8f5-47ac-8f7d-a79aefd86781 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:27:10.426802 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c470098-e8f5-47ac-8f7d-a79aefd86781 admin admin] PATH_INFO: `/v3/users/159509d122e34effb8ffc7cdae41cd40` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:27:10.426802 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c470098-e8f5-47ac-8f7d-a79aefd86781 admin admin] RBAC: Authorizing `identity:delete_user(user_id=159509d122e34effb8ffc7cdae41cd40)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:27:10.429096 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c470098-e8f5-47ac-8f7d-a79aefd86781 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:27:10.599083 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:27:10.620874 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-1ae5d79d-2f2e-4537-8249-adc393222d13 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '205f8092521e47ad8eb63f837ea4ba9e'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:27:10.621579 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-1ae5d79d-2f2e-4537-8249-adc393222d13 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '205f8092521e47ad8eb63f837ea4ba9e'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:27:10.622218 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-1ae5d79d-2f2e-4537-8249-adc393222d13 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '205f8092521e47ad8eb63f837ea4ba9e'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:27:10.635100 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-2c470098-e8f5-47ac-8f7d-a79aefd86781 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '159509d122e34effb8ffc7cdae41cd40'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:27:10.643268 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-2c470098-e8f5-47ac-8f7d-a79aefd86781 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '159509d122e34effb8ffc7cdae41cd40'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:27:10.703201 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-1ae5d79d-2f2e-4537-8249-adc393222d13 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '205f8092521e47ad8eb63f837ea4ba9e'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:27:10.711285 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-1ae5d79d-2f2e-4537-8249-adc393222d13 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '205f8092521e47ad8eb63f837ea4ba9e'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:27:10.730249 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1159/2318] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 16 17:27:10 2022] DELETE /identity/v3/users/205f8092521e47ad8eb63f837ea4ba9e => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:27:10.734740 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a54273-8acc-4ded-85e1-0b104ea3b222 None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:27:10.738442 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a54273-8acc-4ded-85e1-0b104ea3b222 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:27:10.738442 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a54273-8acc-4ded-85e1-0b104ea3b222 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:27:10.752897 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-f5a54273-8acc-4ded-85e1-0b104ea3b222 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:27:10.754202 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-f5a54273-8acc-4ded-85e1-0b104ea3b222 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:27:10.754794 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-2c470098-e8f5-47ac-8f7d-a79aefd86781 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '159509d122e34effb8ffc7cdae41cd40'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:27:10.755462 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-2c470098-e8f5-47ac-8f7d-a79aefd86781 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '159509d122e34effb8ffc7cdae41cd40'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:27:10.770692 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-2c470098-e8f5-47ac-8f7d-a79aefd86781 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '159509d122e34effb8ffc7cdae41cd40'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:27:10.778968 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1160/2319] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 16 17:27:10 2022] DELETE /identity/v3/users/159509d122e34effb8ffc7cdae41cd40 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:27:10.784747 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4c5db3-b7d8-462c-9bb2-43df24791aee None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:27:10.785135 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4c5db3-b7d8-462c-9bb2-43df24791aee None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:27:10.785432 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4c5db3-b7d8-462c-9bb2-43df24791aee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:27:10.806219 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-9b4c5db3-b7d8-462c-9bb2-43df24791aee None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:27:10.807609 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-9b4c5db3-b7d8-462c-9bb2-43df24791aee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:27:10.818278 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1160/2320] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:27:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 17:27:10.827746 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a54273-8acc-4ded-85e1-0b104ea3b222 None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:27:10.829494 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-f5a54273-8acc-4ded-85e1-0b104ea3b222 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:27:10.839585 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=86,keystone:INSERT=2,keystone:DELETE=12 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:27:10.878787 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1161/2321] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:27:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:27:10.885734 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4c5db3-b7d8-462c-9bb2-43df24791aee None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:27:10.888873 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-9b4c5db3-b7d8-462c-9bb2-43df24791aee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:27:10.921862 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a54273-8acc-4ded-85e1-0b104ea3b222 None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:27:10.962688 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4c5db3-b7d8-462c-9bb2-43df24791aee None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:27:10.967518 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d7e694-fb98-4d9c-bf1a-3650b5b5a99e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5d25bfa8dc042329d57cd55fa7b7b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:27:10.968332 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d7e694-fb98-4d9c-bf1a-3650b5b5a99e service neutron] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:27:10.968623 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d7e694-fb98-4d9c-bf1a-3650b5b5a99e service neutron] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:27:10.969074 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d7e694-fb98-4d9c-bf1a-3650b5b5a99e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:27:10.980462 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d7e694-fb98-4d9c-bf1a-3650b5b5a99e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:27:10.980664 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d7e694-fb98-4d9c-bf1a-3650b5b5a99e service neutron] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:27:10.987125 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9beb4fc2-6981-47ea-a557-0c15b0fa8c38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5d25bfa8dc042329d57cd55fa7b7b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:27:10.987980 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beb4fc2-6981-47ea-a557-0c15b0fa8c38 service neutron] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:27:10.988265 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beb4fc2-6981-47ea-a557-0c15b0fa8c38 service neutron] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:27:10.988562 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beb4fc2-6981-47ea-a557-0c15b0fa8c38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:27:10.991032 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1162/2322] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:27:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:27:10.998786 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9beb4fc2-6981-47ea-a557-0c15b0fa8c38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:27:11.000277 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9beb4fc2-6981-47ea-a557-0c15b0fa8c38 service neutron] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:27:11.011674 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1161/2323] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:27:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 17:27:11.596424 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:INSERT=2,keystone:DELETE=3,keystone:SELECT=95 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:27:11.640653 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d7e694-fb98-4d9c-bf1a-3650b5b5a99e service neutron] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:27:11.642643 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-d6d7e694-fb98-4d9c-bf1a-3650b5b5a99e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:27:11.647958 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9beb4fc2-6981-47ea-a557-0c15b0fa8c38 service neutron] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:27:11.649546 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-9beb4fc2-6981-47ea-a557-0c15b0fa8c38 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:27:11.663704 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d7e694-fb98-4d9c-bf1a-3650b5b5a99e service neutron] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:27:11.671715 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f65a96-cd2d-4118-9947-b245a50acc24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:27:11.673251 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f65a96-cd2d-4118-9947-b245a50acc24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:27:11.673895 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f65a96-cd2d-4118-9947-b245a50acc24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:27:11.674506 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f65a96-cd2d-4118-9947-b245a50acc24 admin admin] PATH_INFO: `/v3/projects/d93522c6d85a4f8f9bcac0c50ace5f30` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:27:11.674929 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9beb4fc2-6981-47ea-a557-0c15b0fa8c38 service neutron] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:27:11.676383 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f65a96-cd2d-4118-9947-b245a50acc24 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d93522c6d85a4f8f9bcac0c50ace5f30)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:27:11.678994 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f65a96-cd2d-4118-9947-b245a50acc24 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:27:11.679929 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75da1f8-32e5-499e-8075-3b7874c472fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:27:11.680811 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75da1f8-32e5-499e-8075-3b7874c472fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:27:11.681100 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75da1f8-32e5-499e-8075-3b7874c472fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:27:11.681411 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75da1f8-32e5-499e-8075-3b7874c472fe admin admin] PATH_INFO: `/v3/projects/ae99da376fc84c30b7c0b82718bb9edb` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:27:11.683031 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75da1f8-32e5-499e-8075-3b7874c472fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae99da376fc84c30b7c0b82718bb9edb)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:27:11.685610 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75da1f8-32e5-499e-8075-3b7874c472fe admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:27:11.925268 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-86f65a96-cd2d-4118-9947-b245a50acc24 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd93522c6d85a4f8f9bcac0c50ace5f30', 'request_id': 'req-86f65a96-cd2d-4118-9947-b245a50acc24'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:27:11.930930 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:27:11.934464 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-86f65a96-cd2d-4118-9947-b245a50acc24 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd93522c6d85a4f8f9bcac0c50ace5f30', 'request_id': 'req-86f65a96-cd2d-4118-9947-b245a50acc24'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:27:11.964922 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-f75da1f8-32e5-499e-8075-3b7874c472fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae99da376fc84c30b7c0b82718bb9edb', 'request_id': 'req-f75da1f8-32e5-499e-8075-3b7874c472fe'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:27:11.972515 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-f75da1f8-32e5-499e-8075-3b7874c472fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae99da376fc84c30b7c0b82718bb9edb', 'request_id': 'req-f75da1f8-32e5-499e-8075-3b7874c472fe'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:27:11.978658 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-f75da1f8-32e5-499e-8075-3b7874c472fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae99da376fc84c30b7c0b82718bb9edb', 'request_id': 'req-f75da1f8-32e5-499e-8075-3b7874c472fe'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:27:12.040587 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-86f65a96-cd2d-4118-9947-b245a50acc24 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd93522c6d85a4f8f9bcac0c50ace5f30', 'request_id': 'req-86f65a96-cd2d-4118-9947-b245a50acc24'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:27:12.054257 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-86f65a96-cd2d-4118-9947-b245a50acc24 admin admin] The token cache is being invalidate because project d93522c6d85a4f8f9bcac0c50ace5f30 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80874) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 17:27:12.054560 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-86f65a96-cd2d-4118-9947-b245a50acc24 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:27:12.055775 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-86f65a96-cd2d-4118-9947-b245a50acc24 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:27:12.061954 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1163/2324] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 16 17:27:11 2022] DELETE /identity/v3/projects/d93522c6d85a4f8f9bcac0c50ace5f30 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:27:12.066984 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b40fbde-5b7e-451d-abf4-68c5fb066e64 None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:27:12.067360 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b40fbde-5b7e-451d-abf4-68c5fb066e64 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:27:12.067765 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b40fbde-5b7e-451d-abf4-68c5fb066e64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:27:12.094131 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-9b40fbde-5b7e-451d-abf4-68c5fb066e64 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:27:12.095559 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-9b40fbde-5b7e-451d-abf4-68c5fb066e64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:27:12.123025 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-f75da1f8-32e5-499e-8075-3b7874c472fe admin admin] The token cache is being invalidate because project ae99da376fc84c30b7c0b82718bb9edb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80873) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 17:27:12.123781 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-f75da1f8-32e5-499e-8075-3b7874c472fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:27:12.125264 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-f75da1f8-32e5-499e-8075-3b7874c472fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:27:12.127608 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1162/2325] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 16 17:27:11 2022] DELETE /identity/v3/projects/ae99da376fc84c30b7c0b82718bb9edb => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:27:12.185514 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1164/2326] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:27:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:27:12.197809 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97643b6-1815-4ae0-96e8-1a5540f5f81a None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:27:12.197809 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97643b6-1815-4ae0-96e8-1a5540f5f81a None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:27:12.197809 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97643b6-1815-4ae0-96e8-1a5540f5f81a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:27:12.215627 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-f97643b6-1815-4ae0-96e8-1a5540f5f81a None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:27:12.217566 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-f97643b6-1815-4ae0-96e8-1a5540f5f81a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:27:12.235074 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1163/2327] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:27:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:27:12.237966 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b40fbde-5b7e-451d-abf4-68c5fb066e64 None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:27:12.254528 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b40fbde-5b7e-451d-abf4-68c5fb066e64 None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:27:12.260001 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a22b2be-8a91-4c21-a415-976dbc6cd8bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:27:12.261558 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a22b2be-8a91-4c21-a415-976dbc6cd8bb admin admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:27:12.261891 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a22b2be-8a91-4c21-a415-976dbc6cd8bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:27:12.262176 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a22b2be-8a91-4c21-a415-976dbc6cd8bb admin admin] PATH_INFO: `/v3/domains` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:27:12.263227 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a22b2be-8a91-4c21-a415-976dbc6cd8bb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:27:12.264130 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a22b2be-8a91-4c21-a415-976dbc6cd8bb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:27:12.266206 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a22b2be-8a91-4c21-a415-976dbc6cd8bb admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:27:12.286910 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1165/2328] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 16 17:27:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:27:12.297379 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97643b6-1815-4ae0-96e8-1a5540f5f81a None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:27:12.305708 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97643b6-1815-4ae0-96e8-1a5540f5f81a None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:27:12.327066 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3d3d31-bcc4-4c62-891b-93fdfba0bff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:27:12.327747 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3d3d31-bcc4-4c62-891b-93fdfba0bff4 admin admin] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:27:12.328032 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3d3d31-bcc4-4c62-891b-93fdfba0bff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:27:12.328541 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3d3d31-bcc4-4c62-891b-93fdfba0bff4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:27:12.329258 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3d3d31-bcc4-4c62-891b-93fdfba0bff4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:27:12.331231 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3d3d31-bcc4-4c62-891b-93fdfba0bff4 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:27:12.438813 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1164/2329] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 16 17:27:12 2022] POST /identity/v3/projects => generated 399 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:27:12.440099 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a22b2be-8a91-4c21-a415-976dbc6cd8bb admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:27:12.452149 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a22b2be-8a91-4c21-a415-976dbc6cd8bb admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:27:12.516095 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913d5dbd-2b98-4f4e-98d2-8a170ad1e264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:27:12.516862 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913d5dbd-2b98-4f4e-98d2-8a170ad1e264 admin admin] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:27:12.517231 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913d5dbd-2b98-4f4e-98d2-8a170ad1e264 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:27:12.517591 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913d5dbd-2b98-4f4e-98d2-8a170ad1e264 admin admin] PATH_INFO: `/v3/users` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:27:12.518405 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913d5dbd-2b98-4f4e-98d2-8a170ad1e264 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:27:12.520928 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913d5dbd-2b98-4f4e-98d2-8a170ad1e264 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:27:12.596184 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1166/2330] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 16 17:27:12 2022] POST /identity/v3/users => generated 300 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:27:12.601507 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3d3d31-bcc4-4c62-891b-93fdfba0bff4 admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:27:12.612813 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3d3d31-bcc4-4c62-891b-93fdfba0bff4 admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:27:12.617581 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6784fe9-45db-4a80-ae7c-102683ef313e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:27:12.618306 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6784fe9-45db-4a80-ae7c-102683ef313e admin admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:27:12.618589 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6784fe9-45db-4a80-ae7c-102683ef313e admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:27:12.618871 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6784fe9-45db-4a80-ae7c-102683ef313e admin admin] PATH_INFO: `/v3/roles` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:27:12.619657 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6784fe9-45db-4a80-ae7c-102683ef313e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:27:12.621266 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6784fe9-45db-4a80-ae7c-102683ef313e admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:27:12.632420 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1165/2331] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 17:27:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 17:27:12.636601 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913d5dbd-2b98-4f4e-98d2-8a170ad1e264 admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:27:12.648886 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913d5dbd-2b98-4f4e-98d2-8a170ad1e264 admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:27:12.655357 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d75addf-78a0-42cd-bd29-2f6fb9a54aba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:27:12.656031 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d75addf-78a0-42cd-bd29-2f6fb9a54aba admin admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:27:12.656325 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d75addf-78a0-42cd-bd29-2f6fb9a54aba admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:27:12.656611 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d75addf-78a0-42cd-bd29-2f6fb9a54aba admin admin] PATH_INFO: `/v3/roles` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:27:12.657353 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d75addf-78a0-42cd-bd29-2f6fb9a54aba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:27:12.659010 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d75addf-78a0-42cd-bd29-2f6fb9a54aba admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:27:12.670121 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1167/2332] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 17:27:12 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:27:12.674407 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6784fe9-45db-4a80-ae7c-102683ef313e admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:27:12.686518 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6784fe9-45db-4a80-ae7c-102683ef313e admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:27:12.691049 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb109fb-1900-401f-9889-a1e4399aaa0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:27:12.691961 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb109fb-1900-401f-9889-a1e4399aaa0f admin admin] REQUEST_METHOD: `PUT` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:27:12.692255 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb109fb-1900-401f-9889-a1e4399aaa0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:27:12.692540 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb109fb-1900-401f-9889-a1e4399aaa0f admin admin] PATH_INFO: `/v3/projects/16ee41d0e64b484a8aa735990022897a/users/3e1937787c084c9e8c96af08da2f86d3/roles/896bff49c5d6464eb612a15f4aa9badc` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:27:12.709032 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb109fb-1900-401f-9889-a1e4399aaa0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=16ee41d0e64b484a8aa735990022897a, user_id=3e1937787c084c9e8c96af08da2f86d3, role_id=896bff49c5d6464eb612a15f4aa9badc)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:27:12.712058 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb109fb-1900-401f-9889-a1e4399aaa0f admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:27:12.863790 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1166/2333] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 17:27:12 2022] PUT /identity/v3/projects/16ee41d0e64b484a8aa735990022897a/users/3e1937787c084c9e8c96af08da2f86d3/roles/896bff49c5d6464eb612a15f4aa9badc => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:27:12.874542 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840a5160-cbaf-4805-a95c-2add13b15960 None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:27:12.874842 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840a5160-cbaf-4805-a95c-2add13b15960 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:27:12.875129 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840a5160-cbaf-4805-a95c-2add13b15960 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:27:12.916330 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-840a5160-cbaf-4805-a95c-2add13b15960 None None] MFA Rules not processed for user `3e1937787c084c9e8c96af08da2f86d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:27:12.928177 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-840a5160-cbaf-4805-a95c-2add13b15960 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:27:13.024259 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1168/2334] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:27:12 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:27:13.045401 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb109fb-1900-401f-9889-a1e4399aaa0f admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:27:13.047778 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-ecb109fb-1900-401f-9889-a1e4399aaa0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:27:13.122919 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb109fb-1900-401f-9889-a1e4399aaa0f admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:27:13.126659 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896db6c4-a060-4441-9a72-147de20e390b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef37136b89d34edc9cd94c7aa81b2095', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:27:13.127583 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896db6c4-a060-4441-9a72-147de20e390b service cinder] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:27:13.127885 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896db6c4-a060-4441-9a72-147de20e390b service cinder] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:27:13.128171 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896db6c4-a060-4441-9a72-147de20e390b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:27:13.138698 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896db6c4-a060-4441-9a72-147de20e390b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:27:13.140311 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896db6c4-a060-4441-9a72-147de20e390b service cinder] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:27:13.152068 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1167/2335] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:27:13 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:27:13.441816 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:27:14.023842 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:27:14.330374 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a962facd-1597-4645-bb88-990c00e27532 None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:27:14.330893 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a962facd-1597-4645-bb88-990c00e27532 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:27:14.331024 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a962facd-1597-4645-bb88-990c00e27532 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:27:14.348867 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-a962facd-1597-4645-bb88-990c00e27532 None None] MFA Rules not processed for user `695942c4783a4d45874ff48f29ff9638`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:27:14.350188 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-a962facd-1597-4645-bb88-990c00e27532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:27:14.411593 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1169/2336] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:27:14 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:27:14.653094 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896db6c4-a060-4441-9a72-147de20e390b service cinder] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:27:14.654681 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-896db6c4-a060-4441-9a72-147de20e390b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:27:14.725596 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896db6c4-a060-4441-9a72-147de20e390b service cinder] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:27:14.730328 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8556b3c4-7c74-48a6-9948-55d2758a37ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:27:14.731228 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8556b3c4-7c74-48a6-9948-55d2758a37ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:27:14.731512 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8556b3c4-7c74-48a6-9948-55d2758a37ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:27:14.731792 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8556b3c4-7c74-48a6-9948-55d2758a37ff admin admin] PATH_INFO: `/v3/users/53dd0f55ea154ec9942dd6aa4a9e4329` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:27:14.733106 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8556b3c4-7c74-48a6-9948-55d2758a37ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=53dd0f55ea154ec9942dd6aa4a9e4329)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:27:14.735102 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8556b3c4-7c74-48a6-9948-55d2758a37ff admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:27:14.968594 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-8556b3c4-7c74-48a6-9948-55d2758a37ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53dd0f55ea154ec9942dd6aa4a9e4329'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:27:14.970168 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-8556b3c4-7c74-48a6-9948-55d2758a37ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53dd0f55ea154ec9942dd6aa4a9e4329'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:27:14.970948 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-8556b3c4-7c74-48a6-9948-55d2758a37ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53dd0f55ea154ec9942dd6aa4a9e4329'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:27:15.056121 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-8556b3c4-7c74-48a6-9948-55d2758a37ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53dd0f55ea154ec9942dd6aa4a9e4329'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:27:15.064192 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-8556b3c4-7c74-48a6-9948-55d2758a37ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53dd0f55ea154ec9942dd6aa4a9e4329'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:27:15.083013 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1168/2337] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 16 17:27:14 2022] DELETE /identity/v3/users/53dd0f55ea154ec9942dd6aa4a9e4329 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:27:15.087703 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bb377f-41cf-4ebb-95a7-5a20260803e3 None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:27:15.088001 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bb377f-41cf-4ebb-95a7-5a20260803e3 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:27:15.088314 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bb377f-41cf-4ebb-95a7-5a20260803e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:27:15.107815 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-d6bb377f-41cf-4ebb-95a7-5a20260803e3 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:27:15.109028 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-d6bb377f-41cf-4ebb-95a7-5a20260803e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:27:15.173891 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1170/2338] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:27:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:27:15.184204 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8556b3c4-7c74-48a6-9948-55d2758a37ff admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:27:15.185696 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-8556b3c4-7c74-48a6-9948-55d2758a37ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:27:15.252252 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8556b3c4-7c74-48a6-9948-55d2758a37ff admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:27:15.256068 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed13df2b-6dfd-4006-84ba-52149e77e25d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5d25bfa8dc042329d57cd55fa7b7b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:27:15.256720 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed13df2b-6dfd-4006-84ba-52149e77e25d service neutron] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:27:15.257010 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed13df2b-6dfd-4006-84ba-52149e77e25d service neutron] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:27:15.260870 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed13df2b-6dfd-4006-84ba-52149e77e25d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:27:15.267751 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed13df2b-6dfd-4006-84ba-52149e77e25d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:27:15.269191 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed13df2b-6dfd-4006-84ba-52149e77e25d service neutron] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:27:15.279384 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1169/2339] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:27:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:27:15.586667 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bb377f-41cf-4ebb-95a7-5a20260803e3 None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:27:15.588420 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-d6bb377f-41cf-4ebb-95a7-5a20260803e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:27:15.600642 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bb377f-41cf-4ebb-95a7-5a20260803e3 None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:27:15.606230 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a874ce-51f3-4824-8a15-ea2a07e2d6e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:27:15.607244 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a874ce-51f3-4824-8a15-ea2a07e2d6e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:27:15.607538 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a874ce-51f3-4824-8a15-ea2a07e2d6e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:27:15.607824 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a874ce-51f3-4824-8a15-ea2a07e2d6e3 admin admin] PATH_INFO: `/v3/users/1d19aa8713f34803b0239d3a64c220bc` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:27:15.616191 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a874ce-51f3-4824-8a15-ea2a07e2d6e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d19aa8713f34803b0239d3a64c220bc)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:27:15.618235 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a874ce-51f3-4824-8a15-ea2a07e2d6e3 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:27:15.846445 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed13df2b-6dfd-4006-84ba-52149e77e25d service neutron] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:27:15.852384 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-ed13df2b-6dfd-4006-84ba-52149e77e25d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:27:15.867770 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-70a874ce-51f3-4824-8a15-ea2a07e2d6e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d19aa8713f34803b0239d3a64c220bc'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:27:15.876541 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-70a874ce-51f3-4824-8a15-ea2a07e2d6e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d19aa8713f34803b0239d3a64c220bc'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:27:15.881088 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed13df2b-6dfd-4006-84ba-52149e77e25d service neutron] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:27:15.894800 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8998ea1a-989f-4906-b350-23aba987b10c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:27:15.895939 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8998ea1a-989f-4906-b350-23aba987b10c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:27:15.903623 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8998ea1a-989f-4906-b350-23aba987b10c admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:27:15.903623 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8998ea1a-989f-4906-b350-23aba987b10c admin admin] PATH_INFO: `/v3/projects/fe0179a15c2d4aef8caf25bc5cfa45dd` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:27:15.903623 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8998ea1a-989f-4906-b350-23aba987b10c admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe0179a15c2d4aef8caf25bc5cfa45dd)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:27:15.903623 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8998ea1a-989f-4906-b350-23aba987b10c admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:27:15.931853 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:27:15.966158 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-70a874ce-51f3-4824-8a15-ea2a07e2d6e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d19aa8713f34803b0239d3a64c220bc'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:27:15.966864 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-70a874ce-51f3-4824-8a15-ea2a07e2d6e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d19aa8713f34803b0239d3a64c220bc'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:27:15.980324 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-70a874ce-51f3-4824-8a15-ea2a07e2d6e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d19aa8713f34803b0239d3a64c220bc'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:27:15.987243 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1171/2340] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 16 17:27:15 2022] DELETE /identity/v3/users/1d19aa8713f34803b0239d3a64c220bc => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:27:15.991947 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504fe560-e1ef-4038-a69e-4833dd4a29c3 None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:27:15.991947 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504fe560-e1ef-4038-a69e-4833dd4a29c3 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:27:15.992179 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504fe560-e1ef-4038-a69e-4833dd4a29c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:27:16.009638 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-504fe560-e1ef-4038-a69e-4833dd4a29c3 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:27:16.011895 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-504fe560-e1ef-4038-a69e-4833dd4a29c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:27:16.028136 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-8998ea1a-989f-4906-b350-23aba987b10c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe0179a15c2d4aef8caf25bc5cfa45dd', 'request_id': 'req-8998ea1a-989f-4906-b350-23aba987b10c'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:27:16.034670 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-8998ea1a-989f-4906-b350-23aba987b10c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe0179a15c2d4aef8caf25bc5cfa45dd', 'request_id': 'req-8998ea1a-989f-4906-b350-23aba987b10c'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:27:16.040648 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-8998ea1a-989f-4906-b350-23aba987b10c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe0179a15c2d4aef8caf25bc5cfa45dd', 'request_id': 'req-8998ea1a-989f-4906-b350-23aba987b10c'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:27:16.082739 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1172/2341] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:27:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 17:27:16.093114 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504fe560-e1ef-4038-a69e-4833dd4a29c3 None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:27:16.094576 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-504fe560-e1ef-4038-a69e-4833dd4a29c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:27:16.136032 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-8998ea1a-989f-4906-b350-23aba987b10c admin admin] The token cache is being invalidate because project fe0179a15c2d4aef8caf25bc5cfa45dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80873) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 17:27:16.136330 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-8998ea1a-989f-4906-b350-23aba987b10c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:27:16.136960 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-8998ea1a-989f-4906-b350-23aba987b10c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:27:16.141968 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1170/2342] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 16 17:27:15 2022] DELETE /identity/v3/projects/fe0179a15c2d4aef8caf25bc5cfa45dd => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 17:27:16.143315 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32ca9b5-90f8-4358-bb5a-de7940dff9bd None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:27:16.143603 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32ca9b5-90f8-4358-bb5a-de7940dff9bd None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:27:16.144000 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32ca9b5-90f8-4358-bb5a-de7940dff9bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:27:16.155186 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504fe560-e1ef-4038-a69e-4833dd4a29c3 None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:27:16.159233 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76e99c8-f3e6-4f21-aa80-1e1009ffb708 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5d25bfa8dc042329d57cd55fa7b7b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:27:16.159892 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76e99c8-f3e6-4f21-aa80-1e1009ffb708 service neutron] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:27:16.160213 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76e99c8-f3e6-4f21-aa80-1e1009ffb708 service neutron] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:27:16.160500 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76e99c8-f3e6-4f21-aa80-1e1009ffb708 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:27:16.162358 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-d76e99c8-f3e6-4f21-aa80-1e1009ffb708 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:27:16.162486 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-f32ca9b5-90f8-4358-bb5a-de7940dff9bd None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:27:16.163647 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-f32ca9b5-90f8-4358-bb5a-de7940dff9bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:27:16.171907 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1171/2343] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:27:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:27:16.175761 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76e99c8-f3e6-4f21-aa80-1e1009ffb708 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:27:16.177233 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76e99c8-f3e6-4f21-aa80-1e1009ffb708 service neutron] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:27:16.180044 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd0b39c-94af-433c-ac16-e0ced08b8733 None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:27:16.180341 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd0b39c-94af-433c-ac16-e0ced08b8733 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:27:16.180629 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd0b39c-94af-433c-ac16-e0ced08b8733 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:27:16.187435 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1173/2344] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:27:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 17:27:16.203182 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-2fd0b39c-94af-433c-ac16-e0ced08b8733 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:27:16.210467 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-2fd0b39c-94af-433c-ac16-e0ced08b8733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:27:16.216414 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1172/2345] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:27:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 17:27:16.217540 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76e99c8-f3e6-4f21-aa80-1e1009ffb708 service neutron] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:27:16.227121 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76e99c8-f3e6-4f21-aa80-1e1009ffb708 service neutron] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:27:16.232135 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6003444f-f312-482e-a8d3-029e3f1c6710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:27:16.232802 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6003444f-f312-482e-a8d3-029e3f1c6710 admin admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:27:16.233300 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6003444f-f312-482e-a8d3-029e3f1c6710 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:27:16.233416 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6003444f-f312-482e-a8d3-029e3f1c6710 admin admin] PATH_INFO: `/v3/domains` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:27:16.234182 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6003444f-f312-482e-a8d3-029e3f1c6710 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:27:16.234502 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6003444f-f312-482e-a8d3-029e3f1c6710 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:27:16.236120 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6003444f-f312-482e-a8d3-029e3f1c6710 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:27:16.250482 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1174/2346] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 16 17:27:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 17:27:16.254682 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd0b39c-94af-433c-ac16-e0ced08b8733 None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:27:16.267597 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd0b39c-94af-433c-ac16-e0ced08b8733 None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:27:16.279672 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91cdc57-c3d6-4757-8b5f-6b106c3a7ed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:27:16.279672 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91cdc57-c3d6-4757-8b5f-6b106c3a7ed4 admin admin] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:27:16.279672 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91cdc57-c3d6-4757-8b5f-6b106c3a7ed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:27:16.279672 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91cdc57-c3d6-4757-8b5f-6b106c3a7ed4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:27:16.280017 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91cdc57-c3d6-4757-8b5f-6b106c3a7ed4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:27:16.280017 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91cdc57-c3d6-4757-8b5f-6b106c3a7ed4 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:27:16.394808 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1173/2347] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 16 17:27:16 2022] POST /identity/v3/projects => generated 373 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:27:16.397108 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6003444f-f312-482e-a8d3-029e3f1c6710 admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:27:16.402045 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:27:16.421633 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6003444f-f312-482e-a8d3-029e3f1c6710 admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:27:16.529034 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c3cd5f-e9dc-4ed3-83c0-90a5b9a8a8ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:27:16.530259 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c3cd5f-e9dc-4ed3-83c0-90a5b9a8a8ff admin admin] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:27:16.530822 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c3cd5f-e9dc-4ed3-83c0-90a5b9a8a8ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:27:16.531366 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c3cd5f-e9dc-4ed3-83c0-90a5b9a8a8ff admin admin] PATH_INFO: `/v3/users` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:27:16.534350 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c3cd5f-e9dc-4ed3-83c0-90a5b9a8a8ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:27:16.537962 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c3cd5f-e9dc-4ed3-83c0-90a5b9a8a8ff admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:27:16.650863 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1175/2348] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 16 17:27:16 2022] POST /identity/v3/users => generated 287 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:27:16.653326 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91cdc57-c3d6-4757-8b5f-6b106c3a7ed4 admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:27:16.663874 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91cdc57-c3d6-4757-8b5f-6b106c3a7ed4 admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:27:16.668545 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d869b7-8453-4cc5-98d5-be9d84dc599a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:27:16.669212 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d869b7-8453-4cc5-98d5-be9d84dc599a admin admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:27:16.669496 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d869b7-8453-4cc5-98d5-be9d84dc599a admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:27:16.669797 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d869b7-8453-4cc5-98d5-be9d84dc599a admin admin] PATH_INFO: `/v3/roles` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:27:16.670532 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d869b7-8453-4cc5-98d5-be9d84dc599a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:27:16.672117 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d869b7-8453-4cc5-98d5-be9d84dc599a admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:27:16.683404 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1174/2349] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 17:27:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:27:16.694378 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c3cd5f-e9dc-4ed3-83c0-90a5b9a8a8ff admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:27:16.705695 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c3cd5f-e9dc-4ed3-83c0-90a5b9a8a8ff admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:27:16.710578 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bbb2f5-bee2-43ce-a6c0-41aa9c0b7048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:27:16.711239 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bbb2f5-bee2-43ce-a6c0-41aa9c0b7048 admin admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:27:16.711526 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bbb2f5-bee2-43ce-a6c0-41aa9c0b7048 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:27:16.711809 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bbb2f5-bee2-43ce-a6c0-41aa9c0b7048 admin admin] PATH_INFO: `/v3/roles` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:27:16.712534 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bbb2f5-bee2-43ce-a6c0-41aa9c0b7048 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:27:16.715363 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bbb2f5-bee2-43ce-a6c0-41aa9c0b7048 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:27:16.722166 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d869b7-8453-4cc5-98d5-be9d84dc599a admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:27:16.723941 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-64d869b7-8453-4cc5-98d5-be9d84dc599a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:27:16.730246 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1176/2350] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 17:27:16 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:27:16.734653 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bbb2f5-bee2-43ce-a6c0-41aa9c0b7048 admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:27:16.741073 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d869b7-8453-4cc5-98d5-be9d84dc599a admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:27:16.754710 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45219cea-9136-4415-9052-4ac30a2a5dd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:27:16.755517 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45219cea-9136-4415-9052-4ac30a2a5dd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:27:16.755810 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45219cea-9136-4415-9052-4ac30a2a5dd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:27:16.756149 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45219cea-9136-4415-9052-4ac30a2a5dd4 admin admin] PATH_INFO: `/v3/projects/1334ab378fab45a1b7de0f37d0563a31` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:27:16.757412 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45219cea-9136-4415-9052-4ac30a2a5dd4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1334ab378fab45a1b7de0f37d0563a31)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:27:16.757662 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bbb2f5-bee2-43ce-a6c0-41aa9c0b7048 admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:27:16.759437 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45219cea-9136-4415-9052-4ac30a2a5dd4 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:27:16.763650 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc68813-0da4-4a9a-bdb5-30b4dab6b6b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:27:16.764551 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc68813-0da4-4a9a-bdb5-30b4dab6b6b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:27:16.764843 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc68813-0da4-4a9a-bdb5-30b4dab6b6b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:27:16.765285 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc68813-0da4-4a9a-bdb5-30b4dab6b6b7 admin admin] PATH_INFO: `/v3/projects/3d980b5b4c2e4145977436054db819c0/users/c0c8406fdc684b2bb71bb3a76b01258e/roles/896bff49c5d6464eb612a15f4aa9badc` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:27:16.783150 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc68813-0da4-4a9a-bdb5-30b4dab6b6b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d980b5b4c2e4145977436054db819c0, user_id=c0c8406fdc684b2bb71bb3a76b01258e, role_id=896bff49c5d6464eb612a15f4aa9badc)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:27:16.785851 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc68813-0da4-4a9a-bdb5-30b4dab6b6b7 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:27:16.877685 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1177/2351] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 17:27:16 2022] PUT /identity/v3/projects/3d980b5b4c2e4145977436054db819c0/users/c0c8406fdc684b2bb71bb3a76b01258e/roles/896bff49c5d6464eb612a15f4aa9badc => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 17:27:16.883173 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-45219cea-9136-4415-9052-4ac30a2a5dd4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1334ab378fab45a1b7de0f37d0563a31', 'request_id': 'req-45219cea-9136-4415-9052-4ac30a2a5dd4'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:27:16.883895 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7cfcb4-3241-4a2b-8219-0215765b34ae None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:27:16.884526 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7cfcb4-3241-4a2b-8219-0215765b34ae None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:27:16.884900 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7cfcb4-3241-4a2b-8219-0215765b34ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:27:16.895177 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-45219cea-9136-4415-9052-4ac30a2a5dd4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1334ab378fab45a1b7de0f37d0563a31', 'request_id': 'req-45219cea-9136-4415-9052-4ac30a2a5dd4'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:27:16.901933 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-45219cea-9136-4415-9052-4ac30a2a5dd4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1334ab378fab45a1b7de0f37d0563a31', 'request_id': 'req-45219cea-9136-4415-9052-4ac30a2a5dd4'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:27:16.909209 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-0d7cfcb4-3241-4a2b-8219-0215765b34ae None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:27:16.910629 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-0d7cfcb4-3241-4a2b-8219-0215765b34ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:27:16.989990 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1178/2352] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:27:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:27:16.999874 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7cfcb4-3241-4a2b-8219-0215765b34ae None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:27:17.001314 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-0d7cfcb4-3241-4a2b-8219-0215765b34ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:27:17.059627 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7cfcb4-3241-4a2b-8219-0215765b34ae None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:27:17.063325 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277d89e6-f781-4f81-8d2c-1e950ad8ad0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5d25bfa8dc042329d57cd55fa7b7b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:27:17.063978 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277d89e6-f781-4f81-8d2c-1e950ad8ad0b service neutron] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:27:17.064265 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277d89e6-f781-4f81-8d2c-1e950ad8ad0b service neutron] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:27:17.064553 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277d89e6-f781-4f81-8d2c-1e950ad8ad0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:27:17.074978 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277d89e6-f781-4f81-8d2c-1e950ad8ad0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:27:17.076431 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277d89e6-f781-4f81-8d2c-1e950ad8ad0b service neutron] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:27:17.086299 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1179/2353] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:27:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 17:27:17.127005 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-45219cea-9136-4415-9052-4ac30a2a5dd4 admin admin] The token cache is being invalidate because project 1334ab378fab45a1b7de0f37d0563a31 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80873) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 17:27:17.127295 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-45219cea-9136-4415-9052-4ac30a2a5dd4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:27:17.127922 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-45219cea-9136-4415-9052-4ac30a2a5dd4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:27:17.129460 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1175/2354] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 16 17:27:16 2022] DELETE /identity/v3/projects/1334ab378fab45a1b7de0f37d0563a31 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 17:27:17.133532 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277d89e6-f781-4f81-8d2c-1e950ad8ad0b service neutron] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:27:17.144036 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277d89e6-f781-4f81-8d2c-1e950ad8ad0b service neutron] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:27:17.148782 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36809132-41cd-423c-bd4d-9c2cc96dd893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:27:17.149643 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36809132-41cd-423c-bd4d-9c2cc96dd893 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:27:17.149992 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36809132-41cd-423c-bd4d-9c2cc96dd893 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:27:17.150281 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36809132-41cd-423c-bd4d-9c2cc96dd893 admin admin] PATH_INFO: `/v3/users/7745dea329a3447d982dc216fa9ccbef` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:27:17.151515 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36809132-41cd-423c-bd4d-9c2cc96dd893 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7745dea329a3447d982dc216fa9ccbef)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:27:17.153583 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36809132-41cd-423c-bd4d-9c2cc96dd893 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:27:17.418615 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-36809132-41cd-423c-bd4d-9c2cc96dd893 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7745dea329a3447d982dc216fa9ccbef'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:27:17.427591 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-36809132-41cd-423c-bd4d-9c2cc96dd893 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7745dea329a3447d982dc216fa9ccbef'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:27:17.543341 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-36809132-41cd-423c-bd4d-9c2cc96dd893 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7745dea329a3447d982dc216fa9ccbef'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:27:17.543946 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-36809132-41cd-423c-bd4d-9c2cc96dd893 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7745dea329a3447d982dc216fa9ccbef'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:27:17.556705 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-36809132-41cd-423c-bd4d-9c2cc96dd893 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7745dea329a3447d982dc216fa9ccbef'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:27:17.562760 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1180/2355] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 16 17:27:17 2022] DELETE /identity/v3/users/7745dea329a3447d982dc216fa9ccbef => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:27:18.126556 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:27:18.174689 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45219cea-9136-4415-9052-4ac30a2a5dd4 admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:27:18.176922 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-45219cea-9136-4415-9052-4ac30a2a5dd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:27:18.198941 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45219cea-9136-4415-9052-4ac30a2a5dd4 admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:27:18.253260 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=82,keystone:INSERT=5,keystone:DELETE=13 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:27:18.303837 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5240dd1b-2fd9-458b-a94c-53330968c409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:27:18.305487 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5240dd1b-2fd9-458b-a94c-53330968c409 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:27:18.306046 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5240dd1b-2fd9-458b-a94c-53330968c409 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:27:18.306577 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5240dd1b-2fd9-458b-a94c-53330968c409 admin admin] PATH_INFO: `/v3/projects/56ac111c8eec45c1a81138fc253548a6` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:27:18.310185 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5240dd1b-2fd9-458b-a94c-53330968c409 admin admin] RBAC: Authorizing `identity:delete_project(project_id=56ac111c8eec45c1a81138fc253548a6)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:27:18.312277 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5240dd1b-2fd9-458b-a94c-53330968c409 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:27:18.519589 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-5240dd1b-2fd9-458b-a94c-53330968c409 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56ac111c8eec45c1a81138fc253548a6', 'request_id': 'req-5240dd1b-2fd9-458b-a94c-53330968c409'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:27:18.539176 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-5240dd1b-2fd9-458b-a94c-53330968c409 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56ac111c8eec45c1a81138fc253548a6', 'request_id': 'req-5240dd1b-2fd9-458b-a94c-53330968c409'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:27:18.553641 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-5240dd1b-2fd9-458b-a94c-53330968c409 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56ac111c8eec45c1a81138fc253548a6', 'request_id': 'req-5240dd1b-2fd9-458b-a94c-53330968c409'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:27:18.691319 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-5240dd1b-2fd9-458b-a94c-53330968c409 admin admin] The token cache is being invalidate because project 56ac111c8eec45c1a81138fc253548a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80873) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 17:27:18.691616 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-5240dd1b-2fd9-458b-a94c-53330968c409 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:27:18.692284 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-5240dd1b-2fd9-458b-a94c-53330968c409 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:27:18.694138 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1176/2356] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 16 17:27:18 2022] DELETE /identity/v3/projects/56ac111c8eec45c1a81138fc253548a6 => generated 0 bytes in 520 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:27:18.699844 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3d00f1-96bf-4254-ba71-c1a15c08a2fb None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:27:18.700144 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3d00f1-96bf-4254-ba71-c1a15c08a2fb None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:27:18.700431 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3d00f1-96bf-4254-ba71-c1a15c08a2fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:27:18.719964 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-af3d00f1-96bf-4254-ba71-c1a15c08a2fb None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:27:18.726951 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-af3d00f1-96bf-4254-ba71-c1a15c08a2fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:27:18.788523 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1181/2357] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:27:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:27:18.797097 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe1c0d7-75b9-45cd-ac31-b7178eb65fd5 None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:27:18.797809 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe1c0d7-75b9-45cd-ac31-b7178eb65fd5 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:27:18.798179 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe1c0d7-75b9-45cd-ac31-b7178eb65fd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:27:18.822008 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-0fe1c0d7-75b9-45cd-ac31-b7178eb65fd5 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:27:18.824195 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-0fe1c0d7-75b9-45cd-ac31-b7178eb65fd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:27:18.834019 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1177/2358] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:27:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:27:18.838922 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3d00f1-96bf-4254-ba71-c1a15c08a2fb None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:27:18.849649 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3d00f1-96bf-4254-ba71-c1a15c08a2fb None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:27:18.868011 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae95df0c-cd72-4969-b651-cad69e82b484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:27:18.868011 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae95df0c-cd72-4969-b651-cad69e82b484 admin admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:27:18.868011 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae95df0c-cd72-4969-b651-cad69e82b484 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:27:18.868011 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae95df0c-cd72-4969-b651-cad69e82b484 admin admin] PATH_INFO: `/v3/domains` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:27:18.868422 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae95df0c-cd72-4969-b651-cad69e82b484 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:27:18.868422 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae95df0c-cd72-4969-b651-cad69e82b484 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:27:18.868928 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae95df0c-cd72-4969-b651-cad69e82b484 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:27:18.902470 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1182/2359] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 16 17:27:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:27:18.903711 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe1c0d7-75b9-45cd-ac31-b7178eb65fd5 None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:27:18.915843 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe1c0d7-75b9-45cd-ac31-b7178eb65fd5 None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:27:18.930522 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3261e40b-1955-49f0-aaca-ee3cd45adbd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:27:18.933093 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3261e40b-1955-49f0-aaca-ee3cd45adbd0 admin admin] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:27:18.933698 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3261e40b-1955-49f0-aaca-ee3cd45adbd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:27:18.934842 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3261e40b-1955-49f0-aaca-ee3cd45adbd0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:27:18.936175 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3261e40b-1955-49f0-aaca-ee3cd45adbd0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:27:18.938574 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3261e40b-1955-49f0-aaca-ee3cd45adbd0 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:27:18.961957 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a76f1d-c09c-430b-8362-a6667627b4d9 None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:27:18.962260 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a76f1d-c09c-430b-8362-a6667627b4d9 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:27:18.962551 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a76f1d-c09c-430b-8362-a6667627b4d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:27:19.021156 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-33a76f1d-c09c-430b-8362-a6667627b4d9 None None] MFA Rules not processed for user `c0c8406fdc684b2bb71bb3a76b01258e`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:27:19.022609 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-33a76f1d-c09c-430b-8362-a6667627b4d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:27:19.078660 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1178/2360] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 16 17:27:18 2022] POST /identity/v3/projects => generated 409 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:27:19.083756 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3261e40b-1955-49f0-aaca-ee3cd45adbd0 admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:27:19.200439 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3261e40b-1955-49f0-aaca-ee3cd45adbd0 admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:27:19.208055 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9aa3ab-d7dc-4a90-b15c-5076b658af9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:27:19.209132 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9aa3ab-d7dc-4a90-b15c-5076b658af9f admin admin] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:27:19.209829 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9aa3ab-d7dc-4a90-b15c-5076b658af9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:27:19.210268 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9aa3ab-d7dc-4a90-b15c-5076b658af9f admin admin] PATH_INFO: `/v3/users` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:27:19.211154 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9aa3ab-d7dc-4a90-b15c-5076b658af9f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:27:19.214398 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9aa3ab-d7dc-4a90-b15c-5076b658af9f admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:27:19.233659 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1183/2361] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:27:18 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:27:19.246139 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a76f1d-c09c-430b-8362-a6667627b4d9 None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:27:19.247590 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-33a76f1d-c09c-430b-8362-a6667627b4d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:27:19.363597 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1179/2362] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 16 17:27:19 2022] POST /identity/v3/users => generated 305 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:27:19.370935 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9aa3ab-d7dc-4a90-b15c-5076b658af9f admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:27:19.379922 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a76f1d-c09c-430b-8362-a6667627b4d9 None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:27:19.382079 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9aa3ab-d7dc-4a90-b15c-5076b658af9f admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:27:19.388239 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afb99ec-7e13-46ba-bbaf-1a243b753e30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:27:19.389208 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afb99ec-7e13-46ba-bbaf-1a243b753e30 admin admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:27:19.393623 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afb99ec-7e13-46ba-bbaf-1a243b753e30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:27:19.393623 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afb99ec-7e13-46ba-bbaf-1a243b753e30 admin admin] PATH_INFO: `/v3/roles` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:27:19.393623 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afb99ec-7e13-46ba-bbaf-1a243b753e30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:27:19.393623 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afb99ec-7e13-46ba-bbaf-1a243b753e30 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:27:19.414692 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1180/2363] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 17:27:19 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 17:27:19.419835 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afb99ec-7e13-46ba-bbaf-1a243b753e30 admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:27:19.439999 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afb99ec-7e13-46ba-bbaf-1a243b753e30 admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:27:19.444976 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e47f62d-fbc0-4908-bbd2-6c1d10e4f3f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:27:19.445822 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e47f62d-fbc0-4908-bbd2-6c1d10e4f3f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:27:19.446192 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e47f62d-fbc0-4908-bbd2-6c1d10e4f3f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:27:19.446808 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e47f62d-fbc0-4908-bbd2-6c1d10e4f3f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:27:19.448401 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e47f62d-fbc0-4908-bbd2-6c1d10e4f3f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:27:19.450293 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e47f62d-fbc0-4908-bbd2-6c1d10e4f3f7 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:27:19.463869 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1181/2364] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 17:27:19 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 17:27:19.469948 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e47f62d-fbc0-4908-bbd2-6c1d10e4f3f7 admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:27:19.481894 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e47f62d-fbc0-4908-bbd2-6c1d10e4f3f7 admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:27:19.488569 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a511fb6-a3c7-4f9a-b8f7-97d5f12792b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:27:19.489655 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a511fb6-a3c7-4f9a-b8f7-97d5f12792b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:27:19.489794 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2900cf-edfa-4192-b272-a39a93da1ff2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef37136b89d34edc9cd94c7aa81b2095', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:27:19.490268 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a511fb6-a3c7-4f9a-b8f7-97d5f12792b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:27:19.490604 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2900cf-edfa-4192-b272-a39a93da1ff2 service cinder] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:27:19.490719 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a511fb6-a3c7-4f9a-b8f7-97d5f12792b5 admin admin] PATH_INFO: `/v3/projects/a9bf81b66b3a45f4be061c707c040ab6/users/e54d335da4d34099a71b4d34a74fc698/roles/896bff49c5d6464eb612a15f4aa9badc` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:27:19.491729 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2900cf-edfa-4192-b272-a39a93da1ff2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:27:19.492174 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2900cf-edfa-4192-b272-a39a93da1ff2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:27:19.508747 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a511fb6-a3c7-4f9a-b8f7-97d5f12792b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9bf81b66b3a45f4be061c707c040ab6, user_id=e54d335da4d34099a71b4d34a74fc698, role_id=896bff49c5d6464eb612a15f4aa9badc)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:27:19.512590 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a511fb6-a3c7-4f9a-b8f7-97d5f12792b5 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:27:19.561991 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2900cf-edfa-4192-b272-a39a93da1ff2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:27:19.563498 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2900cf-edfa-4192-b272-a39a93da1ff2 service cinder] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:27:19.574411 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1184/2365] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:27:19 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:27:19.582812 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2900cf-edfa-4192-b272-a39a93da1ff2 service cinder] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:27:19.584271 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-0f2900cf-edfa-4192-b272-a39a93da1ff2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:27:19.599107 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2900cf-edfa-4192-b272-a39a93da1ff2 service cinder] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:27:19.605411 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9753c6d5-6d0b-45ff-97d3-8dfb9cdec325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:27:19.606596 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9753c6d5-6d0b-45ff-97d3-8dfb9cdec325 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:27:19.606784 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9753c6d5-6d0b-45ff-97d3-8dfb9cdec325 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:27:19.607031 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9753c6d5-6d0b-45ff-97d3-8dfb9cdec325 admin admin] PATH_INFO: `/v3/users/3e1937787c084c9e8c96af08da2f86d3` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:27:19.608263 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9753c6d5-6d0b-45ff-97d3-8dfb9cdec325 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e1937787c084c9e8c96af08da2f86d3)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:27:19.610293 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9753c6d5-6d0b-45ff-97d3-8dfb9cdec325 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:27:19.630156 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1182/2366] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 17:27:19 2022] PUT /identity/v3/projects/a9bf81b66b3a45f4be061c707c040ab6/users/e54d335da4d34099a71b4d34a74fc698/roles/896bff49c5d6464eb612a15f4aa9badc => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:27:19.641485 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e2827b-e6b1-4c4c-af20-1157f60deb7b None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:27:19.642141 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e2827b-e6b1-4c4c-af20-1157f60deb7b None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:27:19.642638 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e2827b-e6b1-4c4c-af20-1157f60deb7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:27:19.677267 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-10e2827b-e6b1-4c4c-af20-1157f60deb7b None None] MFA Rules not processed for user `e54d335da4d34099a71b4d34a74fc698`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:27:19.678713 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-10e2827b-e6b1-4c4c-af20-1157f60deb7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:27:19.749480 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1183/2367] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:27:19 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:27:19.753778 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e2827b-e6b1-4c4c-af20-1157f60deb7b None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:27:19.814608 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e2827b-e6b1-4c4c-af20-1157f60deb7b None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:27:19.819190 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4adbb0-9668-4df5-a54c-c1308a0bb37f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:27:19.819851 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4adbb0-9668-4df5-a54c-c1308a0bb37f admin admin] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:27:19.820140 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4adbb0-9668-4df5-a54c-c1308a0bb37f admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:27:19.820419 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4adbb0-9668-4df5-a54c-c1308a0bb37f admin admin] PATH_INFO: `/v3/projects` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:27:19.821111 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4adbb0-9668-4df5-a54c-c1308a0bb37f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:27:19.823942 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4adbb0-9668-4df5-a54c-c1308a0bb37f admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:27:19.913652 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-9753c6d5-6d0b-45ff-97d3-8dfb9cdec325 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e1937787c084c9e8c96af08da2f86d3'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:27:19.920802 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-9753c6d5-6d0b-45ff-97d3-8dfb9cdec325 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e1937787c084c9e8c96af08da2f86d3'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:27:19.945910 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1184/2368] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 16 17:27:19 2022] POST /identity/v3/projects => generated 407 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 17:27:19.950803 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4adbb0-9668-4df5-a54c-c1308a0bb37f admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:27:20.027040 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4adbb0-9668-4df5-a54c-c1308a0bb37f admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:27:20.029560 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-9753c6d5-6d0b-45ff-97d3-8dfb9cdec325 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e1937787c084c9e8c96af08da2f86d3'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:27:20.030618 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-9753c6d5-6d0b-45ff-97d3-8dfb9cdec325 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e1937787c084c9e8c96af08da2f86d3'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:27:20.032926 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5bf637-983e-4fc0-955c-c39dde1ac4b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:27:20.033612 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5bf637-983e-4fc0-955c-c39dde1ac4b1 admin admin] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:27:20.033941 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5bf637-983e-4fc0-955c-c39dde1ac4b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:27:20.034224 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5bf637-983e-4fc0-955c-c39dde1ac4b1 admin admin] PATH_INFO: `/v3/users` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:27:20.035123 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5bf637-983e-4fc0-955c-c39dde1ac4b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:27:20.037130 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5bf637-983e-4fc0-955c-c39dde1ac4b1 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:27:20.056019 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-9753c6d5-6d0b-45ff-97d3-8dfb9cdec325 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e1937787c084c9e8c96af08da2f86d3'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:27:20.065612 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1185/2369] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 16 17:27:19 2022] DELETE /identity/v3/users/3e1937787c084c9e8c96af08da2f86d3 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:27:20.069647 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8589c97-2505-4e37-8187-cce6dcbf4b39 None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:27:20.069965 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8589c97-2505-4e37-8187-cce6dcbf4b39 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:27:20.070253 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8589c97-2505-4e37-8187-cce6dcbf4b39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:27:20.088734 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-a8589c97-2505-4e37-8187-cce6dcbf4b39 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:27:20.098831 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-a8589c97-2505-4e37-8187-cce6dcbf4b39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:27:20.130664 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1185/2370] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 16 17:27:19 2022] POST /identity/v3/users => generated 310 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 17:27:20.135664 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5bf637-983e-4fc0-955c-c39dde1ac4b1 admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:27:20.138237 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-8a5bf637-983e-4fc0-955c-c39dde1ac4b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:27:20.151593 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5bf637-983e-4fc0-955c-c39dde1ac4b1 admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:27:20.155664 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1186/2371] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:27:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:27:20.156571 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef13d85-3dc1-44f2-bb91-c57353d4a558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:27:20.157258 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef13d85-3dc1-44f2-bb91-c57353d4a558 admin admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:27:20.160937 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef13d85-3dc1-44f2-bb91-c57353d4a558 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:27:20.160937 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef13d85-3dc1-44f2-bb91-c57353d4a558 admin admin] PATH_INFO: `/v3/roles` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:27:20.160937 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef13d85-3dc1-44f2-bb91-c57353d4a558 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:27:20.160937 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef13d85-3dc1-44f2-bb91-c57353d4a558 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:27:20.171354 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8589c97-2505-4e37-8187-cce6dcbf4b39 None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:27:20.172430 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1186/2372] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 17:27:20 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:27:20.173733 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-a8589c97-2505-4e37-8187-cce6dcbf4b39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:27:20.176705 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef13d85-3dc1-44f2-bb91-c57353d4a558 admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:27:20.187718 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef13d85-3dc1-44f2-bb91-c57353d4a558 admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:27:20.194091 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a34f54-4205-4840-9f05-a18001b763c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:27:20.194999 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a34f54-4205-4840-9f05-a18001b763c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:27:20.195291 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a34f54-4205-4840-9f05-a18001b763c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:27:20.195572 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a34f54-4205-4840-9f05-a18001b763c4 admin admin] PATH_INFO: `/v3/projects/06e4037d6bad4cc981455db28975007f/users/b05fdea4b06b46f1af50a65b0d28240d/roles/dba744f8ab2a4c45b9d3212f8d203aba` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:27:20.224675 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:INSERT=2,keystone:SELECT=88,keystone:DELETE=10 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:27:20.235772 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a34f54-4205-4840-9f05-a18001b763c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=06e4037d6bad4cc981455db28975007f, user_id=b05fdea4b06b46f1af50a65b0d28240d, role_id=dba744f8ab2a4c45b9d3212f8d203aba)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:27:20.241873 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a34f54-4205-4840-9f05-a18001b763c4 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:27:20.279497 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8589c97-2505-4e37-8187-cce6dcbf4b39 None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:27:20.287020 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25173e0e-4ada-4749-9f24-06a43821ed42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5d25bfa8dc042329d57cd55fa7b7b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:27:20.287020 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25173e0e-4ada-4749-9f24-06a43821ed42 service neutron] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:27:20.287020 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25173e0e-4ada-4749-9f24-06a43821ed42 service neutron] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:27:20.287020 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25173e0e-4ada-4749-9f24-06a43821ed42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:27:20.299303 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25173e0e-4ada-4749-9f24-06a43821ed42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:27:20.300773 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25173e0e-4ada-4749-9f24-06a43821ed42 service neutron] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:27:20.318191 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1187/2373] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:27:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 17:27:20.350444 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1187/2374] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 17:27:20 2022] PUT /identity/v3/projects/06e4037d6bad4cc981455db28975007f/users/b05fdea4b06b46f1af50a65b0d28240d/roles/dba744f8ab2a4c45b9d3212f8d203aba => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:27:20.355524 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25173e0e-4ada-4749-9f24-06a43821ed42 service neutron] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:27:20.371756 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25173e0e-4ada-4749-9f24-06a43821ed42 service neutron] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:27:20.408780 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:27:20.529969 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f89d59-1274-42e1-96e7-492579782bf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:27:20.530653 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f89d59-1274-42e1-96e7-492579782bf9 admin admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:27:20.530942 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f89d59-1274-42e1-96e7-492579782bf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:27:20.531223 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f89d59-1274-42e1-96e7-492579782bf9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:27:20.531960 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f89d59-1274-42e1-96e7-492579782bf9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:27:20.533566 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f89d59-1274-42e1-96e7-492579782bf9 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:27:20.569947 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1188/2375] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 17:27:20 2022] GET /identity/v3/roles => generated 1420 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:27:20.573377 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a34f54-4205-4840-9f05-a18001b763c4 admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:27:20.589118 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a34f54-4205-4840-9f05-a18001b763c4 admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:27:20.594978 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b508ff-fc5e-463e-a44d-2e18c659ba47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:27:20.598121 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b508ff-fc5e-463e-a44d-2e18c659ba47 admin admin] REQUEST_METHOD: `PUT` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:27:20.598121 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b508ff-fc5e-463e-a44d-2e18c659ba47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:27:20.598121 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b508ff-fc5e-463e-a44d-2e18c659ba47 admin admin] PATH_INFO: `/v3/projects/06e4037d6bad4cc981455db28975007f/users/b05fdea4b06b46f1af50a65b0d28240d/roles/dba744f8ab2a4c45b9d3212f8d203aba` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:27:20.599706 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b508ff-fc5e-463e-a44d-2e18c659ba47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=06e4037d6bad4cc981455db28975007f, user_id=b05fdea4b06b46f1af50a65b0d28240d, role_id=dba744f8ab2a4c45b9d3212f8d203aba)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:27:20.602800 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b508ff-fc5e-463e-a44d-2e18c659ba47 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:27:20.614208 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1188/2376] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 17:27:20 2022] PUT /identity/v3/projects/06e4037d6bad4cc981455db28975007f/users/b05fdea4b06b46f1af50a65b0d28240d/roles/dba744f8ab2a4c45b9d3212f8d203aba => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:27:20.625324 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952a2ac4-45a3-4382-b646-57c54d215e87 None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:27:20.625616 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952a2ac4-45a3-4382-b646-57c54d215e87 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:27:20.628228 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952a2ac4-45a3-4382-b646-57c54d215e87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:27:20.654694 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-952a2ac4-45a3-4382-b646-57c54d215e87 None None] MFA Rules not processed for user `b05fdea4b06b46f1af50a65b0d28240d`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:27:20.657219 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-952a2ac4-45a3-4382-b646-57c54d215e87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:27:20.731420 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1189/2377] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:27:20 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:27:20.746569 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b508ff-fc5e-463e-a44d-2e18c659ba47 admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:27:20.749150 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-90b508ff-fc5e-463e-a44d-2e18c659ba47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:27:20.835127 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b508ff-fc5e-463e-a44d-2e18c659ba47 admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:27:20.840712 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ae5b10-fa07-440c-8d28-68271cd34b27 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef37136b89d34edc9cd94c7aa81b2095', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:27:20.846602 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ae5b10-fa07-440c-8d28-68271cd34b27 service cinder] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:27:20.846602 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ae5b10-fa07-440c-8d28-68271cd34b27 service cinder] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:27:20.846602 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ae5b10-fa07-440c-8d28-68271cd34b27 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:27:20.859920 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ae5b10-fa07-440c-8d28-68271cd34b27 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:27:20.859920 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ae5b10-fa07-440c-8d28-68271cd34b27 service cinder] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:27:20.874289 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1189/2378] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:27:20 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:27:21.016153 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952a2ac4-45a3-4382-b646-57c54d215e87 None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:27:21.018863 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-952a2ac4-45a3-4382-b646-57c54d215e87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:27:21.170635 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952a2ac4-45a3-4382-b646-57c54d215e87 None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:27:21.175842 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4f3aa6-11a1-4f25-9801-6f3293ca6b83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:27:21.176718 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4f3aa6-11a1-4f25-9801-6f3293ca6b83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:27:21.186638 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4f3aa6-11a1-4f25-9801-6f3293ca6b83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:27:21.186638 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4f3aa6-11a1-4f25-9801-6f3293ca6b83 admin admin] PATH_INFO: `/v3/projects/16ee41d0e64b484a8aa735990022897a` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:27:21.186638 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4f3aa6-11a1-4f25-9801-6f3293ca6b83 admin admin] RBAC: Authorizing `identity:delete_project(project_id=16ee41d0e64b484a8aa735990022897a)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:27:21.186638 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4f3aa6-11a1-4f25-9801-6f3293ca6b83 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:27:21.281200 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-1a4f3aa6-11a1-4f25-9801-6f3293ca6b83 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16ee41d0e64b484a8aa735990022897a', 'request_id': 'req-1a4f3aa6-11a1-4f25-9801-6f3293ca6b83'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:27:21.286911 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-1a4f3aa6-11a1-4f25-9801-6f3293ca6b83 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16ee41d0e64b484a8aa735990022897a', 'request_id': 'req-1a4f3aa6-11a1-4f25-9801-6f3293ca6b83'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:27:21.335848 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ae5b10-fa07-440c-8d28-68271cd34b27 service cinder] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:27:21.337325 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-92ae5b10-fa07-440c-8d28-68271cd34b27 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:27:21.368499 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ae5b10-fa07-440c-8d28-68271cd34b27 service cinder] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:27:21.372115 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-1a4f3aa6-11a1-4f25-9801-6f3293ca6b83 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16ee41d0e64b484a8aa735990022897a', 'request_id': 'req-1a4f3aa6-11a1-4f25-9801-6f3293ca6b83'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:27:21.387663 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-1a4f3aa6-11a1-4f25-9801-6f3293ca6b83 admin admin] The token cache is being invalidate because project 16ee41d0e64b484a8aa735990022897a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80874) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 17:27:21.387995 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-1a4f3aa6-11a1-4f25-9801-6f3293ca6b83 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:27:21.388746 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-1a4f3aa6-11a1-4f25-9801-6f3293ca6b83 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:27:21.390610 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1190/2379] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 16 17:27:21 2022] DELETE /identity/v3/projects/16ee41d0e64b484a8aa735990022897a => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:27:21.471158 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc102d5-257f-489b-8073-eb17f3179f02 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef37136b89d34edc9cd94c7aa81b2095', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:27:21.471158 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc102d5-257f-489b-8073-eb17f3179f02 service cinder] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:27:21.471158 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc102d5-257f-489b-8073-eb17f3179f02 service cinder] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:27:21.471158 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc102d5-257f-489b-8073-eb17f3179f02 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:27:21.471825 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-7cc102d5-257f-489b-8073-eb17f3179f02 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:27:21.565051 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc102d5-257f-489b-8073-eb17f3179f02 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:27:21.565051 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc102d5-257f-489b-8073-eb17f3179f02 service cinder] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:27:21.569546 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ad62bf-0f90-416a-95bf-2ad29654f9e5 None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:27:21.570154 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ad62bf-0f90-416a-95bf-2ad29654f9e5 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:27:21.570364 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ad62bf-0f90-416a-95bf-2ad29654f9e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:27:21.576157 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1190/2380] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:27:21 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 17:27:21.596814 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-37ad62bf-0f90-416a-95bf-2ad29654f9e5 None None] MFA Rules not processed for user `c0c8406fdc684b2bb71bb3a76b01258e`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:27:21.597043 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-37ad62bf-0f90-416a-95bf-2ad29654f9e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:27:21.659965 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1191/2381] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:27:21 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:27:22.309122 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:27:22.598609 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:27:23.840859 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:27:24.617579 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:27:24.737064 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc102d5-257f-489b-8073-eb17f3179f02 service cinder] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:27:24.738523 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-7cc102d5-257f-489b-8073-eb17f3179f02 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:27:24.817335 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc102d5-257f-489b-8073-eb17f3179f02 service cinder] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:27:24.824460 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea2e669-a69a-493d-98c8-a868ce10bdb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:27:24.825466 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea2e669-a69a-493d-98c8-a868ce10bdb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:27:24.826273 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea2e669-a69a-493d-98c8-a868ce10bdb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:27:24.826273 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea2e669-a69a-493d-98c8-a868ce10bdb3 admin admin] PATH_INFO: `/v3/users/c965234a5efc44cb89b8990935f0287f` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:27:24.827807 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea2e669-a69a-493d-98c8-a868ce10bdb3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c965234a5efc44cb89b8990935f0287f)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:27:24.829999 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea2e669-a69a-493d-98c8-a868ce10bdb3 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:27:24.875107 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:27:25.055170 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-6ea2e669-a69a-493d-98c8-a868ce10bdb3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c965234a5efc44cb89b8990935f0287f'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:27:25.056017 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-6ea2e669-a69a-493d-98c8-a868ce10bdb3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c965234a5efc44cb89b8990935f0287f'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:27:25.057559 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-6ea2e669-a69a-493d-98c8-a868ce10bdb3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c965234a5efc44cb89b8990935f0287f'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:27:25.183466 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-6ea2e669-a69a-493d-98c8-a868ce10bdb3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c965234a5efc44cb89b8990935f0287f'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:27:25.192812 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-6ea2e669-a69a-493d-98c8-a868ce10bdb3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c965234a5efc44cb89b8990935f0287f'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:27:25.221500 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1191/2382] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 16 17:27:24 2022] DELETE /identity/v3/users/c965234a5efc44cb89b8990935f0287f => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:27:25.226072 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49604ba2-f101-494f-bd68-67d2b1e108e1 None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:27:25.226369 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49604ba2-f101-494f-bd68-67d2b1e108e1 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:27:25.226676 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49604ba2-f101-494f-bd68-67d2b1e108e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:27:25.255093 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-49604ba2-f101-494f-bd68-67d2b1e108e1 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:27:25.256647 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-49604ba2-f101-494f-bd68-67d2b1e108e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:27:25.323322 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1192/2383] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:27:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:27:25.334930 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea2e669-a69a-493d-98c8-a868ce10bdb3 admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:27:25.336415 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-6ea2e669-a69a-493d-98c8-a868ce10bdb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:27:25.445018 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea2e669-a69a-493d-98c8-a868ce10bdb3 admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:27:25.453029 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308cf800-64fb-4f11-9fd4-dc33af887ce6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5d25bfa8dc042329d57cd55fa7b7b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:27:25.453934 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308cf800-64fb-4f11-9fd4-dc33af887ce6 service neutron] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:27:25.454212 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308cf800-64fb-4f11-9fd4-dc33af887ce6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:27:25.454495 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308cf800-64fb-4f11-9fd4-dc33af887ce6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:27:25.466145 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308cf800-64fb-4f11-9fd4-dc33af887ce6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:27:25.467604 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308cf800-64fb-4f11-9fd4-dc33af887ce6 service neutron] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:27:25.483801 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1192/2384] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:27:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:27:25.623316 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:27:26.186826 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49604ba2-f101-494f-bd68-67d2b1e108e1 None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:27:26.186826 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-49604ba2-f101-494f-bd68-67d2b1e108e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:27:26.199187 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49604ba2-f101-494f-bd68-67d2b1e108e1 None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:27:26.204148 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c513222-13d5-4563-a881-b23f8ca33703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:27:26.209980 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c513222-13d5-4563-a881-b23f8ca33703 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:27:26.210287 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c513222-13d5-4563-a881-b23f8ca33703 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:27:26.215462 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c513222-13d5-4563-a881-b23f8ca33703 admin admin] PATH_INFO: `/v3/projects/45b77585c8e64eb9b6659393742a5b82` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:27:26.215462 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c513222-13d5-4563-a881-b23f8ca33703 admin admin] RBAC: Authorizing `identity:delete_project(project_id=45b77585c8e64eb9b6659393742a5b82)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:27:26.215462 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c513222-13d5-4563-a881-b23f8ca33703 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:27:26.334962 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-2c513222-13d5-4563-a881-b23f8ca33703 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45b77585c8e64eb9b6659393742a5b82', 'request_id': 'req-2c513222-13d5-4563-a881-b23f8ca33703'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:27:26.341160 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-2c513222-13d5-4563-a881-b23f8ca33703 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45b77585c8e64eb9b6659393742a5b82', 'request_id': 'req-2c513222-13d5-4563-a881-b23f8ca33703'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:27:26.372082 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:27:26.404205 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-2c513222-13d5-4563-a881-b23f8ca33703 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45b77585c8e64eb9b6659393742a5b82', 'request_id': 'req-2c513222-13d5-4563-a881-b23f8ca33703'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:27:26.418704 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-2c513222-13d5-4563-a881-b23f8ca33703 admin admin] The token cache is being invalidate because project 45b77585c8e64eb9b6659393742a5b82 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80874) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 17:27:26.419045 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-2c513222-13d5-4563-a881-b23f8ca33703 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:27:26.419864 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-2c513222-13d5-4563-a881-b23f8ca33703 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:27:26.421537 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1193/2385] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 16 17:27:26 2022] DELETE /identity/v3/projects/45b77585c8e64eb9b6659393742a5b82 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:27:26.426832 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fce5d5-cfa9-4541-a73b-4c4e680e28fe None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:27:26.427144 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fce5d5-cfa9-4541-a73b-4c4e680e28fe None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:27:26.427434 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fce5d5-cfa9-4541-a73b-4c4e680e28fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:27:26.465985 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-24fce5d5-cfa9-4541-a73b-4c4e680e28fe None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:27:26.467219 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-24fce5d5-cfa9-4541-a73b-4c4e680e28fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:27:26.528913 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1193/2386] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:27:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:27:26.536886 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d16edf-8ae0-4b06-92e5-b8981192ab0f None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:27:26.537177 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d16edf-8ae0-4b06-92e5-b8981192ab0f None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:27:26.537458 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d16edf-8ae0-4b06-92e5-b8981192ab0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:27:26.557928 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-35d16edf-8ae0-4b06-92e5-b8981192ab0f None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:27:26.559070 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-35d16edf-8ae0-4b06-92e5-b8981192ab0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:27:26.568176 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1194/2387] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:27:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:27:26.572790 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fce5d5-cfa9-4541-a73b-4c4e680e28fe None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:27:26.583318 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fce5d5-cfa9-4541-a73b-4c4e680e28fe None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:27:26.589285 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cb887c-a438-4abe-9cfe-25d3fce9e55b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:27:26.590214 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cb887c-a438-4abe-9cfe-25d3fce9e55b admin admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:27:26.590713 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cb887c-a438-4abe-9cfe-25d3fce9e55b admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:27:26.591169 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cb887c-a438-4abe-9cfe-25d3fce9e55b admin admin] PATH_INFO: `/v3/domains` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:27:26.592123 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cb887c-a438-4abe-9cfe-25d3fce9e55b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80873) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:27:26.592746 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cb887c-a438-4abe-9cfe-25d3fce9e55b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:27:26.595367 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cb887c-a438-4abe-9cfe-25d3fce9e55b admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:27:26.626681 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1194/2388] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 16 17:27:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:27:26.631849 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d16edf-8ae0-4b06-92e5-b8981192ab0f None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:27:26.642522 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d16edf-8ae0-4b06-92e5-b8981192ab0f None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:27:26.647507 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac6ff03-46fd-4c35-a432-7bdb2b43dab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:27:26.648381 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac6ff03-46fd-4c35-a432-7bdb2b43dab7 admin admin] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:27:26.648850 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac6ff03-46fd-4c35-a432-7bdb2b43dab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:27:26.649364 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac6ff03-46fd-4c35-a432-7bdb2b43dab7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:27:26.653099 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac6ff03-46fd-4c35-a432-7bdb2b43dab7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:27:26.655256 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac6ff03-46fd-4c35-a432-7bdb2b43dab7 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:27:26.740675 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1195/2389] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 16 17:27:26 2022] POST /identity/v3/projects => generated 373 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:27:26.745082 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cb887c-a438-4abe-9cfe-25d3fce9e55b admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:27:26.756021 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cb887c-a438-4abe-9cfe-25d3fce9e55b admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:27:26.822946 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b240d5-75fa-4361-83c4-30ea8d114244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:27:26.823555 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b240d5-75fa-4361-83c4-30ea8d114244 admin admin] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:27:26.823848 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b240d5-75fa-4361-83c4-30ea8d114244 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:27:26.824135 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b240d5-75fa-4361-83c4-30ea8d114244 admin admin] PATH_INFO: `/v3/users` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:27:26.824857 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b240d5-75fa-4361-83c4-30ea8d114244 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:27:26.827130 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b240d5-75fa-4361-83c4-30ea8d114244 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:27:27.040213 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1195/2390] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 16 17:27:26 2022] POST /identity/v3/users => generated 287 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:27:27.045455 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac6ff03-46fd-4c35-a432-7bdb2b43dab7 admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:27:27.057823 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac6ff03-46fd-4c35-a432-7bdb2b43dab7 admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:27:27.066056 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c89dabe-f212-483f-bbd2-07477deb4688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:27:27.066056 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c89dabe-f212-483f-bbd2-07477deb4688 admin admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:27:27.066056 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c89dabe-f212-483f-bbd2-07477deb4688 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:27:27.066056 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c89dabe-f212-483f-bbd2-07477deb4688 admin admin] PATH_INFO: `/v3/roles` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:27:27.067016 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c89dabe-f212-483f-bbd2-07477deb4688 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:27:27.067454 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c89dabe-f212-483f-bbd2-07477deb4688 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:27:27.089213 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1196/2391] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 17:27:27 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:27:27.089310 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b240d5-75fa-4361-83c4-30ea8d114244 admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:27:27.098233 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b240d5-75fa-4361-83c4-30ea8d114244 admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:27:27.105444 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad33aff-f59b-4d54-adec-a94fae82249f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:27:27.106312 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad33aff-f59b-4d54-adec-a94fae82249f admin admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:27:27.106716 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad33aff-f59b-4d54-adec-a94fae82249f admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:27:27.107080 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad33aff-f59b-4d54-adec-a94fae82249f admin admin] PATH_INFO: `/v3/roles` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:27:27.107898 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad33aff-f59b-4d54-adec-a94fae82249f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:27:27.109652 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad33aff-f59b-4d54-adec-a94fae82249f admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:27:27.122118 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1196/2392] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 17:27:27 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 17:27:27.125244 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c89dabe-f212-483f-bbd2-07477deb4688 admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:27:27.136744 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c89dabe-f212-483f-bbd2-07477deb4688 admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:27:27.142742 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff276fa-91ef-4e8d-a41c-056bfdeedfa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:27:27.143647 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff276fa-91ef-4e8d-a41c-056bfdeedfa0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:27:27.143933 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff276fa-91ef-4e8d-a41c-056bfdeedfa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:27:27.144213 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff276fa-91ef-4e8d-a41c-056bfdeedfa0 admin admin] PATH_INFO: `/v3/projects/04b80483685843dda4dc9f63677023cc/users/b0d1c56343f641de8d6cdb3eb525d640/roles/896bff49c5d6464eb612a15f4aa9badc` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:27:27.160871 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff276fa-91ef-4e8d-a41c-056bfdeedfa0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=04b80483685843dda4dc9f63677023cc, user_id=b0d1c56343f641de8d6cdb3eb525d640, role_id=896bff49c5d6464eb612a15f4aa9badc)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:27:27.163656 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff276fa-91ef-4e8d-a41c-056bfdeedfa0 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:27:27.262412 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1197/2393] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 17:27:27 2022] PUT /identity/v3/projects/04b80483685843dda4dc9f63677023cc/users/b0d1c56343f641de8d6cdb3eb525d640/roles/896bff49c5d6464eb612a15f4aa9badc => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:27:27.263045 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53a2cbb-9b4e-4284-80dc-745918166a25 None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:27:27.264522 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53a2cbb-9b4e-4284-80dc-745918166a25 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:27:27.264522 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53a2cbb-9b4e-4284-80dc-745918166a25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:27:27.312000 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-e53a2cbb-9b4e-4284-80dc-745918166a25 None None] MFA Rules not processed for user `b0d1c56343f641de8d6cdb3eb525d640`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:27:27.313800 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-e53a2cbb-9b4e-4284-80dc-745918166a25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:27:27.390933 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1197/2394] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:27:27 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:27:27.403320 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff276fa-91ef-4e8d-a41c-056bfdeedfa0 admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:27:27.405120 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-6ff276fa-91ef-4e8d-a41c-056bfdeedfa0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:27:27.469314 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff276fa-91ef-4e8d-a41c-056bfdeedfa0 admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:27:27.473286 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a5f25c-2ccf-43f6-a5e6-8a991c92ae84 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef37136b89d34edc9cd94c7aa81b2095', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:27:27.473971 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a5f25c-2ccf-43f6-a5e6-8a991c92ae84 service cinder] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:27:27.474263 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a5f25c-2ccf-43f6-a5e6-8a991c92ae84 service cinder] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:27:27.474731 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a5f25c-2ccf-43f6-a5e6-8a991c92ae84 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:27:27.485034 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a5f25c-2ccf-43f6-a5e6-8a991c92ae84 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:27:27.486595 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a5f25c-2ccf-43f6-a5e6-8a991c92ae84 service cinder] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:27:27.496706 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1198/2395] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:27:27 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:27:27.521973 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53a2cbb-9b4e-4284-80dc-745918166a25 None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:27:27.587100 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53a2cbb-9b4e-4284-80dc-745918166a25 None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:27:27.598394 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f491b3d-c101-4f98-83e2-a6c788a26e43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:27:27.599296 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f491b3d-c101-4f98-83e2-a6c788a26e43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:27:27.599801 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f491b3d-c101-4f98-83e2-a6c788a26e43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:27:27.600087 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f491b3d-c101-4f98-83e2-a6c788a26e43 admin admin] PATH_INFO: `/v3/users/b0d1c56343f641de8d6cdb3eb525d640` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:27:27.601341 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f491b3d-c101-4f98-83e2-a6c788a26e43 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0d1c56343f641de8d6cdb3eb525d640)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:27:27.604061 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f491b3d-c101-4f98-83e2-a6c788a26e43 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:27:27.849320 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-8f491b3d-c101-4f98-83e2-a6c788a26e43 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0d1c56343f641de8d6cdb3eb525d640'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:27:27.850019 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-8f491b3d-c101-4f98-83e2-a6c788a26e43 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0d1c56343f641de8d6cdb3eb525d640'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:27:27.850635 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-8f491b3d-c101-4f98-83e2-a6c788a26e43 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0d1c56343f641de8d6cdb3eb525d640'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:27:27.942679 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-8f491b3d-c101-4f98-83e2-a6c788a26e43 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0d1c56343f641de8d6cdb3eb525d640'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:27:27.951417 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-8f491b3d-c101-4f98-83e2-a6c788a26e43 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0d1c56343f641de8d6cdb3eb525d640'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:27:27.970668 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1198/2396] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 16 17:27:27 2022] DELETE /identity/v3/users/b0d1c56343f641de8d6cdb3eb525d640 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:27:27.975180 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6008ffd0-9975-451b-a2b7-696740a4c3e0 None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:27:27.975651 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6008ffd0-9975-451b-a2b7-696740a4c3e0 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:27:27.975792 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6008ffd0-9975-451b-a2b7-696740a4c3e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:27:27.993092 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-6008ffd0-9975-451b-a2b7-696740a4c3e0 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:27:27.998600 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-6008ffd0-9975-451b-a2b7-696740a4c3e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:27:28.055438 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1199/2397] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:27:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:27:28.065467 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f491b3d-c101-4f98-83e2-a6c788a26e43 admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:27:28.068007 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-8f491b3d-c101-4f98-83e2-a6c788a26e43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:27:28.069478 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:27:28.131478 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:27:28.134016 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f491b3d-c101-4f98-83e2-a6c788a26e43 admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:27:28.138257 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2aa74b-924e-4c31-ab72-d11a8831a795 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5d25bfa8dc042329d57cd55fa7b7b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:27:28.143285 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2aa74b-924e-4c31-ab72-d11a8831a795 service neutron] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:27:28.143285 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2aa74b-924e-4c31-ab72-d11a8831a795 service neutron] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:27:28.143285 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2aa74b-924e-4c31-ab72-d11a8831a795 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:27:28.148475 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2aa74b-924e-4c31-ab72-d11a8831a795 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:27:28.150616 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2aa74b-924e-4c31-ab72-d11a8831a795 service neutron] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:27:28.159965 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1199/2398] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:27:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:27:28.589340 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6008ffd0-9975-451b-a2b7-696740a4c3e0 None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:27:28.590829 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-6008ffd0-9975-451b-a2b7-696740a4c3e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:27:28.603857 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6008ffd0-9975-451b-a2b7-696740a4c3e0 None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:27:28.608784 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda82d6e-598f-468f-9854-3c5362bcdbea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:27:28.609668 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda82d6e-598f-468f-9854-3c5362bcdbea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:27:28.610051 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda82d6e-598f-468f-9854-3c5362bcdbea admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:27:28.610319 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda82d6e-598f-468f-9854-3c5362bcdbea admin admin] PATH_INFO: `/v3/projects/04b80483685843dda4dc9f63677023cc` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:27:28.611592 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda82d6e-598f-468f-9854-3c5362bcdbea admin admin] RBAC: Authorizing `identity:delete_project(project_id=04b80483685843dda4dc9f63677023cc)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:27:28.613533 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda82d6e-598f-468f-9854-3c5362bcdbea admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:27:28.715819 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-bda82d6e-598f-468f-9854-3c5362bcdbea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04b80483685843dda4dc9f63677023cc', 'request_id': 'req-bda82d6e-598f-468f-9854-3c5362bcdbea'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:27:28.721308 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-bda82d6e-598f-468f-9854-3c5362bcdbea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04b80483685843dda4dc9f63677023cc', 'request_id': 'req-bda82d6e-598f-468f-9854-3c5362bcdbea'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:27:28.810881 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-bda82d6e-598f-468f-9854-3c5362bcdbea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04b80483685843dda4dc9f63677023cc', 'request_id': 'req-bda82d6e-598f-468f-9854-3c5362bcdbea'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:27:28.825500 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-bda82d6e-598f-468f-9854-3c5362bcdbea admin admin] The token cache is being invalidate because project 04b80483685843dda4dc9f63677023cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80874) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 17:27:28.825826 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-bda82d6e-598f-468f-9854-3c5362bcdbea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:27:28.826491 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-bda82d6e-598f-468f-9854-3c5362bcdbea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:27:28.828185 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1200/2399] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 16 17:27:28 2022] DELETE /identity/v3/projects/04b80483685843dda4dc9f63677023cc => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:27:28.833357 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7509dd2e-17af-45c4-811c-eb7fb9006912 None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:27:28.833914 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7509dd2e-17af-45c4-811c-eb7fb9006912 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:27:28.834018 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7509dd2e-17af-45c4-811c-eb7fb9006912 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:27:28.853288 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-7509dd2e-17af-45c4-811c-eb7fb9006912 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:27:28.854542 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-7509dd2e-17af-45c4-811c-eb7fb9006912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:27:28.923925 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1200/2400] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:27:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:27:28.931802 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd75018-5dda-4f3e-ac27-a1c50c38702b None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:27:28.932090 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd75018-5dda-4f3e-ac27-a1c50c38702b None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:27:28.932371 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd75018-5dda-4f3e-ac27-a1c50c38702b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:27:28.950555 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-1cd75018-5dda-4f3e-ac27-a1c50c38702b None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:27:28.951746 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-1cd75018-5dda-4f3e-ac27-a1c50c38702b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:27:28.959999 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1201/2401] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:27:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:27:28.964996 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7509dd2e-17af-45c4-811c-eb7fb9006912 None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:27:28.974701 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7509dd2e-17af-45c4-811c-eb7fb9006912 None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:27:28.981111 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f94e138-ec0e-4c3f-b3e3-0d3779bbd46b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:27:28.981308 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f94e138-ec0e-4c3f-b3e3-0d3779bbd46b admin admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:27:28.981546 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f94e138-ec0e-4c3f-b3e3-0d3779bbd46b admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:27:28.981850 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f94e138-ec0e-4c3f-b3e3-0d3779bbd46b admin admin] PATH_INFO: `/v3/domains` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:27:28.982595 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f94e138-ec0e-4c3f-b3e3-0d3779bbd46b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80873) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:27:28.982919 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f94e138-ec0e-4c3f-b3e3-0d3779bbd46b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:27:28.984522 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f94e138-ec0e-4c3f-b3e3-0d3779bbd46b admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:27:28.999155 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1201/2402] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 16 17:27:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:27:29.003492 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd75018-5dda-4f3e-ac27-a1c50c38702b None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:27:29.014403 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f94e138-ec0e-4c3f-b3e3-0d3779bbd46b admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:27:29.015389 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd75018-5dda-4f3e-ac27-a1c50c38702b None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:27:29.016790 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-9f94e138-ec0e-4c3f-b3e3-0d3779bbd46b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:27:29.020341 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79b5a2a-30c1-4920-bbf4-ac11c66e4712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:27:29.021181 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79b5a2a-30c1-4920-bbf4-ac11c66e4712 admin admin] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:27:29.021580 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79b5a2a-30c1-4920-bbf4-ac11c66e4712 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:27:29.021933 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79b5a2a-30c1-4920-bbf4-ac11c66e4712 admin admin] PATH_INFO: `/v3/projects` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:27:29.022700 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79b5a2a-30c1-4920-bbf4-ac11c66e4712 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:27:29.024814 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79b5a2a-30c1-4920-bbf4-ac11c66e4712 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:27:29.032791 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f94e138-ec0e-4c3f-b3e3-0d3779bbd46b admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:27:29.038159 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e632c1ba-4805-46e6-8944-d6e4ddc7beb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:27:29.038773 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e632c1ba-4805-46e6-8944-d6e4ddc7beb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:27:29.039069 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e632c1ba-4805-46e6-8944-d6e4ddc7beb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:27:29.039354 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e632c1ba-4805-46e6-8944-d6e4ddc7beb5 admin admin] PATH_INFO: `/v3/users/e54d335da4d34099a71b4d34a74fc698` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:27:29.040670 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e632c1ba-4805-46e6-8944-d6e4ddc7beb5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e54d335da4d34099a71b4d34a74fc698)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:27:29.042643 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e632c1ba-4805-46e6-8944-d6e4ddc7beb5 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:27:29.139935 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1202/2403] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 16 17:27:29 2022] POST /identity/v3/projects => generated 383 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 17:27:29.144468 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79b5a2a-30c1-4920-bbf4-ac11c66e4712 admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:27:29.206481 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79b5a2a-30c1-4920-bbf4-ac11c66e4712 admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:27:29.216536 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2480d9-c107-40bc-8b58-0295a710203b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:27:29.227169 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2480d9-c107-40bc-8b58-0295a710203b admin admin] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:27:29.227169 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2480d9-c107-40bc-8b58-0295a710203b admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:27:29.227169 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2480d9-c107-40bc-8b58-0295a710203b admin admin] PATH_INFO: `/v3/users` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:27:29.227169 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2480d9-c107-40bc-8b58-0295a710203b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:27:29.227169 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2480d9-c107-40bc-8b58-0295a710203b admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:27:29.271295 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-e632c1ba-4805-46e6-8944-d6e4ddc7beb5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e54d335da4d34099a71b4d34a74fc698'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:27:29.271963 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-e632c1ba-4805-46e6-8944-d6e4ddc7beb5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e54d335da4d34099a71b4d34a74fc698'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:27:29.272582 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-e632c1ba-4805-46e6-8944-d6e4ddc7beb5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e54d335da4d34099a71b4d34a74fc698'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:27:29.314821 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1203/2404] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 16 17:27:29 2022] POST /identity/v3/users => generated 292 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:27:29.319280 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2480d9-c107-40bc-8b58-0295a710203b admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:27:29.322419 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-ca2480d9-c107-40bc-8b58-0295a710203b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:27:29.335154 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2480d9-c107-40bc-8b58-0295a710203b admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:27:29.341549 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced1680a-8a2a-4ba7-9888-5711b614d4c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:27:29.342271 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced1680a-8a2a-4ba7-9888-5711b614d4c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:27:29.342562 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced1680a-8a2a-4ba7-9888-5711b614d4c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:27:29.342848 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced1680a-8a2a-4ba7-9888-5711b614d4c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:27:29.343644 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced1680a-8a2a-4ba7-9888-5711b614d4c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:27:29.345280 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced1680a-8a2a-4ba7-9888-5711b614d4c8 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:27:29.348269 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-e632c1ba-4805-46e6-8944-d6e4ddc7beb5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e54d335da4d34099a71b4d34a74fc698'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:27:29.357671 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-e632c1ba-4805-46e6-8944-d6e4ddc7beb5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e54d335da4d34099a71b4d34a74fc698'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:27:29.363084 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1204/2405] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 17:27:29 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:27:29.364262 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced1680a-8a2a-4ba7-9888-5711b614d4c8 admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:27:29.380917 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced1680a-8a2a-4ba7-9888-5711b614d4c8 admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:27:29.381450 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1202/2406] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 16 17:27:29 2022] DELETE /identity/v3/users/e54d335da4d34099a71b4d34a74fc698 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:27:29.386654 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2cce49-d27b-49b9-b235-1233b7bc1a47 None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:27:29.387120 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2cce49-d27b-49b9-b235-1233b7bc1a47 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:27:29.387413 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2cce49-d27b-49b9-b235-1233b7bc1a47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:27:29.408002 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-cb2cce49-d27b-49b9-b235-1233b7bc1a47 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:27:29.408283 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-cb2cce49-d27b-49b9-b235-1233b7bc1a47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:27:29.463040 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:27:29.485236 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aed6f87-7a23-4123-96d4-79a07adbf3ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:27:29.486664 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aed6f87-7a23-4123-96d4-79a07adbf3ed admin admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:27:29.487182 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aed6f87-7a23-4123-96d4-79a07adbf3ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:27:29.487713 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aed6f87-7a23-4123-96d4-79a07adbf3ed admin admin] PATH_INFO: `/v3/roles` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:27:29.488255 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1203/2407] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:27:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 17:27:29.489380 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aed6f87-7a23-4123-96d4-79a07adbf3ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:27:29.492449 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aed6f87-7a23-4123-96d4-79a07adbf3ed admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:27:29.501145 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2cce49-d27b-49b9-b235-1233b7bc1a47 None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:27:29.502951 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-cb2cce49-d27b-49b9-b235-1233b7bc1a47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:27:29.510095 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1205/2408] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 17:27:29 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 17:27:29.512517 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aed6f87-7a23-4123-96d4-79a07adbf3ed admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:27:29.524600 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aed6f87-7a23-4123-96d4-79a07adbf3ed admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:27:29.531094 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f62fc0-74b2-429a-84ba-f213e868f57d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:27:29.532152 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f62fc0-74b2-429a-84ba-f213e868f57d admin admin] REQUEST_METHOD: `PUT` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:27:29.532505 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f62fc0-74b2-429a-84ba-f213e868f57d admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:27:29.532859 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f62fc0-74b2-429a-84ba-f213e868f57d admin admin] PATH_INFO: `/v3/projects/10122bee002b4e2f9c0619415552b6bf/users/b0b96633bee24c718e8af89062493d0d/roles/896bff49c5d6464eb612a15f4aa9badc` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:27:29.554545 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f62fc0-74b2-429a-84ba-f213e868f57d admin admin] RBAC: Authorizing `identity:create_grant(project_id=10122bee002b4e2f9c0619415552b6bf, user_id=b0b96633bee24c718e8af89062493d0d, role_id=896bff49c5d6464eb612a15f4aa9badc)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:27:29.558951 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f62fc0-74b2-429a-84ba-f213e868f57d admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:27:29.589128 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2cce49-d27b-49b9-b235-1233b7bc1a47 None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:27:29.592998 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d63f707-1369-48b4-aa40-764d856d1494 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5d25bfa8dc042329d57cd55fa7b7b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:27:29.593656 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d63f707-1369-48b4-aa40-764d856d1494 service neutron] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:27:29.593980 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d63f707-1369-48b4-aa40-764d856d1494 service neutron] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:27:29.594263 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d63f707-1369-48b4-aa40-764d856d1494 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:27:29.604738 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d63f707-1369-48b4-aa40-764d856d1494 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:27:29.606212 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d63f707-1369-48b4-aa40-764d856d1494 service neutron] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:27:29.611130 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:27:29.616025 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1204/2409] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:27:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 17:27:29.646125 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1206/2410] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 17:27:29 2022] PUT /identity/v3/projects/10122bee002b4e2f9c0619415552b6bf/users/b0b96633bee24c718e8af89062493d0d/roles/896bff49c5d6464eb612a15f4aa9badc => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:27:29.651738 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f7ffae-221e-45e3-a37c-d91dac80bbfb None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:27:29.652037 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f7ffae-221e-45e3-a37c-d91dac80bbfb None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:27:29.652320 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f7ffae-221e-45e3-a37c-d91dac80bbfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:27:29.670818 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-99f7ffae-221e-45e3-a37c-d91dac80bbfb None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:27:29.671963 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-99f7ffae-221e-45e3-a37c-d91dac80bbfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:27:29.746611 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1205/2411] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:27:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:27:29.756303 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f62fc0-74b2-429a-84ba-f213e868f57d admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:27:29.758224 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-24f62fc0-74b2-429a-84ba-f213e868f57d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:27:29.824041 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f62fc0-74b2-429a-84ba-f213e868f57d admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:27:29.828183 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31a5e66-8f64-4de8-aae7-1d06fa5b6a00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5d25bfa8dc042329d57cd55fa7b7b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:27:29.828831 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31a5e66-8f64-4de8-aae7-1d06fa5b6a00 service neutron] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:27:29.829204 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31a5e66-8f64-4de8-aae7-1d06fa5b6a00 service neutron] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:27:29.831414 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31a5e66-8f64-4de8-aae7-1d06fa5b6a00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:27:29.844740 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31a5e66-8f64-4de8-aae7-1d06fa5b6a00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:27:29.846229 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31a5e66-8f64-4de8-aae7-1d06fa5b6a00 service neutron] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:27:29.864112 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1207/2412] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:27:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:27:30.125158 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f7ffae-221e-45e3-a37c-d91dac80bbfb None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:27:30.129595 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-99f7ffae-221e-45e3-a37c-d91dac80bbfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:27:30.143880 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f7ffae-221e-45e3-a37c-d91dac80bbfb None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:27:30.164604 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd1cb60-9510-4e78-92de-c6ed0874d623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:27:30.165611 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd1cb60-9510-4e78-92de-c6ed0874d623 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:27:30.165989 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd1cb60-9510-4e78-92de-c6ed0874d623 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:27:30.166349 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd1cb60-9510-4e78-92de-c6ed0874d623 admin admin] PATH_INFO: `/v3/projects/a9bf81b66b3a45f4be061c707c040ab6` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:27:30.169673 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd1cb60-9510-4e78-92de-c6ed0874d623 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9bf81b66b3a45f4be061c707c040ab6)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:27:30.174272 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd1cb60-9510-4e78-92de-c6ed0874d623 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:27:30.337091 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-5dd1cb60-9510-4e78-92de-c6ed0874d623 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9bf81b66b3a45f4be061c707c040ab6', 'request_id': 'req-5dd1cb60-9510-4e78-92de-c6ed0874d623'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:27:30.343936 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-5dd1cb60-9510-4e78-92de-c6ed0874d623 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9bf81b66b3a45f4be061c707c040ab6', 'request_id': 'req-5dd1cb60-9510-4e78-92de-c6ed0874d623'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:27:30.350142 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-5dd1cb60-9510-4e78-92de-c6ed0874d623 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9bf81b66b3a45f4be061c707c040ab6', 'request_id': 'req-5dd1cb60-9510-4e78-92de-c6ed0874d623'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:27:30.465046 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-5dd1cb60-9510-4e78-92de-c6ed0874d623 admin admin] The token cache is being invalidate because project a9bf81b66b3a45f4be061c707c040ab6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80873) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 17:27:30.465046 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-5dd1cb60-9510-4e78-92de-c6ed0874d623 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:27:30.465046 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-5dd1cb60-9510-4e78-92de-c6ed0874d623 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:27:30.466051 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1206/2413] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 16 17:27:30 2022] DELETE /identity/v3/projects/a9bf81b66b3a45f4be061c707c040ab6 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:27:30.470053 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31a5e66-8f64-4de8-aae7-1d06fa5b6a00 service neutron] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:27:30.480877 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31a5e66-8f64-4de8-aae7-1d06fa5b6a00 service neutron] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:27:30.538113 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7411441-d9d0-48f5-9862-3e6938c8a1bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:27:30.539003 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7411441-d9d0-48f5-9862-3e6938c8a1bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:27:30.539289 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7411441-d9d0-48f5-9862-3e6938c8a1bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:27:30.539569 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7411441-d9d0-48f5-9862-3e6938c8a1bd admin admin] PATH_INFO: `/v3/users/b05fdea4b06b46f1af50a65b0d28240d` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:27:30.541001 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7411441-d9d0-48f5-9862-3e6938c8a1bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=b05fdea4b06b46f1af50a65b0d28240d)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:27:30.543519 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7411441-d9d0-48f5-9862-3e6938c8a1bd admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:27:30.686325 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:27:30.809450 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:27:30.820458 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-b7411441-d9d0-48f5-9862-3e6938c8a1bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b05fdea4b06b46f1af50a65b0d28240d'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:27:30.832827 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-b7411441-d9d0-48f5-9862-3e6938c8a1bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b05fdea4b06b46f1af50a65b0d28240d'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:27:30.948800 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-b7411441-d9d0-48f5-9862-3e6938c8a1bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b05fdea4b06b46f1af50a65b0d28240d'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:27:30.952958 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-b7411441-d9d0-48f5-9862-3e6938c8a1bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b05fdea4b06b46f1af50a65b0d28240d'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:27:30.967602 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-b7411441-d9d0-48f5-9862-3e6938c8a1bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b05fdea4b06b46f1af50a65b0d28240d'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:27:30.974608 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1208/2414] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 16 17:27:30 2022] DELETE /identity/v3/users/b05fdea4b06b46f1af50a65b0d28240d => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:27:31.229526 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:27:31.564655 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd1cb60-9510-4e78-92de-c6ed0874d623 admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:27:31.566213 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-5dd1cb60-9510-4e78-92de-c6ed0874d623 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:27:31.589898 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd1cb60-9510-4e78-92de-c6ed0874d623 admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:27:31.636024 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43f1bf0-35b9-46e6-bf8d-3b587c437968 None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:27:31.636600 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43f1bf0-35b9-46e6-bf8d-3b587c437968 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:27:31.636716 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43f1bf0-35b9-46e6-bf8d-3b587c437968 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:27:31.677593 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-e43f1bf0-35b9-46e6-bf8d-3b587c437968 None None] MFA Rules not processed for user `b0b96633bee24c718e8af89062493d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:27:31.678712 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafa1e10-0fa1-4337-9c1d-db3332158306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:27:31.679505 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-e43f1bf0-35b9-46e6-bf8d-3b587c437968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:27:31.680151 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafa1e10-0fa1-4337-9c1d-db3332158306 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:27:31.680503 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafa1e10-0fa1-4337-9c1d-db3332158306 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:27:31.680847 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafa1e10-0fa1-4337-9c1d-db3332158306 admin admin] PATH_INFO: `/v3/projects/06e4037d6bad4cc981455db28975007f` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:27:31.682236 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafa1e10-0fa1-4337-9c1d-db3332158306 admin admin] RBAC: Authorizing `identity:delete_project(project_id=06e4037d6bad4cc981455db28975007f)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:27:31.684784 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafa1e10-0fa1-4337-9c1d-db3332158306 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:27:31.704394 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:27:31.771651 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1209/2415] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:27:31 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 17:27:31.780799 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43f1bf0-35b9-46e6-bf8d-3b587c437968 None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:27:31.782166 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-e43f1bf0-35b9-46e6-bf8d-3b587c437968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:27:31.843446 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-aafa1e10-0fa1-4337-9c1d-db3332158306 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06e4037d6bad4cc981455db28975007f', 'request_id': 'req-aafa1e10-0fa1-4337-9c1d-db3332158306'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:27:31.844558 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43f1bf0-35b9-46e6-bf8d-3b587c437968 None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:27:31.850682 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-aafa1e10-0fa1-4337-9c1d-db3332158306 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06e4037d6bad4cc981455db28975007f', 'request_id': 'req-aafa1e10-0fa1-4337-9c1d-db3332158306'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:27:31.857300 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-aafa1e10-0fa1-4337-9c1d-db3332158306 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06e4037d6bad4cc981455db28975007f', 'request_id': 'req-aafa1e10-0fa1-4337-9c1d-db3332158306'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:27:31.902999 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e132e69a-95a4-458b-8dd7-819058daba2f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef37136b89d34edc9cd94c7aa81b2095', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:27:31.903204 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e132e69a-95a4-458b-8dd7-819058daba2f service cinder] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:27:31.903429 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e132e69a-95a4-458b-8dd7-819058daba2f service cinder] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:27:31.903713 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e132e69a-95a4-458b-8dd7-819058daba2f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:27:31.958895 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-aafa1e10-0fa1-4337-9c1d-db3332158306 admin admin] The token cache is being invalidate because project 06e4037d6bad4cc981455db28975007f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80873) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 17:27:31.959704 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-aafa1e10-0fa1-4337-9c1d-db3332158306 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:27:31.961445 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-aafa1e10-0fa1-4337-9c1d-db3332158306 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:27:31.966602 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1207/2416] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 16 17:27:31 2022] DELETE /identity/v3/projects/06e4037d6bad4cc981455db28975007f => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:27:31.974824 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29369f40-b569-4914-9e70-d69964bb79fe None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:27:31.975116 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29369f40-b569-4914-9e70-d69964bb79fe None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:27:31.975401 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29369f40-b569-4914-9e70-d69964bb79fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:27:31.985286 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e132e69a-95a4-458b-8dd7-819058daba2f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:27:31.986842 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e132e69a-95a4-458b-8dd7-819058daba2f service cinder] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:27:31.999102 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1210/2417] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:27:31 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:27:32.001723 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-29369f40-b569-4914-9e70-d69964bb79fe None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:27:32.003245 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-29369f40-b569-4914-9e70-d69964bb79fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:27:32.110089 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1208/2418] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:27:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:27:32.125669 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b30263f-bc37-4b1a-90f3-14e562058bb2 None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:27:32.126039 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b30263f-bc37-4b1a-90f3-14e562058bb2 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:27:32.126441 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b30263f-bc37-4b1a-90f3-14e562058bb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:27:32.146344 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-6b30263f-bc37-4b1a-90f3-14e562058bb2 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:27:32.147758 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-6b30263f-bc37-4b1a-90f3-14e562058bb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:27:32.157179 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1211/2419] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:27:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:27:32.161212 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29369f40-b569-4914-9e70-d69964bb79fe None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:27:32.171879 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29369f40-b569-4914-9e70-d69964bb79fe None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:27:32.177871 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241aca13-75b5-42bc-afea-651ba6c5eb44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:27:32.178635 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241aca13-75b5-42bc-afea-651ba6c5eb44 admin admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:27:32.179031 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241aca13-75b5-42bc-afea-651ba6c5eb44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:27:32.179381 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241aca13-75b5-42bc-afea-651ba6c5eb44 admin admin] PATH_INFO: `/v3/domains` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:27:32.180229 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241aca13-75b5-42bc-afea-651ba6c5eb44 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80873) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:27:32.180593 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241aca13-75b5-42bc-afea-651ba6c5eb44 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:27:32.182270 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241aca13-75b5-42bc-afea-651ba6c5eb44 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:27:32.200000 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1209/2420] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 16 17:27:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:27:32.204229 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b30263f-bc37-4b1a-90f3-14e562058bb2 None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:27:32.210917 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b30263f-bc37-4b1a-90f3-14e562058bb2 None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:27:32.217593 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1eb956-23a8-4c38-89a5-922702c1057c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:27:32.218395 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1eb956-23a8-4c38-89a5-922702c1057c admin admin] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:27:32.218693 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1eb956-23a8-4c38-89a5-922702c1057c admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:27:32.218981 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1eb956-23a8-4c38-89a5-922702c1057c admin admin] PATH_INFO: `/v3/projects` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:27:32.219697 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1eb956-23a8-4c38-89a5-922702c1057c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:27:32.221664 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1eb956-23a8-4c38-89a5-922702c1057c admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:27:32.312700 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1212/2421] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 16 17:27:32 2022] POST /identity/v3/projects => generated 375 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:27:32.313690 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241aca13-75b5-42bc-afea-651ba6c5eb44 admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:27:32.324271 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241aca13-75b5-42bc-afea-651ba6c5eb44 admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:27:32.395859 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8346ba-c1bf-42fb-87bb-f6a7e15bbe29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:27:32.396771 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8346ba-c1bf-42fb-87bb-f6a7e15bbe29 admin admin] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:27:32.397063 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8346ba-c1bf-42fb-87bb-f6a7e15bbe29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:27:32.397407 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8346ba-c1bf-42fb-87bb-f6a7e15bbe29 admin admin] PATH_INFO: `/v3/users` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:27:32.398555 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8346ba-c1bf-42fb-87bb-f6a7e15bbe29 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:27:32.401253 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8346ba-c1bf-42fb-87bb-f6a7e15bbe29 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:27:32.504782 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1210/2422] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 16 17:27:32 2022] POST /identity/v3/users => generated 288 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 17:27:32.508118 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1eb956-23a8-4c38-89a5-922702c1057c admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:27:32.519096 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1eb956-23a8-4c38-89a5-922702c1057c admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:27:32.523949 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c709c24f-6211-47e2-ad79-016b20137232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:27:32.524850 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c709c24f-6211-47e2-ad79-016b20137232 admin admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:27:32.525680 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c709c24f-6211-47e2-ad79-016b20137232 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:27:32.526101 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c709c24f-6211-47e2-ad79-016b20137232 admin admin] PATH_INFO: `/v3/roles` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:27:32.526849 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c709c24f-6211-47e2-ad79-016b20137232 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:27:32.528561 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c709c24f-6211-47e2-ad79-016b20137232 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:27:32.541797 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1213/2423] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 17:27:32 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:27:32.543708 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8346ba-c1bf-42fb-87bb-f6a7e15bbe29 admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:27:32.556668 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8346ba-c1bf-42fb-87bb-f6a7e15bbe29 admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:27:32.561719 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f16512e-d27b-4663-a3c0-21afc1084c46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:27:32.562429 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f16512e-d27b-4663-a3c0-21afc1084c46 admin admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:27:32.562773 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f16512e-d27b-4663-a3c0-21afc1084c46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:27:32.563003 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f16512e-d27b-4663-a3c0-21afc1084c46 admin admin] PATH_INFO: `/v3/roles` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:27:32.563938 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f16512e-d27b-4663-a3c0-21afc1084c46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:27:32.565584 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f16512e-d27b-4663-a3c0-21afc1084c46 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:27:32.580157 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1211/2424] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 17:27:32 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:27:32.581358 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c709c24f-6211-47e2-ad79-016b20137232 admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:27:32.589784 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:DELETE=7,keystone:SELECT=91,keystone:INSERT=2 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:27:32.593727 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c709c24f-6211-47e2-ad79-016b20137232 admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:27:32.598518 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a1b617-5a2c-4dcc-8d13-520c617f9d19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:27:32.599439 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a1b617-5a2c-4dcc-8d13-520c617f9d19 admin admin] REQUEST_METHOD: `PUT` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:27:32.599725 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a1b617-5a2c-4dcc-8d13-520c617f9d19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:27:32.600006 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a1b617-5a2c-4dcc-8d13-520c617f9d19 admin admin] PATH_INFO: `/v3/projects/88cef3be248f4a09b961c019d21a904e/users/dd6ad4f63ced44dea5905271a1266139/roles/896bff49c5d6464eb612a15f4aa9badc` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:27:32.615386 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a1b617-5a2c-4dcc-8d13-520c617f9d19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88cef3be248f4a09b961c019d21a904e, user_id=dd6ad4f63ced44dea5905271a1266139, role_id=896bff49c5d6464eb612a15f4aa9badc)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:27:32.618381 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a1b617-5a2c-4dcc-8d13-520c617f9d19 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:27:32.717298 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1214/2425] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 17:27:32 2022] PUT /identity/v3/projects/88cef3be248f4a09b961c019d21a904e/users/dd6ad4f63ced44dea5905271a1266139/roles/896bff49c5d6464eb612a15f4aa9badc => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:27:32.718479 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf7c20d-0bab-4f54-a12e-60a257af0135 None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:27:32.718777 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf7c20d-0bab-4f54-a12e-60a257af0135 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:27:32.719177 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf7c20d-0bab-4f54-a12e-60a257af0135 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:27:32.771471 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-eaf7c20d-0bab-4f54-a12e-60a257af0135 None None] MFA Rules not processed for user `dd6ad4f63ced44dea5905271a1266139`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:27:32.778551 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-eaf7c20d-0bab-4f54-a12e-60a257af0135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:27:32.863917 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1212/2426] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:27:32 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:27:32.876358 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a1b617-5a2c-4dcc-8d13-520c617f9d19 admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:27:32.878410 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-24a1b617-5a2c-4dcc-8d13-520c617f9d19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:27:32.950641 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a1b617-5a2c-4dcc-8d13-520c617f9d19 admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:27:32.955432 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038329e2-c745-491f-9045-b8e557126146 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3985eae1ec3240129eec8d1f4d8d21e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:27:32.956157 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038329e2-c745-491f-9045-b8e557126146 service glance] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:27:32.956451 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038329e2-c745-491f-9045-b8e557126146 service glance] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:27:32.956732 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038329e2-c745-491f-9045-b8e557126146 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:27:32.966654 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038329e2-c745-491f-9045-b8e557126146 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:27:32.968176 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038329e2-c745-491f-9045-b8e557126146 service glance] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:27:32.978328 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1215/2427] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:27:32 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:27:33.854688 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfa080f-3e19-4a5e-a015-fd3e9254391b None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:27:33.855199 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfa080f-3e19-4a5e-a015-fd3e9254391b None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:27:33.855426 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfa080f-3e19-4a5e-a015-fd3e9254391b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:27:33.874248 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-8cfa080f-3e19-4a5e-a015-fd3e9254391b None None] MFA Rules not processed for user `b0b96633bee24c718e8af89062493d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:27:33.875483 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-8cfa080f-3e19-4a5e-a015-fd3e9254391b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:27:33.942636 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1213/2428] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:27:33 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:27:34.890587 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:27:36.371232 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:27:37.983087 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:27:38.622122 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:27:38.906924 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:27:39.244492 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:27:39.313576 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:27:39.433876 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:27:39.542692 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:27:39.668067 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:27:39.691031 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:27:39.787953 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:27:40.005050 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:27:40.131136 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=91,keystone:INSERT=9 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:27:40.262187 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:27:40.319405 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:27:41.010927 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:27:41.204947 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:27:41.599704 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:27:41.776554 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:27:42.026658 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:27:42.055749 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:27:42.220933 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:27:42.250984 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:27:42.375165 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:27:42.405086 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:27:42.502192 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:27:42.526226 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:27:42.599660 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:27:42.690785 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:27:42.827845 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:27:43.097580 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:27:43.246749 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8608aa-683f-4878-a6ca-76fbf00c052e None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:27:43.247042 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8608aa-683f-4878-a6ca-76fbf00c052e None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:27:43.247329 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8608aa-683f-4878-a6ca-76fbf00c052e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:27:43.267393 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-4f8608aa-683f-4878-a6ca-76fbf00c052e None None] MFA Rules not processed for user `c0c8406fdc684b2bb71bb3a76b01258e`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:27:43.268653 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-4f8608aa-683f-4878-a6ca-76fbf00c052e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:27:43.334549 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1216/2429] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:27:43 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:27:43.404736 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:27:43.532703 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:27:43.667619 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:27:44.348932 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:27:44.439387 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:27:45.277831 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:27:45.466386 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:27:46.015904 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:27:46.324058 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:27:47.044969 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:27:47.370189 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:27:48.147769 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:27:48.444455 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:27:49.073052 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:27:49.318605 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:DELETE=6,keystone:SELECT=92,keystone:INSERT=2 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:27:50.135975 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:27:50.330690 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:27:50.477372 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfa080f-3e19-4a5e-a015-fd3e9254391b None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:27:50.511568 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:27:50.546158 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfa080f-3e19-4a5e-a015-fd3e9254391b None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:27:50.550705 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be21140e-3117-4fa3-8e9b-463561c93c8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:27:50.554757 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be21140e-3117-4fa3-8e9b-463561c93c8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:27:50.554757 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be21140e-3117-4fa3-8e9b-463561c93c8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:27:50.554757 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be21140e-3117-4fa3-8e9b-463561c93c8e admin admin] PATH_INFO: `/v3/users/dd6ad4f63ced44dea5905271a1266139` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:27:50.554757 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be21140e-3117-4fa3-8e9b-463561c93c8e admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd6ad4f63ced44dea5905271a1266139)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:27:50.556127 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be21140e-3117-4fa3-8e9b-463561c93c8e admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:27:50.822781 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-be21140e-3117-4fa3-8e9b-463561c93c8e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd6ad4f63ced44dea5905271a1266139'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:27:50.823374 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-be21140e-3117-4fa3-8e9b-463561c93c8e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd6ad4f63ced44dea5905271a1266139'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:27:50.823992 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-be21140e-3117-4fa3-8e9b-463561c93c8e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd6ad4f63ced44dea5905271a1266139'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:27:50.917228 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-be21140e-3117-4fa3-8e9b-463561c93c8e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd6ad4f63ced44dea5905271a1266139'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:27:50.925268 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-be21140e-3117-4fa3-8e9b-463561c93c8e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd6ad4f63ced44dea5905271a1266139'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:27:50.947450 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1214/2430] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 16 17:27:50 2022] DELETE /identity/v3/users/dd6ad4f63ced44dea5905271a1266139 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:27:50.952344 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0b4281-d6f1-422f-b50f-82481a6a2b32 None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:27:50.952694 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0b4281-d6f1-422f-b50f-82481a6a2b32 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:27:50.953040 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0b4281-d6f1-422f-b50f-82481a6a2b32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:27:50.972544 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-9f0b4281-d6f1-422f-b50f-82481a6a2b32 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:27:50.973927 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-9f0b4281-d6f1-422f-b50f-82481a6a2b32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:27:51.039550 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1217/2431] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:27:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:27:51.049489 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be21140e-3117-4fa3-8e9b-463561c93c8e admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:27:51.054389 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:27:51.054389 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-be21140e-3117-4fa3-8e9b-463561c93c8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:27:51.125141 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be21140e-3117-4fa3-8e9b-463561c93c8e admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:27:51.128871 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d6f812-0712-43f5-bf0f-4806b1e935d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5d25bfa8dc042329d57cd55fa7b7b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:27:51.129545 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d6f812-0712-43f5-bf0f-4806b1e935d8 service neutron] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:27:51.129880 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d6f812-0712-43f5-bf0f-4806b1e935d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:27:51.130182 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d6f812-0712-43f5-bf0f-4806b1e935d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:27:51.139803 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d6f812-0712-43f5-bf0f-4806b1e935d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:27:51.141270 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d6f812-0712-43f5-bf0f-4806b1e935d8 service neutron] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:27:51.151326 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1215/2432] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:27:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:27:51.547821 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0b4281-d6f1-422f-b50f-82481a6a2b32 None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:27:51.549445 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-9f0b4281-d6f1-422f-b50f-82481a6a2b32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:27:51.559113 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:27:51.564434 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0b4281-d6f1-422f-b50f-82481a6a2b32 None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:27:51.569410 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5c9a3a-3602-4e37-8b35-e98a0be321f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:27:51.570803 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5c9a3a-3602-4e37-8b35-e98a0be321f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:27:51.570960 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5c9a3a-3602-4e37-8b35-e98a0be321f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:27:51.571260 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5c9a3a-3602-4e37-8b35-e98a0be321f4 admin admin] PATH_INFO: `/v3/projects/88cef3be248f4a09b961c019d21a904e` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:27:51.572958 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5c9a3a-3602-4e37-8b35-e98a0be321f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=88cef3be248f4a09b961c019d21a904e)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:27:51.575007 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5c9a3a-3602-4e37-8b35-e98a0be321f4 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:27:51.720747 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-ff5c9a3a-3602-4e37-8b35-e98a0be321f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88cef3be248f4a09b961c019d21a904e', 'request_id': 'req-ff5c9a3a-3602-4e37-8b35-e98a0be321f4'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:27:51.726168 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-ff5c9a3a-3602-4e37-8b35-e98a0be321f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88cef3be248f4a09b961c019d21a904e', 'request_id': 'req-ff5c9a3a-3602-4e37-8b35-e98a0be321f4'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:27:51.816381 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-ff5c9a3a-3602-4e37-8b35-e98a0be321f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88cef3be248f4a09b961c019d21a904e', 'request_id': 'req-ff5c9a3a-3602-4e37-8b35-e98a0be321f4'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:27:51.831704 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-ff5c9a3a-3602-4e37-8b35-e98a0be321f4 admin admin] The token cache is being invalidate because project 88cef3be248f4a09b961c019d21a904e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80874) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 17:27:51.832251 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-ff5c9a3a-3602-4e37-8b35-e98a0be321f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:27:51.833159 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-ff5c9a3a-3602-4e37-8b35-e98a0be321f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:27:51.835386 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1218/2433] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 16 17:27:51 2022] DELETE /identity/v3/projects/88cef3be248f4a09b961c019d21a904e => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:27:51.841167 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3291a52-fc03-4258-9c29-907875f1e395 None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:27:51.841641 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3291a52-fc03-4258-9c29-907875f1e395 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:27:51.841788 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3291a52-fc03-4258-9c29-907875f1e395 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:27:51.846695 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:27:51.874333 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-f3291a52-fc03-4258-9c29-907875f1e395 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:27:51.875569 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-f3291a52-fc03-4258-9c29-907875f1e395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:27:51.939421 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1216/2434] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:27:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:27:51.948053 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c53cf57-5fe6-47c5-8fe5-6e1dae80ec12 None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:27:51.948349 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c53cf57-5fe6-47c5-8fe5-6e1dae80ec12 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:27:51.948633 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c53cf57-5fe6-47c5-8fe5-6e1dae80ec12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:27:51.967159 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-8c53cf57-5fe6-47c5-8fe5-6e1dae80ec12 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:27:51.968360 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-8c53cf57-5fe6-47c5-8fe5-6e1dae80ec12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:27:51.977094 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1219/2435] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:27:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:27:51.981481 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3291a52-fc03-4258-9c29-907875f1e395 None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:27:51.985977 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:DELETE=3,keystone:SELECT=97 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:27:51.991275 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3291a52-fc03-4258-9c29-907875f1e395 None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:27:51.995911 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab488ca-4cc2-4d6b-9401-8d7b00681681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:27:51.996569 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab488ca-4cc2-4d6b-9401-8d7b00681681 admin admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:27:51.996858 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab488ca-4cc2-4d6b-9401-8d7b00681681 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:27:51.997136 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab488ca-4cc2-4d6b-9401-8d7b00681681 admin admin] PATH_INFO: `/v3/domains` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:27:51.997909 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab488ca-4cc2-4d6b-9401-8d7b00681681 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80873) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:27:51.998222 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab488ca-4cc2-4d6b-9401-8d7b00681681 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:27:51.999847 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab488ca-4cc2-4d6b-9401-8d7b00681681 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:27:52.011804 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1217/2436] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 16 17:27:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:27:52.016121 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c53cf57-5fe6-47c5-8fe5-6e1dae80ec12 None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:27:52.021891 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:27:52.026151 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c53cf57-5fe6-47c5-8fe5-6e1dae80ec12 None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:27:52.030915 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102446f7-ed01-4aeb-af9d-263c770603c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:27:52.031626 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102446f7-ed01-4aeb-af9d-263c770603c5 admin admin] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:27:52.031918 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102446f7-ed01-4aeb-af9d-263c770603c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:27:52.032199 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102446f7-ed01-4aeb-af9d-263c770603c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:27:52.032913 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102446f7-ed01-4aeb-af9d-263c770603c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:27:52.034870 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102446f7-ed01-4aeb-af9d-263c770603c5 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:27:52.123633 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1220/2437] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 16 17:27:52 2022] POST /identity/v3/projects => generated 373 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:27:52.124834 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:27:52.124983 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab488ca-4cc2-4d6b-9401-8d7b00681681 admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:27:52.135566 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab488ca-4cc2-4d6b-9401-8d7b00681681 admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:27:52.196642 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:27:52.206049 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54095180-19bf-4f4c-a80d-d936258cb13d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:27:52.206738 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54095180-19bf-4f4c-a80d-d936258cb13d admin admin] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:27:52.207014 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54095180-19bf-4f4c-a80d-d936258cb13d admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:27:52.207292 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54095180-19bf-4f4c-a80d-d936258cb13d admin admin] PATH_INFO: `/v3/users` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:27:52.207991 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54095180-19bf-4f4c-a80d-d936258cb13d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:27:52.209924 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54095180-19bf-4f4c-a80d-d936258cb13d admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:27:52.335662 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1218/2438] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 16 17:27:52 2022] POST /identity/v3/users => generated 287 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:27:52.339723 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102446f7-ed01-4aeb-af9d-263c770603c5 admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:27:52.350157 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102446f7-ed01-4aeb-af9d-263c770603c5 admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:27:52.354820 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805fc36c-1d56-4f04-87c6-57ff7480834d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:27:52.355505 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805fc36c-1d56-4f04-87c6-57ff7480834d admin admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:27:52.355853 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805fc36c-1d56-4f04-87c6-57ff7480834d admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:27:52.356078 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805fc36c-1d56-4f04-87c6-57ff7480834d admin admin] PATH_INFO: `/v3/roles` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:27:52.356804 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805fc36c-1d56-4f04-87c6-57ff7480834d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:27:52.358429 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805fc36c-1d56-4f04-87c6-57ff7480834d admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:27:52.368747 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1221/2439] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 17:27:52 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:27:52.372658 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54095180-19bf-4f4c-a80d-d936258cb13d admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:27:52.382772 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54095180-19bf-4f4c-a80d-d936258cb13d admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:27:52.386226 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:27:52.388056 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f42123-7865-4e62-851d-64e2124ba1d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:27:52.388724 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f42123-7865-4e62-851d-64e2124ba1d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:27:52.389018 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f42123-7865-4e62-851d-64e2124ba1d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:27:52.389302 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f42123-7865-4e62-851d-64e2124ba1d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:27:52.390066 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f42123-7865-4e62-851d-64e2124ba1d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:27:52.395585 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f42123-7865-4e62-851d-64e2124ba1d9 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:27:52.401702 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1219/2440] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 17:27:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:27:52.406149 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805fc36c-1d56-4f04-87c6-57ff7480834d admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:27:52.418392 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805fc36c-1d56-4f04-87c6-57ff7480834d admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:27:52.423596 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964459cd-b06b-44c1-8c2b-083f2dbe134d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:27:52.424722 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964459cd-b06b-44c1-8c2b-083f2dbe134d admin admin] REQUEST_METHOD: `PUT` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:27:52.425017 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964459cd-b06b-44c1-8c2b-083f2dbe134d admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:27:52.425302 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964459cd-b06b-44c1-8c2b-083f2dbe134d admin admin] PATH_INFO: `/v3/projects/adaac935ec214142b9a841a0968d66a6/users/07d1e0981f9a40978db32700b0c0df3c/roles/896bff49c5d6464eb612a15f4aa9badc` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:27:52.429208 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:27:52.443243 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964459cd-b06b-44c1-8c2b-083f2dbe134d admin admin] RBAC: Authorizing `identity:create_grant(project_id=adaac935ec214142b9a841a0968d66a6, user_id=07d1e0981f9a40978db32700b0c0df3c, role_id=896bff49c5d6464eb612a15f4aa9badc)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:27:52.449486 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964459cd-b06b-44c1-8c2b-083f2dbe134d admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:27:52.966006 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1222/2441] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 17:27:52 2022] PUT /identity/v3/projects/adaac935ec214142b9a841a0968d66a6/users/07d1e0981f9a40978db32700b0c0df3c/roles/896bff49c5d6464eb612a15f4aa9badc => generated 0 bytes in 560 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:27:52.977133 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758b1d05-9cb3-4d6e-8ffb-7bb63ec04c15 None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:27:52.977684 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758b1d05-9cb3-4d6e-8ffb-7bb63ec04c15 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:27:52.977947 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758b1d05-9cb3-4d6e-8ffb-7bb63ec04c15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:27:53.007682 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-758b1d05-9cb3-4d6e-8ffb-7bb63ec04c15 None None] MFA Rules not processed for user `07d1e0981f9a40978db32700b0c0df3c`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:27:53.008982 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-758b1d05-9cb3-4d6e-8ffb-7bb63ec04c15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:27:53.085262 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1220/2442] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:27:52 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:27:53.087067 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964459cd-b06b-44c1-8c2b-083f2dbe134d admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:27:53.155539 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964459cd-b06b-44c1-8c2b-083f2dbe134d admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:27:53.160573 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a741fa-3621-4f78-b9d7-960d8c475fce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:27:53.161238 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a741fa-3621-4f78-b9d7-960d8c475fce admin admin] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:27:53.161529 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a741fa-3621-4f78-b9d7-960d8c475fce admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:27:53.161864 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a741fa-3621-4f78-b9d7-960d8c475fce admin admin] PATH_INFO: `/v3/projects` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:27:53.162677 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a741fa-3621-4f78-b9d7-960d8c475fce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:27:53.165375 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a741fa-3621-4f78-b9d7-960d8c475fce admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:27:53.177223 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:27:53.210442 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:27:53.328945 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1223/2443] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 16 17:27:53 2022] POST /identity/v3/projects => generated 373 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:27:53.333563 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758b1d05-9cb3-4d6e-8ffb-7bb63ec04c15 None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:27:53.348703 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758b1d05-9cb3-4d6e-8ffb-7bb63ec04c15 None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:27:53.421311 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6000c0b4-9084-426d-8c43-663e3c46cb89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:27:53.422278 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6000c0b4-9084-426d-8c43-663e3c46cb89 admin admin] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:27:53.422795 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6000c0b4-9084-426d-8c43-663e3c46cb89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:27:53.423150 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6000c0b4-9084-426d-8c43-663e3c46cb89 admin admin] PATH_INFO: `/v3/users` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:27:53.424345 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6000c0b4-9084-426d-8c43-663e3c46cb89 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:27:53.426557 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6000c0b4-9084-426d-8c43-663e3c46cb89 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:27:53.512977 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1221/2444] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 16 17:27:53 2022] POST /identity/v3/users => generated 293 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 17:27:53.517044 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a741fa-3621-4f78-b9d7-960d8c475fce admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:27:53.518678 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:27:53.527377 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a741fa-3621-4f78-b9d7-960d8c475fce admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:27:53.534065 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e74123-5dfb-4023-b08c-688ad9e6ed93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:27:53.534065 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e74123-5dfb-4023-b08c-688ad9e6ed93 admin admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:27:53.534065 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e74123-5dfb-4023-b08c-688ad9e6ed93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:27:53.534521 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e74123-5dfb-4023-b08c-688ad9e6ed93 admin admin] PATH_INFO: `/v3/roles` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:27:53.535276 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e74123-5dfb-4023-b08c-688ad9e6ed93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:27:53.536900 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e74123-5dfb-4023-b08c-688ad9e6ed93 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:27:53.548218 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1224/2445] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 17:27:53 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:27:53.552286 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6000c0b4-9084-426d-8c43-663e3c46cb89 admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:27:53.563050 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6000c0b4-9084-426d-8c43-663e3c46cb89 admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:27:53.567708 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227b067f-1f90-4b7b-bb7a-4d1c32766c48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:27:53.568593 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227b067f-1f90-4b7b-bb7a-4d1c32766c48 admin admin] REQUEST_METHOD: `PUT` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:27:53.568883 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227b067f-1f90-4b7b-bb7a-4d1c32766c48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:27:53.569166 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227b067f-1f90-4b7b-bb7a-4d1c32766c48 admin admin] PATH_INFO: `/v3/projects/4eba6be982174a1a8d24bef4169e0a03/users/612b8d1152554e558e0c3036ef1e0274/roles/dba744f8ab2a4c45b9d3212f8d203aba` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:27:53.584134 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227b067f-1f90-4b7b-bb7a-4d1c32766c48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4eba6be982174a1a8d24bef4169e0a03, user_id=612b8d1152554e558e0c3036ef1e0274, role_id=dba744f8ab2a4c45b9d3212f8d203aba)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:27:53.586904 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227b067f-1f90-4b7b-bb7a-4d1c32766c48 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:27:53.591644 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:DELETE=6,keystone:SELECT=89,keystone:INSERT=5 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:27:53.655153 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1222/2446] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 17:27:53 2022] PUT /identity/v3/projects/4eba6be982174a1a8d24bef4169e0a03/users/612b8d1152554e558e0c3036ef1e0274/roles/dba744f8ab2a4c45b9d3212f8d203aba => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:27:53.659892 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e74123-5dfb-4023-b08c-688ad9e6ed93 admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:27:53.676409 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e74123-5dfb-4023-b08c-688ad9e6ed93 admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:27:53.752668 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685ccfbb-a402-4bfa-9edd-61cc51472f55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:27:53.756210 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685ccfbb-a402-4bfa-9edd-61cc51472f55 admin admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:27:53.756210 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685ccfbb-a402-4bfa-9edd-61cc51472f55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:27:53.756210 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685ccfbb-a402-4bfa-9edd-61cc51472f55 admin admin] PATH_INFO: `/v3/roles` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:27:53.756210 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685ccfbb-a402-4bfa-9edd-61cc51472f55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:27:53.756548 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685ccfbb-a402-4bfa-9edd-61cc51472f55 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:27:53.766609 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1225/2447] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 17:27:53 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:27:53.771403 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227b067f-1f90-4b7b-bb7a-4d1c32766c48 admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:27:53.780076 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:27:53.785105 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227b067f-1f90-4b7b-bb7a-4d1c32766c48 admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:27:53.790411 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c36c258-6ad2-448e-920e-dc2b8eaafc7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:27:53.791379 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c36c258-6ad2-448e-920e-dc2b8eaafc7e admin admin] REQUEST_METHOD: `PUT` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:27:53.791666 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c36c258-6ad2-448e-920e-dc2b8eaafc7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:27:53.791945 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c36c258-6ad2-448e-920e-dc2b8eaafc7e admin admin] PATH_INFO: `/v3/projects/4eba6be982174a1a8d24bef4169e0a03/users/612b8d1152554e558e0c3036ef1e0274/roles/dba744f8ab2a4c45b9d3212f8d203aba` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:27:53.794114 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c36c258-6ad2-448e-920e-dc2b8eaafc7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=4eba6be982174a1a8d24bef4169e0a03, user_id=612b8d1152554e558e0c3036ef1e0274, role_id=dba744f8ab2a4c45b9d3212f8d203aba)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:27:53.796870 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c36c258-6ad2-448e-920e-dc2b8eaafc7e admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:27:53.804861 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:27:53.807916 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1223/2448] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 17:27:53 2022] PUT /identity/v3/projects/4eba6be982174a1a8d24bef4169e0a03/users/612b8d1152554e558e0c3036ef1e0274/roles/dba744f8ab2a4c45b9d3212f8d203aba => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:27:53.818888 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1f8185-08c8-4d19-b430-dec719a5ffbc None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:27:53.819210 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1f8185-08c8-4d19-b430-dec719a5ffbc None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:27:53.819635 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1f8185-08c8-4d19-b430-dec719a5ffbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:27:53.847701 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-ce1f8185-08c8-4d19-b430-dec719a5ffbc None None] MFA Rules not processed for user `612b8d1152554e558e0c3036ef1e0274`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:27:53.848980 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-ce1f8185-08c8-4d19-b430-dec719a5ffbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:27:53.926591 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1226/2449] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:27:53 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:27:53.937523 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c36c258-6ad2-448e-920e-dc2b8eaafc7e admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:27:53.939246 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-5c36c258-6ad2-448e-920e-dc2b8eaafc7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:27:54.022033 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c36c258-6ad2-448e-920e-dc2b8eaafc7e admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:27:54.026518 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f1518f-6d67-4f21-bb97-0b9fee0d2efb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef37136b89d34edc9cd94c7aa81b2095', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:27:54.027172 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f1518f-6d67-4f21-bb97-0b9fee0d2efb service cinder] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:27:54.027461 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f1518f-6d67-4f21-bb97-0b9fee0d2efb service cinder] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:27:54.027741 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f1518f-6d67-4f21-bb97-0b9fee0d2efb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:27:54.088699 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f1518f-6d67-4f21-bb97-0b9fee0d2efb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:27:54.090077 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f1518f-6d67-4f21-bb97-0b9fee0d2efb service cinder] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:27:54.099177 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1224/2450] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:27:53 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:27:54.107265 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:27:54.135946 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:27:54.317280 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:27:54.621494 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:27:54.879680 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:27:56.588386 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:27:56.905664 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:27:57.114146 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:27:57.313536 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1f8185-08c8-4d19-b430-dec719a5ffbc None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:27:57.376263 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:27:57.380252 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1f8185-08c8-4d19-b430-dec719a5ffbc None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:27:57.385610 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aec466-eb90-4bae-a108-dc341aadfb15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:27:57.390748 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aec466-eb90-4bae-a108-dc341aadfb15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:27:57.390748 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aec466-eb90-4bae-a108-dc341aadfb15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:27:57.390748 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aec466-eb90-4bae-a108-dc341aadfb15 admin admin] PATH_INFO: `/v3/users/07d1e0981f9a40978db32700b0c0df3c` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:27:57.390748 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3aec466-eb90-4bae-a108-dc341aadfb15 admin admin] RBAC: Authorizing `identity:delete_user(user_id=07d1e0981f9a40978db32700b0c0df3c)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:27:57.390748 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3aec466-eb90-4bae-a108-dc341aadfb15 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:27:57.636686 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-f3aec466-eb90-4bae-a108-dc341aadfb15 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07d1e0981f9a40978db32700b0c0df3c'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:27:57.644110 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-f3aec466-eb90-4bae-a108-dc341aadfb15 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07d1e0981f9a40978db32700b0c0df3c'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:27:57.741039 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-f3aec466-eb90-4bae-a108-dc341aadfb15 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07d1e0981f9a40978db32700b0c0df3c'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:27:57.741676 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-f3aec466-eb90-4bae-a108-dc341aadfb15 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07d1e0981f9a40978db32700b0c0df3c'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:27:57.757818 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-f3aec466-eb90-4bae-a108-dc341aadfb15 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07d1e0981f9a40978db32700b0c0df3c'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:27:57.768690 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1227/2451] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 16 17:27:57 2022] DELETE /identity/v3/users/07d1e0981f9a40978db32700b0c0df3c => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:27:57.769903 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6ae3e0-9caf-46c0-86d5-e501952d8263 None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:27:57.770422 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6ae3e0-9caf-46c0-86d5-e501952d8263 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:27:57.770519 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6ae3e0-9caf-46c0-86d5-e501952d8263 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:27:57.788566 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-1a6ae3e0-9caf-46c0-86d5-e501952d8263 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:27:57.789816 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-1a6ae3e0-9caf-46c0-86d5-e501952d8263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:27:57.849682 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1225/2452] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:27:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:27:57.859863 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aec466-eb90-4bae-a108-dc341aadfb15 admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:27:57.861428 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-f3aec466-eb90-4bae-a108-dc341aadfb15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:27:57.926556 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aec466-eb90-4bae-a108-dc341aadfb15 admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:27:57.930334 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f52560-4e46-45da-a29c-c41a0d42cdc7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5d25bfa8dc042329d57cd55fa7b7b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:27:57.930988 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f52560-4e46-45da-a29c-c41a0d42cdc7 service neutron] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:27:57.931302 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f52560-4e46-45da-a29c-c41a0d42cdc7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:27:57.932125 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f52560-4e46-45da-a29c-c41a0d42cdc7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:27:57.941375 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f52560-4e46-45da-a29c-c41a0d42cdc7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:27:57.942851 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f52560-4e46-45da-a29c-c41a0d42cdc7 service neutron] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:27:57.952790 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1228/2453] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:27:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:27:58.428713 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6ae3e0-9caf-46c0-86d5-e501952d8263 None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:27:58.430352 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-1a6ae3e0-9caf-46c0-86d5-e501952d8263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:27:58.442437 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6ae3e0-9caf-46c0-86d5-e501952d8263 None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:27:58.447460 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bab37ce-7895-43c2-9d73-fdfc0434928c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:27:58.448325 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bab37ce-7895-43c2-9d73-fdfc0434928c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:27:58.448615 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bab37ce-7895-43c2-9d73-fdfc0434928c admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:27:58.448901 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bab37ce-7895-43c2-9d73-fdfc0434928c admin admin] PATH_INFO: `/v3/projects/adaac935ec214142b9a841a0968d66a6` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:27:58.450145 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bab37ce-7895-43c2-9d73-fdfc0434928c admin admin] RBAC: Authorizing `identity:delete_project(project_id=adaac935ec214142b9a841a0968d66a6)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:27:58.452098 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bab37ce-7895-43c2-9d73-fdfc0434928c admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:27:58.584855 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-9bab37ce-7895-43c2-9d73-fdfc0434928c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'adaac935ec214142b9a841a0968d66a6', 'request_id': 'req-9bab37ce-7895-43c2-9d73-fdfc0434928c'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:27:58.591901 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-9bab37ce-7895-43c2-9d73-fdfc0434928c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'adaac935ec214142b9a841a0968d66a6', 'request_id': 'req-9bab37ce-7895-43c2-9d73-fdfc0434928c'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:27:58.597754 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-9bab37ce-7895-43c2-9d73-fdfc0434928c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'adaac935ec214142b9a841a0968d66a6', 'request_id': 'req-9bab37ce-7895-43c2-9d73-fdfc0434928c'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:27:58.600817 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:27:58.728597 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-9bab37ce-7895-43c2-9d73-fdfc0434928c admin admin] The token cache is being invalidate because project adaac935ec214142b9a841a0968d66a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80873) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 17:27:58.728901 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-9bab37ce-7895-43c2-9d73-fdfc0434928c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:27:58.729580 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-9bab37ce-7895-43c2-9d73-fdfc0434928c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:27:58.731234 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1226/2454] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 16 17:27:58 2022] DELETE /identity/v3/projects/adaac935ec214142b9a841a0968d66a6 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:27:58.736747 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f52560-4e46-45da-a29c-c41a0d42cdc7 service neutron] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:27:58.749003 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f52560-4e46-45da-a29c-c41a0d42cdc7 service neutron] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:27:58.809128 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5f3825-4e98-4517-a5cb-7655e5a8f157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:27:58.813005 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5f3825-4e98-4517-a5cb-7655e5a8f157 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:27:58.813005 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5f3825-4e98-4517-a5cb-7655e5a8f157 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:27:58.813005 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5f3825-4e98-4517-a5cb-7655e5a8f157 admin admin] PATH_INFO: `/v3/users/612b8d1152554e558e0c3036ef1e0274` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:27:58.813005 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5f3825-4e98-4517-a5cb-7655e5a8f157 admin admin] RBAC: Authorizing `identity:delete_user(user_id=612b8d1152554e558e0c3036ef1e0274)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:27:58.813684 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5f3825-4e98-4517-a5cb-7655e5a8f157 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:27:58.837106 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:27:59.082997 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-bc5f3825-4e98-4517-a5cb-7655e5a8f157 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '612b8d1152554e558e0c3036ef1e0274'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:27:59.090071 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-bc5f3825-4e98-4517-a5cb-7655e5a8f157 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '612b8d1152554e558e0c3036ef1e0274'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:27:59.192127 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-bc5f3825-4e98-4517-a5cb-7655e5a8f157 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '612b8d1152554e558e0c3036ef1e0274'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:27:59.192755 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-bc5f3825-4e98-4517-a5cb-7655e5a8f157 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '612b8d1152554e558e0c3036ef1e0274'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:27:59.207119 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-bc5f3825-4e98-4517-a5cb-7655e5a8f157 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '612b8d1152554e558e0c3036ef1e0274'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:27:59.214515 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1229/2455] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 16 17:27:58 2022] DELETE /identity/v3/users/612b8d1152554e558e0c3036ef1e0274 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:27:59.716019 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bab37ce-7895-43c2-9d73-fdfc0434928c admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:27:59.718219 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-9bab37ce-7895-43c2-9d73-fdfc0434928c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:27:59.747543 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bab37ce-7895-43c2-9d73-fdfc0434928c admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:27:59.809602 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95680693-432a-4040-af56-5f323fd6d37f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:27:59.810517 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95680693-432a-4040-af56-5f323fd6d37f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:27:59.810815 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95680693-432a-4040-af56-5f323fd6d37f admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:27:59.811102 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95680693-432a-4040-af56-5f323fd6d37f admin admin] PATH_INFO: `/v3/projects/4eba6be982174a1a8d24bef4169e0a03` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:27:59.812319 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95680693-432a-4040-af56-5f323fd6d37f admin admin] RBAC: Authorizing `identity:delete_project(project_id=4eba6be982174a1a8d24bef4169e0a03)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:27:59.814259 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95680693-432a-4040-af56-5f323fd6d37f admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:27:59.966834 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-95680693-432a-4040-af56-5f323fd6d37f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4eba6be982174a1a8d24bef4169e0a03', 'request_id': 'req-95680693-432a-4040-af56-5f323fd6d37f'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:27:59.973186 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-95680693-432a-4040-af56-5f323fd6d37f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4eba6be982174a1a8d24bef4169e0a03', 'request_id': 'req-95680693-432a-4040-af56-5f323fd6d37f'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:27:59.978729 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-95680693-432a-4040-af56-5f323fd6d37f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4eba6be982174a1a8d24bef4169e0a03', 'request_id': 'req-95680693-432a-4040-af56-5f323fd6d37f'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:28:00.032472 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-95680693-432a-4040-af56-5f323fd6d37f admin admin] The token cache is being invalidate because project 4eba6be982174a1a8d24bef4169e0a03 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80873) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 17:28:00.032760 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-95680693-432a-4040-af56-5f323fd6d37f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:28:00.033378 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-95680693-432a-4040-af56-5f323fd6d37f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:28:00.034952 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1227/2456] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 16 17:27:59 2022] DELETE /identity/v3/projects/4eba6be982174a1a8d24bef4169e0a03 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:28:00.039818 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fed511-6b37-48c0-a317-04f916f44c15 None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:28:00.040273 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fed511-6b37-48c0-a317-04f916f44c15 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:28:00.040397 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fed511-6b37-48c0-a317-04f916f44c15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:28:00.061121 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-59fed511-6b37-48c0-a317-04f916f44c15 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:28:00.062593 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-59fed511-6b37-48c0-a317-04f916f44c15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:28:00.125232 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1230/2457] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:28:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:28:00.133871 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5811165-f644-46fd-9a1a-893a4a63f886 None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:28:00.134172 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5811165-f644-46fd-9a1a-893a4a63f886 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:28:00.134889 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5811165-f644-46fd-9a1a-893a4a63f886 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:28:00.152972 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-f5811165-f644-46fd-9a1a-893a4a63f886 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:28:00.154144 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-f5811165-f644-46fd-9a1a-893a4a63f886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:28:00.162217 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1228/2458] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:28:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:28:00.167239 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fed511-6b37-48c0-a317-04f916f44c15 None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:28:00.177124 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fed511-6b37-48c0-a317-04f916f44c15 None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:28:00.182529 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50488110-98ee-4b85-9a6a-2d1b6d0b7cdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:28:00.183178 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50488110-98ee-4b85-9a6a-2d1b6d0b7cdb admin admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:28:00.183634 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50488110-98ee-4b85-9a6a-2d1b6d0b7cdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:28:00.183750 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50488110-98ee-4b85-9a6a-2d1b6d0b7cdb admin admin] PATH_INFO: `/v3/domains` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:28:00.184475 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50488110-98ee-4b85-9a6a-2d1b6d0b7cdb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:28:00.184789 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50488110-98ee-4b85-9a6a-2d1b6d0b7cdb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:28:00.186474 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50488110-98ee-4b85-9a6a-2d1b6d0b7cdb admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:28:00.198983 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1231/2459] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 16 17:28:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:28:00.203623 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5811165-f644-46fd-9a1a-893a4a63f886 None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:28:00.214209 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5811165-f644-46fd-9a1a-893a4a63f886 None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:28:00.218860 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874bf1c9-090d-4d6a-b1b7-1c029befba45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:28:00.219514 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874bf1c9-090d-4d6a-b1b7-1c029befba45 admin admin] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:28:00.219796 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874bf1c9-090d-4d6a-b1b7-1c029befba45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:28:00.220072 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874bf1c9-090d-4d6a-b1b7-1c029befba45 admin admin] PATH_INFO: `/v3/projects` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:28:00.220777 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874bf1c9-090d-4d6a-b1b7-1c029befba45 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:28:00.222706 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874bf1c9-090d-4d6a-b1b7-1c029befba45 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:28:00.331726 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1229/2460] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 16 17:28:00 2022] POST /identity/v3/projects => generated 371 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:28:00.335665 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50488110-98ee-4b85-9a6a-2d1b6d0b7cdb admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:28:00.345976 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50488110-98ee-4b85-9a6a-2d1b6d0b7cdb admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:28:00.404350 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f679cbf0-1bb1-4a89-b995-6a2f52264a94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:28:00.404970 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f679cbf0-1bb1-4a89-b995-6a2f52264a94 admin admin] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:28:00.405263 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f679cbf0-1bb1-4a89-b995-6a2f52264a94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:28:00.405546 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f679cbf0-1bb1-4a89-b995-6a2f52264a94 admin admin] PATH_INFO: `/v3/users` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:28:00.406284 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f679cbf0-1bb1-4a89-b995-6a2f52264a94 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:28:00.408265 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f679cbf0-1bb1-4a89-b995-6a2f52264a94 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:28:00.523093 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1232/2461] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 16 17:28:00 2022] POST /identity/v3/users => generated 286 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:28:00.527964 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874bf1c9-090d-4d6a-b1b7-1c029befba45 admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:28:00.539483 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874bf1c9-090d-4d6a-b1b7-1c029befba45 admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:28:00.544717 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f1ec4a-0a39-48b4-874d-925b5f09148e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:28:00.545386 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f1ec4a-0a39-48b4-874d-925b5f09148e admin admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:28:00.545679 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f1ec4a-0a39-48b4-874d-925b5f09148e admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:28:00.546014 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f1ec4a-0a39-48b4-874d-925b5f09148e admin admin] PATH_INFO: `/v3/roles` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:28:00.546733 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f1ec4a-0a39-48b4-874d-925b5f09148e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:28:00.548337 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f1ec4a-0a39-48b4-874d-925b5f09148e admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:28:00.559578 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1230/2462] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 17:28:00 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 17:28:00.563757 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f679cbf0-1bb1-4a89-b995-6a2f52264a94 admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:28:00.573950 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f679cbf0-1bb1-4a89-b995-6a2f52264a94 admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:28:00.578515 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f4a620-fc2c-46b1-9262-6ebea4347f9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:28:00.579163 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f4a620-fc2c-46b1-9262-6ebea4347f9d admin admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:28:00.579451 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f4a620-fc2c-46b1-9262-6ebea4347f9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:28:00.579731 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f4a620-fc2c-46b1-9262-6ebea4347f9d admin admin] PATH_INFO: `/v3/roles` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:28:00.580454 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f4a620-fc2c-46b1-9262-6ebea4347f9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:28:00.582069 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f4a620-fc2c-46b1-9262-6ebea4347f9d admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:28:00.593814 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1233/2463] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 17:28:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:28:00.597967 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f1ec4a-0a39-48b4-874d-925b5f09148e admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:28:00.609225 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f1ec4a-0a39-48b4-874d-925b5f09148e admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:28:00.613905 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecde879e-db6a-4fde-8059-782ab8e38cf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:28:00.614782 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecde879e-db6a-4fde-8059-782ab8e38cf5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:28:00.615072 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecde879e-db6a-4fde-8059-782ab8e38cf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:28:00.615356 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecde879e-db6a-4fde-8059-782ab8e38cf5 admin admin] PATH_INFO: `/v3/projects/d8b35c5dd8424877bac4e7d13043ef35/users/04b9ecfcdac9465caa1fce10a7537826/roles/896bff49c5d6464eb612a15f4aa9badc` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:28:00.632404 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecde879e-db6a-4fde-8059-782ab8e38cf5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8b35c5dd8424877bac4e7d13043ef35, user_id=04b9ecfcdac9465caa1fce10a7537826, role_id=896bff49c5d6464eb612a15f4aa9badc)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:28:00.636103 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecde879e-db6a-4fde-8059-782ab8e38cf5 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:28:00.752970 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1231/2464] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 17:28:00 2022] PUT /identity/v3/projects/d8b35c5dd8424877bac4e7d13043ef35/users/04b9ecfcdac9465caa1fce10a7537826/roles/896bff49c5d6464eb612a15f4aa9badc => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:28:00.765742 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a35c2e-2d5d-407e-9e76-d83ee8474876 None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:28:00.766071 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a35c2e-2d5d-407e-9e76-d83ee8474876 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:28:00.766380 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a35c2e-2d5d-407e-9e76-d83ee8474876 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:28:00.773267 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:28:00.793795 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-09a35c2e-2d5d-407e-9e76-d83ee8474876 None None] MFA Rules not processed for user `04b9ecfcdac9465caa1fce10a7537826`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:28:00.796387 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-09a35c2e-2d5d-407e-9e76-d83ee8474876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:28:00.865573 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1234/2465] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:28:00 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:28:00.876555 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecde879e-db6a-4fde-8059-782ab8e38cf5 admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:28:00.878308 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-ecde879e-db6a-4fde-8059-782ab8e38cf5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:28:00.902042 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:DELETE=8,keystone:SELECT=89,keystone:INSERT=3 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:28:00.939570 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecde879e-db6a-4fde-8059-782ab8e38cf5 admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:28:00.943211 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6831ee1-d8ad-4885-90d0-798859155142 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3985eae1ec3240129eec8d1f4d8d21e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:28:00.944000 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6831ee1-d8ad-4885-90d0-798859155142 service glance] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:28:00.944296 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6831ee1-d8ad-4885-90d0-798859155142 service glance] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:28:00.944580 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6831ee1-d8ad-4885-90d0-798859155142 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:28:00.953640 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6831ee1-d8ad-4885-90d0-798859155142 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:28:00.956354 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6831ee1-d8ad-4885-90d0-798859155142 service glance] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:28:00.965035 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1232/2466] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:28:00 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:28:05.313702 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f92748-d58c-4dde-8f7f-cc9cdf3cf65c None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:28:05.314150 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f92748-d58c-4dde-8f7f-cc9cdf3cf65c None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:28:05.314297 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f92748-d58c-4dde-8f7f-cc9cdf3cf65c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:28:05.345292 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-73f92748-d58c-4dde-8f7f-cc9cdf3cf65c None None] MFA Rules not processed for user `f7f35c1c15a84a92863d4f3f96d76830`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:28:05.346522 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-73f92748-d58c-4dde-8f7f-cc9cdf3cf65c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:28:05.412978 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1235/2467] 10.222.0.39 () {58 vars in 1009 bytes} [Thu Jun 16 17:28:05 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:28:05.465343 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6831ee1-d8ad-4885-90d0-798859155142 service glance] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:28:05.465343 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-e6831ee1-d8ad-4885-90d0-798859155142 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:28:05.537664 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6831ee1-d8ad-4885-90d0-798859155142 service glance] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:28:05.542875 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f5ef06-361b-46e7-8ea4-1bb2f242c23b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbec2dfe63764ed88a23e172ead0afa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:28:05.543531 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f5ef06-361b-46e7-8ea4-1bb2f242c23b service swift] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:28:05.543824 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f5ef06-361b-46e7-8ea4-1bb2f242c23b service swift] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:28:05.544108 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f5ef06-361b-46e7-8ea4-1bb2f242c23b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:28:05.552334 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f5ef06-361b-46e7-8ea4-1bb2f242c23b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:28:05.553951 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f5ef06-361b-46e7-8ea4-1bb2f242c23b service swift] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:28:05.562158 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1233/2468] 10.222.0.39 () {60 vars in 1384 bytes} [Thu Jun 16 17:28:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 16 17:28:12.448631 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b435d397-ad95-484a-bb56-0b8102cd9a26 None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:28:12.449273 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b435d397-ad95-484a-bb56-0b8102cd9a26 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:28:12.449581 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b435d397-ad95-484a-bb56-0b8102cd9a26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:28:12.474314 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-b435d397-ad95-484a-bb56-0b8102cd9a26 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:28:12.476032 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-b435d397-ad95-484a-bb56-0b8102cd9a26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:28:12.556230 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1236/2469] 10.222.0.86 () {58 vars in 1016 bytes} [Thu Jun 16 17:28:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:28:12.575019 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f5ef06-361b-46e7-8ea4-1bb2f242c23b service swift] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:28:12.576787 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-c9f5ef06-361b-46e7-8ea4-1bb2f242c23b service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:28:12.691639 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f5ef06-361b-46e7-8ea4-1bb2f242c23b service swift] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:28:12.699489 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768e19c9-844a-4787-8e3c-49c929eda67c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d381bb41dea4f1e90c3cf3815ac88dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:28:12.700475 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768e19c9-844a-4787-8e3c-49c929eda67c service nova] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:28:12.700760 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768e19c9-844a-4787-8e3c-49c929eda67c service nova] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:28:12.701070 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768e19c9-844a-4787-8e3c-49c929eda67c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:28:12.711125 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768e19c9-844a-4787-8e3c-49c929eda67c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:28:12.713407 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768e19c9-844a-4787-8e3c-49c929eda67c service nova] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:28:12.724182 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1234/2470] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:28:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:28:15.641931 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b435d397-ad95-484a-bb56-0b8102cd9a26 None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:28:15.641931 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-b435d397-ad95-484a-bb56-0b8102cd9a26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:28:15.679504 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:28:15.859581 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b435d397-ad95-484a-bb56-0b8102cd9a26 None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:28:15.864946 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a49481-c490-42c7-abac-68b489f95e8b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2882f26811094d8e88c03701c94296fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:28:15.865469 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a49481-c490-42c7-abac-68b489f95e8b service placement] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:28:15.865753 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a49481-c490-42c7-abac-68b489f95e8b service placement] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:28:15.866100 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a49481-c490-42c7-abac-68b489f95e8b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:28:15.869143 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-59a49481-c490-42c7-abac-68b489f95e8b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:28:15.882961 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a49481-c490-42c7-abac-68b489f95e8b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:28:15.888868 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a49481-c490-42c7-abac-68b489f95e8b service placement] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:28:15.899219 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1237/2471] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:28:15 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:28:17.794329 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072222dc-516f-43aa-8ed2-0c401a86aa18 None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:28:17.794950 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072222dc-516f-43aa-8ed2-0c401a86aa18 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:28:17.795133 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072222dc-516f-43aa-8ed2-0c401a86aa18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:28:17.814609 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-072222dc-516f-43aa-8ed2-0c401a86aa18 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:28:17.816190 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-072222dc-516f-43aa-8ed2-0c401a86aa18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:28:17.825754 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1235/2472] 10.222.0.86 () {58 vars in 1016 bytes} [Thu Jun 16 17:28:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:28:17.856159 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a49481-c490-42c7-abac-68b489f95e8b service placement] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:28:17.859108 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-59a49481-c490-42c7-abac-68b489f95e8b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:28:17.875659 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a49481-c490-42c7-abac-68b489f95e8b service placement] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:28:17.883083 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2979093a-e125-4c73-bef9-e1d621155f82 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d381bb41dea4f1e90c3cf3815ac88dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:28:17.883874 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2979093a-e125-4c73-bef9-e1d621155f82 service nova] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:28:17.884236 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2979093a-e125-4c73-bef9-e1d621155f82 service nova] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:28:17.884595 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2979093a-e125-4c73-bef9-e1d621155f82 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:28:17.896228 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2979093a-e125-4c73-bef9-e1d621155f82 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:28:17.898129 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2979093a-e125-4c73-bef9-e1d621155f82 service nova] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:28:17.910364 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1238/2473] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:28:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:28:23.604405 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3192de3-b180-4e5f-bdfa-dcf07dbcb7c9 None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:28:23.606831 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3192de3-b180-4e5f-bdfa-dcf07dbcb7c9 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:28:23.607369 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3192de3-b180-4e5f-bdfa-dcf07dbcb7c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:28:23.629828 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-e3192de3-b180-4e5f-bdfa-dcf07dbcb7c9 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:28:23.631717 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-e3192de3-b180-4e5f-bdfa-dcf07dbcb7c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:28:23.641874 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1236/2474] 10.222.0.86 () {58 vars in 1016 bytes} [Thu Jun 16 17:28:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:28:23.661202 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2979093a-e125-4c73-bef9-e1d621155f82 service nova] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:28:23.677372 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2979093a-e125-4c73-bef9-e1d621155f82 service nova] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:28:23.685359 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a57c2f-20a6-4e6c-ab76-2c7611c360f2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d381bb41dea4f1e90c3cf3815ac88dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:28:23.686343 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a57c2f-20a6-4e6c-ab76-2c7611c360f2 service nova] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:28:23.687009 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a57c2f-20a6-4e6c-ab76-2c7611c360f2 service nova] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:28:23.687440 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a57c2f-20a6-4e6c-ab76-2c7611c360f2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:28:23.701226 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a57c2f-20a6-4e6c-ab76-2c7611c360f2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:28:23.703294 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a57c2f-20a6-4e6c-ab76-2c7611c360f2 service nova] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:28:23.716845 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1239/2475] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:28:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:28:26.409872 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87eb654-5e63-4d2b-ad97-519a145c56e3 None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:28:26.410431 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87eb654-5e63-4d2b-ad97-519a145c56e3 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:28:26.410431 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87eb654-5e63-4d2b-ad97-519a145c56e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:28:26.418070 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:28:26.432733 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-c87eb654-5e63-4d2b-ad97-519a145c56e3 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:28:26.455892 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-c87eb654-5e63-4d2b-ad97-519a145c56e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:28:26.479503 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1237/2476] 10.222.0.86 () {58 vars in 1016 bytes} [Thu Jun 16 17:28:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:28:26.526169 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a57c2f-20a6-4e6c-ab76-2c7611c360f2 service nova] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:28:26.542009 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a57c2f-20a6-4e6c-ab76-2c7611c360f2 service nova] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:28:26.550195 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfddc0d-b696-42d4-81ef-ec267639ea23 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d381bb41dea4f1e90c3cf3815ac88dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:28:26.551162 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfddc0d-b696-42d4-81ef-ec267639ea23 service nova] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:28:26.551744 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfddc0d-b696-42d4-81ef-ec267639ea23 service nova] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:28:26.552185 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfddc0d-b696-42d4-81ef-ec267639ea23 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:28:26.563247 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfddc0d-b696-42d4-81ef-ec267639ea23 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:28:26.565109 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfddc0d-b696-42d4-81ef-ec267639ea23 service nova] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:28:26.588218 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1240/2477] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:28:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:28:29.724966 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a658262-8bc8-4e50-8e5a-6dbba354c1ce None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:28:29.725614 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a658262-8bc8-4e50-8e5a-6dbba354c1ce None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:28:29.725614 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a658262-8bc8-4e50-8e5a-6dbba354c1ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:28:29.743860 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-4a658262-8bc8-4e50-8e5a-6dbba354c1ce None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:28:29.745055 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-4a658262-8bc8-4e50-8e5a-6dbba354c1ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:28:29.753968 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1238/2478] 10.222.0.86 () {58 vars in 1016 bytes} [Thu Jun 16 17:28:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:28:29.774013 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfddc0d-b696-42d4-81ef-ec267639ea23 service nova] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:28:29.785398 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfddc0d-b696-42d4-81ef-ec267639ea23 service nova] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:28:29.791155 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3768babe-e235-4951-8b9c-37f2a5db1395 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d381bb41dea4f1e90c3cf3815ac88dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:28:29.791798 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3768babe-e235-4951-8b9c-37f2a5db1395 service nova] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:28:29.792087 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3768babe-e235-4951-8b9c-37f2a5db1395 service nova] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:28:29.792367 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3768babe-e235-4951-8b9c-37f2a5db1395 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:28:29.800643 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3768babe-e235-4951-8b9c-37f2a5db1395 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:28:29.802248 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3768babe-e235-4951-8b9c-37f2a5db1395 service nova] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:28:29.812226 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1241/2479] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:28:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:28:30.305188 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86fb779-63aa-473b-92ad-7f8e5edc474c None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:28:30.305485 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86fb779-63aa-473b-92ad-7f8e5edc474c None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:28:30.305787 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86fb779-63aa-473b-92ad-7f8e5edc474c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:28:30.353174 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-d86fb779-63aa-473b-92ad-7f8e5edc474c None None] MFA Rules not processed for user `f7f35c1c15a84a92863d4f3f96d76830`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:28:30.354414 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-d86fb779-63aa-473b-92ad-7f8e5edc474c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:28:30.371965 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1239/2480] 10.222.0.39 () {58 vars in 967 bytes} [Thu Jun 16 17:28:30 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:28:30.384578 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3768babe-e235-4951-8b9c-37f2a5db1395 service nova] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:28:30.406515 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3768babe-e235-4951-8b9c-37f2a5db1395 service nova] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:28:30.411708 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb67619e-4874-493d-a17d-ac39d4b4aa31 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbec2dfe63764ed88a23e172ead0afa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:28:30.412901 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb67619e-4874-493d-a17d-ac39d4b4aa31 service swift] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:28:30.412901 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb67619e-4874-493d-a17d-ac39d4b4aa31 service swift] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:28:30.412901 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb67619e-4874-493d-a17d-ac39d4b4aa31 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:28:30.421344 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb67619e-4874-493d-a17d-ac39d4b4aa31 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:28:30.422980 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb67619e-4874-493d-a17d-ac39d4b4aa31 service swift] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:28:30.431306 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1242/2481] 10.222.0.39 () {60 vars in 1384 bytes} [Thu Jun 16 17:28:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 17:28:32.926127 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fb314f-a430-4545-b9e2-a3c0808ce004 None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:28:32.926629 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fb314f-a430-4545-b9e2-a3c0808ce004 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:28:32.926742 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fb314f-a430-4545-b9e2-a3c0808ce004 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:28:32.946194 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-72fb314f-a430-4545-b9e2-a3c0808ce004 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:28:32.947630 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-72fb314f-a430-4545-b9e2-a3c0808ce004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:28:32.957009 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1240/2482] 10.222.0.86 () {58 vars in 1016 bytes} [Thu Jun 16 17:28:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:28:32.972260 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb67619e-4874-493d-a17d-ac39d4b4aa31 service swift] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:28:32.985344 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb67619e-4874-493d-a17d-ac39d4b4aa31 service swift] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:28:32.991818 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098155ce-d646-47a9-9a82-0a9a2730eb0c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d381bb41dea4f1e90c3cf3815ac88dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:28:32.992550 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098155ce-d646-47a9-9a82-0a9a2730eb0c service nova] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:28:32.992908 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098155ce-d646-47a9-9a82-0a9a2730eb0c service nova] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:28:32.993258 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098155ce-d646-47a9-9a82-0a9a2730eb0c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:28:33.002773 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098155ce-d646-47a9-9a82-0a9a2730eb0c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:28:33.004464 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098155ce-d646-47a9-9a82-0a9a2730eb0c service nova] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:28:33.014288 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1243/2483] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:28:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:28:33.545062 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fe4e16-e4dd-4a5d-a3b9-55362c25b1cf None None] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:28:33.545487 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fe4e16-e4dd-4a5d-a3b9-55362c25b1cf None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:28:33.545951 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fe4e16-e4dd-4a5d-a3b9-55362c25b1cf None None] PATH_INFO: `/` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:28:33.547529 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1241/2484] 10.222.0.39 () {54 vars in 921 bytes} [Thu Jun 16 17:28:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:28:33.562296 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398c9162-6cb3-4ae6-99de-66cf0f73bbe7 None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:28:33.562595 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398c9162-6cb3-4ae6-99de-66cf0f73bbe7 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:28:33.562907 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398c9162-6cb3-4ae6-99de-66cf0f73bbe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:28:33.604330 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-398c9162-6cb3-4ae6-99de-66cf0f73bbe7 None None] MFA Rules not processed for user `2882f26811094d8e88c03701c94296fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:28:33.605608 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-398c9162-6cb3-4ae6-99de-66cf0f73bbe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:28:33.615239 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1244/2485] 10.222.0.39 () {58 vars in 1018 bytes} [Thu Jun 16 17:28:33 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:28:33.641144 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fe4e16-e4dd-4a5d-a3b9-55362c25b1cf None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:28:33.642906 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-f0fe4e16-e4dd-4a5d-a3b9-55362c25b1cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:28:33.674411 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fe4e16-e4dd-4a5d-a3b9-55362c25b1cf None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:28:33.680352 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ed056f-d648-4ea8-9295-4b007ec2f746 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2882f26811094d8e88c03701c94296fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:28:33.681229 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ed056f-d648-4ea8-9295-4b007ec2f746 service placement] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:28:33.681721 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ed056f-d648-4ea8-9295-4b007ec2f746 service placement] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:28:33.682214 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ed056f-d648-4ea8-9295-4b007ec2f746 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:28:33.692676 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ed056f-d648-4ea8-9295-4b007ec2f746 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:28:33.694563 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ed056f-d648-4ea8-9295-4b007ec2f746 service placement] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:28:33.706160 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1242/2486] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:28:33 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:28:33.727927 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398c9162-6cb3-4ae6-99de-66cf0f73bbe7 None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:28:33.729507 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-398c9162-6cb3-4ae6-99de-66cf0f73bbe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:28:33.744715 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398c9162-6cb3-4ae6-99de-66cf0f73bbe7 None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:28:33.760864 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6eaa784-6d69-4650-8b2f-aff9abe269cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:28:33.760864 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eaa784-6d69-4650-8b2f-aff9abe269cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:28:33.760864 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eaa784-6d69-4650-8b2f-aff9abe269cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:28:33.760864 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eaa784-6d69-4650-8b2f-aff9abe269cf admin admin] PATH_INFO: `/v3/users/c0c8406fdc684b2bb71bb3a76b01258e` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:28:33.761227 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6eaa784-6d69-4650-8b2f-aff9abe269cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0c8406fdc684b2bb71bb3a76b01258e)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:28:33.761227 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6eaa784-6d69-4650-8b2f-aff9abe269cf admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:28:33.995664 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:28:34.001498 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-a6eaa784-6d69-4650-8b2f-aff9abe269cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0c8406fdc684b2bb71bb3a76b01258e'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:28:34.009107 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-a6eaa784-6d69-4650-8b2f-aff9abe269cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0c8406fdc684b2bb71bb3a76b01258e'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:28:34.111439 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-a6eaa784-6d69-4650-8b2f-aff9abe269cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0c8406fdc684b2bb71bb3a76b01258e'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:28:34.112211 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-a6eaa784-6d69-4650-8b2f-aff9abe269cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0c8406fdc684b2bb71bb3a76b01258e'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:28:34.130492 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-a6eaa784-6d69-4650-8b2f-aff9abe269cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0c8406fdc684b2bb71bb3a76b01258e'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:28:34.137364 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1245/2487] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 16 17:28:33 2022] DELETE /identity/v3/users/c0c8406fdc684b2bb71bb3a76b01258e => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:28:34.433557 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ed056f-d648-4ea8-9295-4b007ec2f746 service placement] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:28:34.445608 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ed056f-d648-4ea8-9295-4b007ec2f746 service placement] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:28:34.484527 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6eaa784-6d69-4650-8b2f-aff9abe269cf admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:28:34.486070 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-a6eaa784-6d69-4650-8b2f-aff9abe269cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:28:34.510032 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48cc7ec-6106-423c-a6cd-0a98646d5bf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:28:34.510925 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48cc7ec-6106-423c-a6cd-0a98646d5bf9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:28:34.511214 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48cc7ec-6106-423c-a6cd-0a98646d5bf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:28:34.511495 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48cc7ec-6106-423c-a6cd-0a98646d5bf9 admin admin] PATH_INFO: `/v3/projects/3d980b5b4c2e4145977436054db819c0` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:28:34.512781 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48cc7ec-6106-423c-a6cd-0a98646d5bf9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d980b5b4c2e4145977436054db819c0)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:28:34.514786 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48cc7ec-6106-423c-a6cd-0a98646d5bf9 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:28:34.558751 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6eaa784-6d69-4650-8b2f-aff9abe269cf admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:28:34.565062 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b509d756-4b95-46ab-b20b-322104ca5c41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:28:34.569426 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b509d756-4b95-46ab-b20b-322104ca5c41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:28:34.569426 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b509d756-4b95-46ab-b20b-322104ca5c41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:28:34.569426 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b509d756-4b95-46ab-b20b-322104ca5c41 admin admin] PATH_INFO: `/v3/users/04b9ecfcdac9465caa1fce10a7537826` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:28:34.569426 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b509d756-4b95-46ab-b20b-322104ca5c41 admin admin] RBAC: Authorizing `identity:delete_user(user_id=04b9ecfcdac9465caa1fce10a7537826)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:28:34.570160 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b509d756-4b95-46ab-b20b-322104ca5c41 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:28:34.633702 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-d48cc7ec-6106-423c-a6cd-0a98646d5bf9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d980b5b4c2e4145977436054db819c0', 'request_id': 'req-d48cc7ec-6106-423c-a6cd-0a98646d5bf9'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:28:34.640839 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-d48cc7ec-6106-423c-a6cd-0a98646d5bf9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d980b5b4c2e4145977436054db819c0', 'request_id': 'req-d48cc7ec-6106-423c-a6cd-0a98646d5bf9'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:28:34.646759 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-d48cc7ec-6106-423c-a6cd-0a98646d5bf9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d980b5b4c2e4145977436054db819c0', 'request_id': 'req-d48cc7ec-6106-423c-a6cd-0a98646d5bf9'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:28:34.731504 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-b509d756-4b95-46ab-b20b-322104ca5c41 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04b9ecfcdac9465caa1fce10a7537826'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:28:34.738467 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-b509d756-4b95-46ab-b20b-322104ca5c41 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04b9ecfcdac9465caa1fce10a7537826'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:28:34.758024 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-d48cc7ec-6106-423c-a6cd-0a98646d5bf9 admin admin] The token cache is being invalidate because project 3d980b5b4c2e4145977436054db819c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80873) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 17:28:34.758376 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-d48cc7ec-6106-423c-a6cd-0a98646d5bf9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:28:34.759048 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-d48cc7ec-6106-423c-a6cd-0a98646d5bf9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:28:34.760753 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1243/2488] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 16 17:28:34 2022] DELETE /identity/v3/projects/3d980b5b4c2e4145977436054db819c0 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:28:34.848586 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-b509d756-4b95-46ab-b20b-322104ca5c41 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04b9ecfcdac9465caa1fce10a7537826'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:28:34.849794 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-b509d756-4b95-46ab-b20b-322104ca5c41 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04b9ecfcdac9465caa1fce10a7537826'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:28:34.874565 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-b509d756-4b95-46ab-b20b-322104ca5c41 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04b9ecfcdac9465caa1fce10a7537826'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:28:34.896551 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1246/2489] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 16 17:28:34 2022] DELETE /identity/v3/users/04b9ecfcdac9465caa1fce10a7537826 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:28:34.900562 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b63df8-ab95-4e96-8f16-78d31d826d97 None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:28:34.900999 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b63df8-ab95-4e96-8f16-78d31d826d97 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:28:34.901388 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b63df8-ab95-4e96-8f16-78d31d826d97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:28:34.924710 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-18b63df8-ab95-4e96-8f16-78d31d826d97 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:28:34.927565 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-18b63df8-ab95-4e96-8f16-78d31d826d97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:28:34.969636 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:28:35.025593 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1244/2490] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:28:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 17:28:35.043380 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b509d756-4b95-46ab-b20b-322104ca5c41 admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:28:35.045383 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-b509d756-4b95-46ab-b20b-322104ca5c41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:28:35.090792 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:28:35.106510 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b509d756-4b95-46ab-b20b-322104ca5c41 admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:28:35.110433 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f96c29a-747c-4bce-97c3-b83110cc1961 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5d25bfa8dc042329d57cd55fa7b7b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:28:35.111081 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f96c29a-747c-4bce-97c3-b83110cc1961 service neutron] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:28:35.111373 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f96c29a-747c-4bce-97c3-b83110cc1961 service neutron] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:28:35.111660 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f96c29a-747c-4bce-97c3-b83110cc1961 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:28:35.120874 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f96c29a-747c-4bce-97c3-b83110cc1961 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:28:35.122463 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f96c29a-747c-4bce-97c3-b83110cc1961 service neutron] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:28:35.133023 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1247/2491] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:28:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:28:35.617127 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b63df8-ab95-4e96-8f16-78d31d826d97 None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:28:35.618915 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-18b63df8-ab95-4e96-8f16-78d31d826d97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:28:35.631590 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b63df8-ab95-4e96-8f16-78d31d826d97 None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:28:35.636333 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da44bff-dd28-41ce-abe5-2b23f1845064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:28:35.637201 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da44bff-dd28-41ce-abe5-2b23f1845064 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:28:35.637490 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da44bff-dd28-41ce-abe5-2b23f1845064 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:28:35.637784 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da44bff-dd28-41ce-abe5-2b23f1845064 admin admin] PATH_INFO: `/v3/projects/d8b35c5dd8424877bac4e7d13043ef35` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:28:35.639017 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da44bff-dd28-41ce-abe5-2b23f1845064 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8b35c5dd8424877bac4e7d13043ef35)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:28:35.640954 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da44bff-dd28-41ce-abe5-2b23f1845064 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:28:35.780780 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-7da44bff-dd28-41ce-abe5-2b23f1845064 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8b35c5dd8424877bac4e7d13043ef35', 'request_id': 'req-7da44bff-dd28-41ce-abe5-2b23f1845064'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:28:35.787239 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-7da44bff-dd28-41ce-abe5-2b23f1845064 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8b35c5dd8424877bac4e7d13043ef35', 'request_id': 'req-7da44bff-dd28-41ce-abe5-2b23f1845064'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:28:35.793059 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-7da44bff-dd28-41ce-abe5-2b23f1845064 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8b35c5dd8424877bac4e7d13043ef35', 'request_id': 'req-7da44bff-dd28-41ce-abe5-2b23f1845064'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:28:35.877583 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-7da44bff-dd28-41ce-abe5-2b23f1845064 admin admin] The token cache is being invalidate because project d8b35c5dd8424877bac4e7d13043ef35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80873) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 17:28:35.877906 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-7da44bff-dd28-41ce-abe5-2b23f1845064 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:28:35.881686 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-7da44bff-dd28-41ce-abe5-2b23f1845064 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:28:35.881686 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1245/2492] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 16 17:28:35 2022] DELETE /identity/v3/projects/d8b35c5dd8424877bac4e7d13043ef35 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:28:35.885263 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecb7454-e6fa-448a-9469-0d1c1e9da405 None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:28:35.885557 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecb7454-e6fa-448a-9469-0d1c1e9da405 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:28:35.885901 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecb7454-e6fa-448a-9469-0d1c1e9da405 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:28:35.905288 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-3ecb7454-e6fa-448a-9469-0d1c1e9da405 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:28:35.906533 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-3ecb7454-e6fa-448a-9469-0d1c1e9da405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:28:35.969002 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1248/2493] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:28:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:28:35.976982 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8710f0e7-1c39-46c9-bb8b-ed706eafa6d7 None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:28:35.977285 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8710f0e7-1c39-46c9-bb8b-ed706eafa6d7 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:28:35.977702 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8710f0e7-1c39-46c9-bb8b-ed706eafa6d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:28:35.999398 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-8710f0e7-1c39-46c9-bb8b-ed706eafa6d7 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:28:36.000950 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-8710f0e7-1c39-46c9-bb8b-ed706eafa6d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:28:36.009859 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1246/2494] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:28:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:28:36.014004 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecb7454-e6fa-448a-9469-0d1c1e9da405 None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:28:36.034034 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecb7454-e6fa-448a-9469-0d1c1e9da405 None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:28:36.054813 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8c987b-a9bf-47b2-a97d-88d1a7f38747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:28:36.054813 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8c987b-a9bf-47b2-a97d-88d1a7f38747 admin admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:28:36.054813 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8c987b-a9bf-47b2-a97d-88d1a7f38747 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:28:36.054813 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8c987b-a9bf-47b2-a97d-88d1a7f38747 admin admin] PATH_INFO: `/v3/domains` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:28:36.055678 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8c987b-a9bf-47b2-a97d-88d1a7f38747 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:28:36.055678 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8c987b-a9bf-47b2-a97d-88d1a7f38747 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:28:36.055678 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8c987b-a9bf-47b2-a97d-88d1a7f38747 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:28:36.061641 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1249/2495] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 16 17:28:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:28:36.062985 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8710f0e7-1c39-46c9-bb8b-ed706eafa6d7 None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:28:36.072937 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8710f0e7-1c39-46c9-bb8b-ed706eafa6d7 None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:28:36.077894 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f758a3-6899-47ae-9a05-54226cda6936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:28:36.078543 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f758a3-6899-47ae-9a05-54226cda6936 admin admin] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:28:36.079480 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f758a3-6899-47ae-9a05-54226cda6936 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:28:36.079480 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f758a3-6899-47ae-9a05-54226cda6936 admin admin] PATH_INFO: `/v3/projects` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:28:36.079791 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f758a3-6899-47ae-9a05-54226cda6936 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:28:36.081686 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f758a3-6899-47ae-9a05-54226cda6936 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:28:36.164618 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1247/2496] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 16 17:28:36 2022] POST /identity/v3/projects => generated 385 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:28:36.173212 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8c987b-a9bf-47b2-a97d-88d1a7f38747 admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:28:36.187133 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8c987b-a9bf-47b2-a97d-88d1a7f38747 admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:28:36.257594 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78bb0ba-c851-4ba9-8941-6cccea575b1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:28:36.258564 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78bb0ba-c851-4ba9-8941-6cccea575b1b admin admin] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:28:36.258924 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78bb0ba-c851-4ba9-8941-6cccea575b1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:28:36.259891 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78bb0ba-c851-4ba9-8941-6cccea575b1b admin admin] PATH_INFO: `/v3/users` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:28:36.260678 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78bb0ba-c851-4ba9-8941-6cccea575b1b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:28:36.262697 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78bb0ba-c851-4ba9-8941-6cccea575b1b admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:28:36.339388 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1250/2497] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 16 17:28:36 2022] POST /identity/v3/users => generated 293 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 17:28:36.345045 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f758a3-6899-47ae-9a05-54226cda6936 admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:28:36.356167 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f758a3-6899-47ae-9a05-54226cda6936 admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:28:36.364179 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a32ee4f-1b82-42b0-ad58-f413e9d0d860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:28:36.364865 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a32ee4f-1b82-42b0-ad58-f413e9d0d860 admin admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:28:36.365155 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a32ee4f-1b82-42b0-ad58-f413e9d0d860 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:28:36.365530 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a32ee4f-1b82-42b0-ad58-f413e9d0d860 admin admin] PATH_INFO: `/v3/roles` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:28:36.366218 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a32ee4f-1b82-42b0-ad58-f413e9d0d860 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:28:36.367839 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a32ee4f-1b82-42b0-ad58-f413e9d0d860 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:28:36.380359 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1248/2498] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 17:28:36 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:28:36.384671 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78bb0ba-c851-4ba9-8941-6cccea575b1b admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:28:36.395138 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78bb0ba-c851-4ba9-8941-6cccea575b1b admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:28:36.400070 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae4926a-199a-4be3-8a1c-0f496d1f7afc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:28:36.400734 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae4926a-199a-4be3-8a1c-0f496d1f7afc admin admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:28:36.401019 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae4926a-199a-4be3-8a1c-0f496d1f7afc admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:28:36.401302 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae4926a-199a-4be3-8a1c-0f496d1f7afc admin admin] PATH_INFO: `/v3/roles` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:28:36.402095 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae4926a-199a-4be3-8a1c-0f496d1f7afc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:28:36.403687 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae4926a-199a-4be3-8a1c-0f496d1f7afc admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:28:36.414479 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1251/2499] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 17:28:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:28:36.418829 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a32ee4f-1b82-42b0-ad58-f413e9d0d860 admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:28:36.429422 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a32ee4f-1b82-42b0-ad58-f413e9d0d860 admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:28:36.434079 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6f6afa-4c33-411e-8b7e-151e81542395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:28:36.434949 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6f6afa-4c33-411e-8b7e-151e81542395 admin admin] REQUEST_METHOD: `PUT` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:28:36.435260 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6f6afa-4c33-411e-8b7e-151e81542395 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:28:36.435538 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6f6afa-4c33-411e-8b7e-151e81542395 admin admin] PATH_INFO: `/v3/projects/aee2f1938cb24dd39baa7814531854a1/users/17fe859be6a44cbeb39dd9b62b99ecb2/roles/896bff49c5d6464eb612a15f4aa9badc` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:28:36.450737 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6f6afa-4c33-411e-8b7e-151e81542395 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aee2f1938cb24dd39baa7814531854a1, user_id=17fe859be6a44cbeb39dd9b62b99ecb2, role_id=896bff49c5d6464eb612a15f4aa9badc)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:28:36.453429 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6f6afa-4c33-411e-8b7e-151e81542395 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:28:36.569539 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1249/2500] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 17:28:36 2022] PUT /identity/v3/projects/aee2f1938cb24dd39baa7814531854a1/users/17fe859be6a44cbeb39dd9b62b99ecb2/roles/896bff49c5d6464eb612a15f4aa9badc => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 17:28:36.574699 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684c0035-7ab5-4c90-8fd7-e4b06929ea81 None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:28:36.574995 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684c0035-7ab5-4c90-8fd7-e4b06929ea81 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:28:36.575278 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684c0035-7ab5-4c90-8fd7-e4b06929ea81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:28:36.593620 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-684c0035-7ab5-4c90-8fd7-e4b06929ea81 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:28:36.594865 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-684c0035-7ab5-4c90-8fd7-e4b06929ea81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:28:36.646362 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:28:36.668798 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1252/2501] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:28:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:28:36.680945 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6f6afa-4c33-411e-8b7e-151e81542395 admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:28:36.683712 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-8b6f6afa-4c33-411e-8b7e-151e81542395 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:28:36.739377 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:28:36.751577 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6f6afa-4c33-411e-8b7e-151e81542395 admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:28:36.755327 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0be06f-18d2-4884-b972-46e20fe2da05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5d25bfa8dc042329d57cd55fa7b7b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:28:36.755987 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0be06f-18d2-4884-b972-46e20fe2da05 service neutron] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:28:36.756278 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0be06f-18d2-4884-b972-46e20fe2da05 service neutron] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:28:36.756566 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0be06f-18d2-4884-b972-46e20fe2da05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:28:36.766620 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0be06f-18d2-4884-b972-46e20fe2da05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:28:36.768218 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0be06f-18d2-4884-b972-46e20fe2da05 service neutron] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:28:36.778327 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1250/2502] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:28:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:28:42.656641 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bda10c7-1031-4fee-b4bd-b78f34061c99 None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:28:42.657201 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bda10c7-1031-4fee-b4bd-b78f34061c99 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:28:42.657510 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bda10c7-1031-4fee-b4bd-b78f34061c99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:28:42.689619 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-7bda10c7-1031-4fee-b4bd-b78f34061c99 None None] MFA Rules not processed for user `17fe859be6a44cbeb39dd9b62b99ecb2`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:28:42.691266 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-7bda10c7-1031-4fee-b4bd-b78f34061c99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:28:42.771142 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1253/2503] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:28:42 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:28:42.775662 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0be06f-18d2-4884-b972-46e20fe2da05 service neutron] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:28:42.787585 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0be06f-18d2-4884-b972-46e20fe2da05 service neutron] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:28:42.792994 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2cb7c8-7aca-4614-a4e7-22a26986de53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:28:42.796096 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2cb7c8-7aca-4614-a4e7-22a26986de53 admin admin] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:28:42.796396 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2cb7c8-7aca-4614-a4e7-22a26986de53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:28:42.796682 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2cb7c8-7aca-4614-a4e7-22a26986de53 admin admin] PATH_INFO: `/v3/projects` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:28:42.797397 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2cb7c8-7aca-4614-a4e7-22a26986de53 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:28:42.799391 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2cb7c8-7aca-4614-a4e7-22a26986de53 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:28:42.887565 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1251/2504] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 16 17:28:42 2022] POST /identity/v3/projects => generated 385 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:28:42.892438 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bda10c7-1031-4fee-b4bd-b78f34061c99 None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:28:42.908260 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bda10c7-1031-4fee-b4bd-b78f34061c99 None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:28:43.020393 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e6266c-4760-4a91-a216-387624ff4456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:28:43.021687 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e6266c-4760-4a91-a216-387624ff4456 admin admin] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:28:43.022110 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e6266c-4760-4a91-a216-387624ff4456 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:28:43.022532 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e6266c-4760-4a91-a216-387624ff4456 admin admin] PATH_INFO: `/v3/users` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:28:43.023300 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e6266c-4760-4a91-a216-387624ff4456 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:28:43.025595 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e6266c-4760-4a91-a216-387624ff4456 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:28:43.152626 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1254/2505] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 16 17:28:42 2022] POST /identity/v3/users => generated 299 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:28:43.159077 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2cb7c8-7aca-4614-a4e7-22a26986de53 admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:28:43.175687 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2cb7c8-7aca-4614-a4e7-22a26986de53 admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:28:43.181620 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8224d8b-e5cf-4fc2-b099-2c31674ea226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:28:43.182457 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8224d8b-e5cf-4fc2-b099-2c31674ea226 admin admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:28:43.182855 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8224d8b-e5cf-4fc2-b099-2c31674ea226 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:28:43.183244 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8224d8b-e5cf-4fc2-b099-2c31674ea226 admin admin] PATH_INFO: `/v3/roles` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:28:43.184091 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8224d8b-e5cf-4fc2-b099-2c31674ea226 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:28:43.185869 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8224d8b-e5cf-4fc2-b099-2c31674ea226 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:28:43.200126 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1252/2506] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 17:28:43 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:28:43.205347 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e6266c-4760-4a91-a216-387624ff4456 admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:28:43.217530 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e6266c-4760-4a91-a216-387624ff4456 admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:28:43.225165 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86361452-38c4-47aa-a481-ea51d6a99143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:28:43.231145 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86361452-38c4-47aa-a481-ea51d6a99143 admin admin] REQUEST_METHOD: `PUT` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:28:43.231145 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86361452-38c4-47aa-a481-ea51d6a99143 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:28:43.231145 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86361452-38c4-47aa-a481-ea51d6a99143 admin admin] PATH_INFO: `/v3/projects/4565755e122841f6b92899133e0dc8cb/users/8b8f58cfa65d4e6b83bc2a3c5199f2a9/roles/dba744f8ab2a4c45b9d3212f8d203aba` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:28:43.247405 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86361452-38c4-47aa-a481-ea51d6a99143 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4565755e122841f6b92899133e0dc8cb, user_id=8b8f58cfa65d4e6b83bc2a3c5199f2a9, role_id=dba744f8ab2a4c45b9d3212f8d203aba)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:28:43.250382 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86361452-38c4-47aa-a481-ea51d6a99143 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:28:43.348340 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1255/2507] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 17:28:43 2022] PUT /identity/v3/projects/4565755e122841f6b92899133e0dc8cb/users/8b8f58cfa65d4e6b83bc2a3c5199f2a9/roles/dba744f8ab2a4c45b9d3212f8d203aba => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:28:43.352633 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8224d8b-e5cf-4fc2-b099-2c31674ea226 admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:28:43.365644 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8224d8b-e5cf-4fc2-b099-2c31674ea226 admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:28:43.447990 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e01e34-1659-4fd2-9001-069d6f79b939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:28:43.448670 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e01e34-1659-4fd2-9001-069d6f79b939 admin admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:28:43.449082 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e01e34-1659-4fd2-9001-069d6f79b939 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:28:43.449447 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e01e34-1659-4fd2-9001-069d6f79b939 admin admin] PATH_INFO: `/v3/roles` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:28:43.450238 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e01e34-1659-4fd2-9001-069d6f79b939 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:28:43.451867 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e01e34-1659-4fd2-9001-069d6f79b939 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:28:43.464176 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1253/2508] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 17:28:43 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:28:43.468328 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86361452-38c4-47aa-a481-ea51d6a99143 admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:28:43.483110 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86361452-38c4-47aa-a481-ea51d6a99143 admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:28:43.488113 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb69582-7baf-463d-957c-629fdda63abd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:28:43.489080 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb69582-7baf-463d-957c-629fdda63abd admin admin] REQUEST_METHOD: `PUT` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:28:43.489440 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb69582-7baf-463d-957c-629fdda63abd admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:28:43.489829 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb69582-7baf-463d-957c-629fdda63abd admin admin] PATH_INFO: `/v3/projects/4565755e122841f6b92899133e0dc8cb/users/8b8f58cfa65d4e6b83bc2a3c5199f2a9/roles/dba744f8ab2a4c45b9d3212f8d203aba` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:28:43.492051 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb69582-7baf-463d-957c-629fdda63abd admin admin] RBAC: Authorizing `identity:create_grant(project_id=4565755e122841f6b92899133e0dc8cb, user_id=8b8f58cfa65d4e6b83bc2a3c5199f2a9, role_id=dba744f8ab2a4c45b9d3212f8d203aba)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:28:43.494839 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb69582-7baf-463d-957c-629fdda63abd admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:28:43.507056 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1256/2509] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 17:28:43 2022] PUT /identity/v3/projects/4565755e122841f6b92899133e0dc8cb/users/8b8f58cfa65d4e6b83bc2a3c5199f2a9/roles/dba744f8ab2a4c45b9d3212f8d203aba => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:28:47.386886 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5efe4f-e183-41e1-a27c-b62c1a3159d7 None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:28:47.387442 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5efe4f-e183-41e1-a27c-b62c1a3159d7 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:28:47.387541 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5efe4f-e183-41e1-a27c-b62c1a3159d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:28:47.412562 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-6b5efe4f-e183-41e1-a27c-b62c1a3159d7 None None] MFA Rules not processed for user `695942c4783a4d45874ff48f29ff9638`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:28:47.414647 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-6b5efe4f-e183-41e1-a27c-b62c1a3159d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:28:47.490761 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1254/2510] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:28:47 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:28:49.959892 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239c8ce4-45a6-4a7d-9453-c963d78d764a None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:28:49.960405 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239c8ce4-45a6-4a7d-9453-c963d78d764a None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:28:49.960504 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239c8ce4-45a6-4a7d-9453-c963d78d764a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:28:50.003104 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-239c8ce4-45a6-4a7d-9453-c963d78d764a None None] MFA Rules not processed for user `8b8f58cfa65d4e6b83bc2a3c5199f2a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:28:50.004446 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-239c8ce4-45a6-4a7d-9453-c963d78d764a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:28:50.030145 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:28:50.102849 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1257/2511] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:28:49 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:28:50.114597 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5efe4f-e183-41e1-a27c-b62c1a3159d7 None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:28:50.117331 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-6b5efe4f-e183-41e1-a27c-b62c1a3159d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:28:50.210187 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:28:50.241218 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5efe4f-e183-41e1-a27c-b62c1a3159d7 None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:28:50.245701 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950a5dfd-b9f7-4062-8537-2b8d94539c09 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3985eae1ec3240129eec8d1f4d8d21e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:28:50.246257 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950a5dfd-b9f7-4062-8537-2b8d94539c09 service glance] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:28:50.246566 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950a5dfd-b9f7-4062-8537-2b8d94539c09 service glance] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:28:50.246963 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950a5dfd-b9f7-4062-8537-2b8d94539c09 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:28:50.324355 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950a5dfd-b9f7-4062-8537-2b8d94539c09 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:28:50.325957 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950a5dfd-b9f7-4062-8537-2b8d94539c09 service glance] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:28:50.340385 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1255/2512] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:28:50 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:28:50.600129 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d410b0c5-f104-468a-b677-bc0618aa2f38 None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:28:50.600420 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d410b0c5-f104-468a-b677-bc0618aa2f38 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:28:50.600711 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d410b0c5-f104-468a-b677-bc0618aa2f38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:28:50.622766 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-d410b0c5-f104-468a-b677-bc0618aa2f38 None None] MFA Rules not processed for user `f7f35c1c15a84a92863d4f3f96d76830`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:28:50.624111 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-d410b0c5-f104-468a-b677-bc0618aa2f38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:28:50.703769 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1258/2513] 10.222.0.39 () {58 vars in 1009 bytes} [Thu Jun 16 17:28:50 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:28:50.712029 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950a5dfd-b9f7-4062-8537-2b8d94539c09 service glance] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:28:50.713670 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-950a5dfd-b9f7-4062-8537-2b8d94539c09 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:28:50.831077 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950a5dfd-b9f7-4062-8537-2b8d94539c09 service glance] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:28:50.838344 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0893f3c-bdf1-45a0-85b3-ed3f95a61380 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbec2dfe63764ed88a23e172ead0afa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:28:50.839132 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0893f3c-bdf1-45a0-85b3-ed3f95a61380 service swift] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:28:50.839490 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0893f3c-bdf1-45a0-85b3-ed3f95a61380 service swift] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:28:50.839841 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0893f3c-bdf1-45a0-85b3-ed3f95a61380 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:28:50.854054 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0893f3c-bdf1-45a0-85b3-ed3f95a61380 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:28:50.855841 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0893f3c-bdf1-45a0-85b3-ed3f95a61380 service swift] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:28:50.866177 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1256/2514] 10.222.0.39 () {60 vars in 1384 bytes} [Thu Jun 16 17:28:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 17:28:51.204886 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132be591-68d8-4b49-954c-462ffbadaf0e None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:28:51.205338 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132be591-68d8-4b49-954c-462ffbadaf0e None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:28:51.205671 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132be591-68d8-4b49-954c-462ffbadaf0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:28:51.225272 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-132be591-68d8-4b49-954c-462ffbadaf0e None None] MFA Rules not processed for user `b0b96633bee24c718e8af89062493d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:28:51.226668 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-132be591-68d8-4b49-954c-462ffbadaf0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:28:51.292725 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1259/2515] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:28:51 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:29:00.861932 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=70 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:29:01.284168 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=71 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:29:02.948770 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cb143a-9419-4bef-9d7b-61ef7fc7b76d None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:29:02.949267 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cb143a-9419-4bef-9d7b-61ef7fc7b76d None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:29:02.949382 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cb143a-9419-4bef-9d7b-61ef7fc7b76d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:29:02.967752 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-14cb143a-9419-4bef-9d7b-61ef7fc7b76d None None] MFA Rules not processed for user `17fe859be6a44cbeb39dd9b62b99ecb2`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:29:02.969999 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-14cb143a-9419-4bef-9d7b-61ef7fc7b76d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:29:02.977443 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1257/2516] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:29:02 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:29:06.760833 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199e910a-6cf5-43d5-ab84-673286cbe8f3 None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:29:06.760833 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199e910a-6cf5-43d5-ab84-673286cbe8f3 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:29:06.760833 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199e910a-6cf5-43d5-ab84-673286cbe8f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:29:06.773070 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-199e910a-6cf5-43d5-ab84-673286cbe8f3 None None] MFA Rules not processed for user `f7f35c1c15a84a92863d4f3f96d76830`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:29:06.774328 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-199e910a-6cf5-43d5-ab84-673286cbe8f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:29:06.783140 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1260/2517] 10.222.0.39 () {58 vars in 1009 bytes} [Thu Jun 16 17:29:06 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:29:06.808436 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cb143a-9419-4bef-9d7b-61ef7fc7b76d None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:29:06.823448 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cb143a-9419-4bef-9d7b-61ef7fc7b76d None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:29:06.829160 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4cfdf1-9410-4420-a836-b9182268741d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbec2dfe63764ed88a23e172ead0afa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:29:06.829845 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4cfdf1-9410-4420-a836-b9182268741d service swift] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:29:06.830136 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4cfdf1-9410-4420-a836-b9182268741d service swift] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:29:06.830416 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4cfdf1-9410-4420-a836-b9182268741d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:29:06.839667 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4cfdf1-9410-4420-a836-b9182268741d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:29:06.841844 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4cfdf1-9410-4420-a836-b9182268741d service swift] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:29:06.853404 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1258/2518] 10.222.0.39 () {60 vars in 1384 bytes} [Thu Jun 16 17:29:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 17:29:16.767636 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=3 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:29:16.848629 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=9 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:29:19.283559 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f990800f-271d-4c63-a489-54d1a3a9126f None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:29:19.284085 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f990800f-271d-4c63-a489-54d1a3a9126f None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:29:19.284085 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f990800f-271d-4c63-a489-54d1a3a9126f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:29:19.303242 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-f990800f-271d-4c63-a489-54d1a3a9126f None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:29:19.304457 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-f990800f-271d-4c63-a489-54d1a3a9126f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:29:19.364699 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1261/2519] 10.222.0.86 () {58 vars in 1016 bytes} [Thu Jun 16 17:29:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:29:19.381234 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4cfdf1-9410-4420-a836-b9182268741d service swift] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:29:19.384731 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-7c4cfdf1-9410-4420-a836-b9182268741d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:29:19.468390 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4cfdf1-9410-4420-a836-b9182268741d service swift] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:29:19.473950 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79f7157-e2ac-4b2e-888a-81c3b80693e3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d381bb41dea4f1e90c3cf3815ac88dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:29:19.474591 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79f7157-e2ac-4b2e-888a-81c3b80693e3 service nova] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:29:19.474883 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79f7157-e2ac-4b2e-888a-81c3b80693e3 service nova] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:29:19.475167 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79f7157-e2ac-4b2e-888a-81c3b80693e3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:29:19.483942 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79f7157-e2ac-4b2e-888a-81c3b80693e3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:29:19.485515 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79f7157-e2ac-4b2e-888a-81c3b80693e3 service nova] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:29:19.496227 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1259/2520] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:29:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:29:22.638137 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc5a074-9cf0-4429-a7d7-dff834870a5f None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:29:22.638729 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc5a074-9cf0-4429-a7d7-dff834870a5f None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:29:22.638729 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc5a074-9cf0-4429-a7d7-dff834870a5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:29:22.662428 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-3fc5a074-9cf0-4429-a7d7-dff834870a5f None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:29:22.663637 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-3fc5a074-9cf0-4429-a7d7-dff834870a5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:29:22.673500 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1262/2521] 10.222.0.86 () {58 vars in 1016 bytes} [Thu Jun 16 17:29:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:29:22.688726 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79f7157-e2ac-4b2e-888a-81c3b80693e3 service nova] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:29:22.701410 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79f7157-e2ac-4b2e-888a-81c3b80693e3 service nova] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:29:22.709738 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca686aa-7710-4a62-a74e-deac4666bea4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d381bb41dea4f1e90c3cf3815ac88dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:29:22.710414 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca686aa-7710-4a62-a74e-deac4666bea4 service nova] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:29:22.710703 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca686aa-7710-4a62-a74e-deac4666bea4 service nova] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:29:22.710985 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca686aa-7710-4a62-a74e-deac4666bea4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:29:22.720718 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca686aa-7710-4a62-a74e-deac4666bea4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:29:22.722450 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca686aa-7710-4a62-a74e-deac4666bea4 service nova] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:29:22.732246 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1260/2522] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:29:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:29:27.599941 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58c584e-b9d2-4a0f-bb37-a1b702f0c3f0 None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:29:27.600484 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58c584e-b9d2-4a0f-bb37-a1b702f0c3f0 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:29:27.600484 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58c584e-b9d2-4a0f-bb37-a1b702f0c3f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:29:27.619112 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-b58c584e-b9d2-4a0f-bb37-a1b702f0c3f0 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:29:27.620328 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-b58c584e-b9d2-4a0f-bb37-a1b702f0c3f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:29:27.628969 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1263/2523] 10.222.0.86 () {58 vars in 1016 bytes} [Thu Jun 16 17:29:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:29:27.648679 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca686aa-7710-4a62-a74e-deac4666bea4 service nova] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:29:27.660104 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca686aa-7710-4a62-a74e-deac4666bea4 service nova] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:29:27.665779 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82d618a-cc85-4bbd-9a68-fb2e25793b18 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d381bb41dea4f1e90c3cf3815ac88dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:29:27.666573 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82d618a-cc85-4bbd-9a68-fb2e25793b18 service nova] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:29:27.666892 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82d618a-cc85-4bbd-9a68-fb2e25793b18 service nova] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:29:27.667349 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82d618a-cc85-4bbd-9a68-fb2e25793b18 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:29:27.680314 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82d618a-cc85-4bbd-9a68-fb2e25793b18 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:29:27.681956 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82d618a-cc85-4bbd-9a68-fb2e25793b18 service nova] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:29:27.695994 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1261/2524] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:29:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:29:31.879989 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38a3f45-51dc-4ce5-8a3b-bd9bc1635331 None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:29:31.880531 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38a3f45-51dc-4ce5-8a3b-bd9bc1635331 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:29:31.880531 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38a3f45-51dc-4ce5-8a3b-bd9bc1635331 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:29:31.967161 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-d38a3f45-51dc-4ce5-8a3b-bd9bc1635331 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:29:31.969067 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-d38a3f45-51dc-4ce5-8a3b-bd9bc1635331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:29:31.977911 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1264/2525] 10.222.0.86 () {58 vars in 1016 bytes} [Thu Jun 16 17:29:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:29:31.994260 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82d618a-cc85-4bbd-9a68-fb2e25793b18 service nova] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:29:32.005406 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82d618a-cc85-4bbd-9a68-fb2e25793b18 service nova] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:29:32.011790 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941a474b-2332-4b0f-a16a-e61db6747f5b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d381bb41dea4f1e90c3cf3815ac88dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:29:32.012487 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941a474b-2332-4b0f-a16a-e61db6747f5b service nova] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:29:32.012780 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941a474b-2332-4b0f-a16a-e61db6747f5b service nova] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:29:32.013065 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941a474b-2332-4b0f-a16a-e61db6747f5b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:29:32.022971 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941a474b-2332-4b0f-a16a-e61db6747f5b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:29:32.024678 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941a474b-2332-4b0f-a16a-e61db6747f5b service nova] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:29:32.036497 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1262/2526] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:29:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:29:35.005388 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ab4a98-6d87-472a-9981-5b905726fd41 None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:29:35.005971 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ab4a98-6d87-472a-9981-5b905726fd41 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:29:35.006086 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ab4a98-6d87-472a-9981-5b905726fd41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:29:35.023295 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-30ab4a98-6d87-472a-9981-5b905726fd41 None None] MFA Rules not processed for user `9497772835074d40b7f748507eb539b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:29:35.024554 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-30ab4a98-6d87-472a-9981-5b905726fd41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:29:35.080870 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1265/2527] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:29:35 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:29:38.210303 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8be674-7203-4cbd-8719-316cffb874e2 None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:29:38.210794 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8be674-7203-4cbd-8719-316cffb874e2 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:29:38.214527 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8be674-7203-4cbd-8719-316cffb874e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:29:38.230440 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-de8be674-7203-4cbd-8719-316cffb874e2 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:29:38.231626 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-de8be674-7203-4cbd-8719-316cffb874e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:29:38.240278 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1263/2528] 10.222.0.86 () {58 vars in 1016 bytes} [Thu Jun 16 17:29:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:29:38.254803 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ab4a98-6d87-472a-9981-5b905726fd41 None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:29:38.270070 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ab4a98-6d87-472a-9981-5b905726fd41 None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:29:38.277604 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224f3852-574e-4a4e-a7d8-87951c999a5a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d381bb41dea4f1e90c3cf3815ac88dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:29:38.277604 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224f3852-574e-4a4e-a7d8-87951c999a5a service nova] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:29:38.277604 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224f3852-574e-4a4e-a7d8-87951c999a5a service nova] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:29:38.277604 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224f3852-574e-4a4e-a7d8-87951c999a5a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:29:38.300675 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224f3852-574e-4a4e-a7d8-87951c999a5a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:29:38.302796 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224f3852-574e-4a4e-a7d8-87951c999a5a service nova] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:29:38.314566 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1266/2529] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:29:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:29:38.896741 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8be674-7203-4cbd-8719-316cffb874e2 None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:29:38.958197 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8be674-7203-4cbd-8719-316cffb874e2 None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:29:38.963730 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0215d004-b068-466d-9377-b3bcb3b69eb3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5d25bfa8dc042329d57cd55fa7b7b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:29:38.964572 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0215d004-b068-466d-9377-b3bcb3b69eb3 service neutron] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:29:38.964870 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0215d004-b068-466d-9377-b3bcb3b69eb3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:29:38.965154 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0215d004-b068-466d-9377-b3bcb3b69eb3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:29:38.978416 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0215d004-b068-466d-9377-b3bcb3b69eb3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:29:38.981041 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0215d004-b068-466d-9377-b3bcb3b69eb3 service neutron] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:29:38.992645 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1264/2530] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:29:38 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:29:48.309072 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=67 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:29:48.987766 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=81 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:30:03.026739 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224f3852-574e-4a4e-a7d8-87951c999a5a service nova] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:30:03.028453 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-224f3852-574e-4a4e-a7d8-87951c999a5a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:30:03.045338 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224f3852-574e-4a4e-a7d8-87951c999a5a service nova] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:30:03.051053 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d9a844-2585-43e4-b63b-ac4271bcda5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:30:03.051943 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d9a844-2585-43e4-b63b-ac4271bcda5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:30:03.052236 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d9a844-2585-43e4-b63b-ac4271bcda5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:30:03.052582 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d9a844-2585-43e4-b63b-ac4271bcda5e admin admin] PATH_INFO: `/v3/users/695942c4783a4d45874ff48f29ff9638` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:30:03.053824 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d9a844-2585-43e4-b63b-ac4271bcda5e admin admin] RBAC: Authorizing `identity:delete_user(user_id=695942c4783a4d45874ff48f29ff9638)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:30:03.055886 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d9a844-2585-43e4-b63b-ac4271bcda5e admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:30:03.284622 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-23d9a844-2585-43e4-b63b-ac4271bcda5e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '695942c4783a4d45874ff48f29ff9638'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:30:03.291440 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-23d9a844-2585-43e4-b63b-ac4271bcda5e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '695942c4783a4d45874ff48f29ff9638'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:30:03.374076 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-23d9a844-2585-43e4-b63b-ac4271bcda5e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '695942c4783a4d45874ff48f29ff9638'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:30:03.374710 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-23d9a844-2585-43e4-b63b-ac4271bcda5e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '695942c4783a4d45874ff48f29ff9638'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:30:03.387778 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-23d9a844-2585-43e4-b63b-ac4271bcda5e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '695942c4783a4d45874ff48f29ff9638'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:30:03.393980 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1267/2531] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 16 17:30:03 2022] DELETE /identity/v3/users/695942c4783a4d45874ff48f29ff9638 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:30:03.633780 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0215d004-b068-466d-9377-b3bcb3b69eb3 service neutron] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:30:03.652062 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0215d004-b068-466d-9377-b3bcb3b69eb3 service neutron] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:30:03.711833 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf1d05e-87b5-4091-b8cf-596998c9e6ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:30:03.712705 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf1d05e-87b5-4091-b8cf-596998c9e6ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:30:03.713001 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf1d05e-87b5-4091-b8cf-596998c9e6ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:30:03.713281 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf1d05e-87b5-4091-b8cf-596998c9e6ce admin admin] PATH_INFO: `/v3/projects/62574e03c88b4fc8b9d2810e19a333ae` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:30:03.714500 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf1d05e-87b5-4091-b8cf-596998c9e6ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=62574e03c88b4fc8b9d2810e19a333ae)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:30:03.716399 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf1d05e-87b5-4091-b8cf-596998c9e6ce admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:30:03.846271 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-9cf1d05e-87b5-4091-b8cf-596998c9e6ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62574e03c88b4fc8b9d2810e19a333ae', 'request_id': 'req-9cf1d05e-87b5-4091-b8cf-596998c9e6ce'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:30:03.853691 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-9cf1d05e-87b5-4091-b8cf-596998c9e6ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62574e03c88b4fc8b9d2810e19a333ae', 'request_id': 'req-9cf1d05e-87b5-4091-b8cf-596998c9e6ce'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:30:03.860088 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-9cf1d05e-87b5-4091-b8cf-596998c9e6ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62574e03c88b4fc8b9d2810e19a333ae', 'request_id': 'req-9cf1d05e-87b5-4091-b8cf-596998c9e6ce'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:30:03.985162 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-9cf1d05e-87b5-4091-b8cf-596998c9e6ce admin admin] The token cache is being invalidate because project 62574e03c88b4fc8b9d2810e19a333ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80873) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 17:30:03.990724 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-9cf1d05e-87b5-4091-b8cf-596998c9e6ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:30:03.990724 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-9cf1d05e-87b5-4091-b8cf-596998c9e6ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:30:03.990724 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1265/2532] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 16 17:30:03 2022] DELETE /identity/v3/projects/62574e03c88b4fc8b9d2810e19a333ae => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 17:30:03.992613 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1252361b-25c7-4040-9824-346a00deb83a None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:30:03.992912 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1252361b-25c7-4040-9824-346a00deb83a None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:30:03.993235 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1252361b-25c7-4040-9824-346a00deb83a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:30:04.012100 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-1252361b-25c7-4040-9824-346a00deb83a None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:30:04.013351 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-1252361b-25c7-4040-9824-346a00deb83a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:30:04.077954 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1268/2533] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:30:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:30:04.085568 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc544e6c-d2ec-431a-8e5c-f4ab60c06c4f None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:30:04.085971 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc544e6c-d2ec-431a-8e5c-f4ab60c06c4f None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:30:04.086254 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc544e6c-d2ec-431a-8e5c-f4ab60c06c4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:30:04.104515 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-dc544e6c-d2ec-431a-8e5c-f4ab60c06c4f None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:30:04.105718 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-dc544e6c-d2ec-431a-8e5c-f4ab60c06c4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:30:04.114438 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1266/2534] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:30:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:30:04.128526 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1252361b-25c7-4040-9824-346a00deb83a None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:30:04.129164 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1252361b-25c7-4040-9824-346a00deb83a None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:30:04.133908 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a6c78d-df64-4841-86e8-a1f556e3114b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:30:04.134565 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a6c78d-df64-4841-86e8-a1f556e3114b admin admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:30:04.134855 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a6c78d-df64-4841-86e8-a1f556e3114b admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:30:04.135141 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a6c78d-df64-4841-86e8-a1f556e3114b admin admin] PATH_INFO: `/v3/domains` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:30:04.135879 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a6c78d-df64-4841-86e8-a1f556e3114b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:30:04.136188 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a6c78d-df64-4841-86e8-a1f556e3114b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:30:04.137815 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a6c78d-df64-4841-86e8-a1f556e3114b admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:30:04.149450 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1269/2535] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 16 17:30:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:30:04.153792 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc544e6c-d2ec-431a-8e5c-f4ab60c06c4f None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:30:04.163676 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc544e6c-d2ec-431a-8e5c-f4ab60c06c4f None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:30:04.171045 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2fcf43-c20c-4961-bcbe-c5e873523b99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:30:04.171045 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2fcf43-c20c-4961-bcbe-c5e873523b99 admin admin] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:30:04.171045 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2fcf43-c20c-4961-bcbe-c5e873523b99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:30:04.171045 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2fcf43-c20c-4961-bcbe-c5e873523b99 admin admin] PATH_INFO: `/v3/projects` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:30:04.171585 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2fcf43-c20c-4961-bcbe-c5e873523b99 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:30:04.172948 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2fcf43-c20c-4961-bcbe-c5e873523b99 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:30:04.299541 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1267/2536] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 16 17:30:04 2022] POST /identity/v3/projects => generated 387 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:30:04.300802 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a6c78d-df64-4841-86e8-a1f556e3114b admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:30:04.311486 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a6c78d-df64-4841-86e8-a1f556e3114b admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:30:04.372425 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884d53b1-fe56-4e02-9acf-02b7ace5f98c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:30:04.373095 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884d53b1-fe56-4e02-9acf-02b7ace5f98c admin admin] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:30:04.373386 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884d53b1-fe56-4e02-9acf-02b7ace5f98c admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:30:04.373669 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884d53b1-fe56-4e02-9acf-02b7ace5f98c admin admin] PATH_INFO: `/v3/users` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:30:04.374486 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884d53b1-fe56-4e02-9acf-02b7ace5f98c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:30:04.377029 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884d53b1-fe56-4e02-9acf-02b7ace5f98c admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:30:04.383675 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:30:04.465916 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1270/2537] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 16 17:30:04 2022] POST /identity/v3/users => generated 294 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:30:04.470104 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2fcf43-c20c-4961-bcbe-c5e873523b99 admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:30:04.480305 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2fcf43-c20c-4961-bcbe-c5e873523b99 admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:30:04.484932 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f17768-cd1e-46d7-b99a-3496e5146be8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:30:04.485592 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f17768-cd1e-46d7-b99a-3496e5146be8 admin admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:30:04.492654 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f17768-cd1e-46d7-b99a-3496e5146be8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:30:04.492654 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f17768-cd1e-46d7-b99a-3496e5146be8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:30:04.492654 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f17768-cd1e-46d7-b99a-3496e5146be8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:30:04.492654 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f17768-cd1e-46d7-b99a-3496e5146be8 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:30:04.499212 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1268/2538] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 17:30:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:30:04.503651 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884d53b1-fe56-4e02-9acf-02b7ace5f98c admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:30:04.513808 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884d53b1-fe56-4e02-9acf-02b7ace5f98c admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:30:04.518963 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8f0676-cc60-4594-86fd-7d4046ca1455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:30:04.519612 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8f0676-cc60-4594-86fd-7d4046ca1455 admin admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:30:04.519898 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8f0676-cc60-4594-86fd-7d4046ca1455 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:30:04.520176 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8f0676-cc60-4594-86fd-7d4046ca1455 admin admin] PATH_INFO: `/v3/roles` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:30:04.520898 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8f0676-cc60-4594-86fd-7d4046ca1455 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:30:04.522536 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8f0676-cc60-4594-86fd-7d4046ca1455 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:30:04.532967 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1271/2539] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 17:30:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:30:04.537188 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f17768-cd1e-46d7-b99a-3496e5146be8 admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:30:04.547253 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f17768-cd1e-46d7-b99a-3496e5146be8 admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:30:04.552180 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bded3d-8db5-48a6-8188-adbdf4161236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:30:04.553075 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bded3d-8db5-48a6-8188-adbdf4161236 admin admin] REQUEST_METHOD: `PUT` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:30:04.553363 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bded3d-8db5-48a6-8188-adbdf4161236 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:30:04.553644 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bded3d-8db5-48a6-8188-adbdf4161236 admin admin] PATH_INFO: `/v3/projects/fb012f5e60aa4c90b145443b46cd34f5/users/3de3de59b09148cd877c64735857c3a2/roles/896bff49c5d6464eb612a15f4aa9badc` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:30:04.569812 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bded3d-8db5-48a6-8188-adbdf4161236 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb012f5e60aa4c90b145443b46cd34f5, user_id=3de3de59b09148cd877c64735857c3a2, role_id=896bff49c5d6464eb612a15f4aa9badc)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:30:04.572582 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bded3d-8db5-48a6-8188-adbdf4161236 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:30:04.648061 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1269/2540] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 17:30:04 2022] PUT /identity/v3/projects/fb012f5e60aa4c90b145443b46cd34f5/users/3de3de59b09148cd877c64735857c3a2/roles/896bff49c5d6464eb612a15f4aa9badc => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:30:04.654118 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68235689-4e82-4672-a3af-981f831bf26d None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:30:04.654420 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68235689-4e82-4672-a3af-981f831bf26d None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:30:04.654711 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68235689-4e82-4672-a3af-981f831bf26d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:30:04.672561 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-68235689-4e82-4672-a3af-981f831bf26d None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:30:04.673939 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-68235689-4e82-4672-a3af-981f831bf26d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:30:04.733275 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1272/2541] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:30:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 17:30:04.743266 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bded3d-8db5-48a6-8188-adbdf4161236 admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:30:04.745185 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-11bded3d-8db5-48a6-8188-adbdf4161236 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:30:04.777038 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:30:04.803673 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bded3d-8db5-48a6-8188-adbdf4161236 admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:30:04.807410 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73b4805-ae55-46a5-b76f-d6c14463958c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5d25bfa8dc042329d57cd55fa7b7b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:30:04.808059 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73b4805-ae55-46a5-b76f-d6c14463958c service neutron] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:30:04.808336 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73b4805-ae55-46a5-b76f-d6c14463958c service neutron] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:30:04.808626 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73b4805-ae55-46a5-b76f-d6c14463958c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:30:04.818203 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73b4805-ae55-46a5-b76f-d6c14463958c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:30:04.819894 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73b4805-ae55-46a5-b76f-d6c14463958c service neutron] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:30:04.829158 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1270/2542] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:30:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:30:11.356724 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09998358-1884-4437-a2b9-5d7d2695296c None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:30:11.357282 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09998358-1884-4437-a2b9-5d7d2695296c None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:30:11.357587 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09998358-1884-4437-a2b9-5d7d2695296c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:30:11.397978 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-09998358-1884-4437-a2b9-5d7d2695296c None None] MFA Rules not processed for user `3de3de59b09148cd877c64735857c3a2`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:30:11.399230 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-09998358-1884-4437-a2b9-5d7d2695296c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:30:11.471707 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1273/2543] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:30:11 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:30:11.490883 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73b4805-ae55-46a5-b76f-d6c14463958c service neutron] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:30:11.492478 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-c73b4805-ae55-46a5-b76f-d6c14463958c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:30:11.575018 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73b4805-ae55-46a5-b76f-d6c14463958c service neutron] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:30:11.582987 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f16208d-c299-4f63-8050-59362c0e051b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d381bb41dea4f1e90c3cf3815ac88dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:30:11.584799 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f16208d-c299-4f63-8050-59362c0e051b service nova] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:30:11.585617 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f16208d-c299-4f63-8050-59362c0e051b service nova] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:30:11.586597 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f16208d-c299-4f63-8050-59362c0e051b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:30:11.604416 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f16208d-c299-4f63-8050-59362c0e051b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:30:11.604416 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f16208d-c299-4f63-8050-59362c0e051b service nova] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:30:11.610260 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1271/2544] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:30:11 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:30:15.005052 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0b1a29-b397-4f5a-a11d-54d9c0424b93 None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:30:15.007523 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0b1a29-b397-4f5a-a11d-54d9c0424b93 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:30:15.013136 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0b1a29-b397-4f5a-a11d-54d9c0424b93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:30:15.049703 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-0d0b1a29-b397-4f5a-a11d-54d9c0424b93 None None] MFA Rules not processed for user `3de3de59b09148cd877c64735857c3a2`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:30:15.052806 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-0d0b1a29-b397-4f5a-a11d-54d9c0424b93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:30:15.060722 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1274/2545] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:30:14 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:30:15.646559 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f16208d-c299-4f63-8050-59362c0e051b service nova] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:30:15.648087 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-8f16208d-c299-4f63-8050-59362c0e051b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:30:15.669570 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f16208d-c299-4f63-8050-59362c0e051b service nova] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:30:15.680682 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cb2afe-8f74-4d8f-a466-ae1c563752eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:30:15.683137 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cb2afe-8f74-4d8f-a466-ae1c563752eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:30:15.683485 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cb2afe-8f74-4d8f-a466-ae1c563752eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:30:15.683780 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cb2afe-8f74-4d8f-a466-ae1c563752eb admin admin] PATH_INFO: `/v3/users/b0b96633bee24c718e8af89062493d0d` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:30:15.685146 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cb2afe-8f74-4d8f-a466-ae1c563752eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0b96633bee24c718e8af89062493d0d)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:30:15.687692 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cb2afe-8f74-4d8f-a466-ae1c563752eb admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:30:15.913821 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-e5cb2afe-8f74-4d8f-a466-ae1c563752eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0b96633bee24c718e8af89062493d0d'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:30:15.914530 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-e5cb2afe-8f74-4d8f-a466-ae1c563752eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0b96633bee24c718e8af89062493d0d'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:30:15.915148 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-e5cb2afe-8f74-4d8f-a466-ae1c563752eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0b96633bee24c718e8af89062493d0d'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:30:16.083149 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-e5cb2afe-8f74-4d8f-a466-ae1c563752eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0b96633bee24c718e8af89062493d0d'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:30:16.092823 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-e5cb2afe-8f74-4d8f-a466-ae1c563752eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0b96633bee24c718e8af89062493d0d'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:30:16.114102 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1272/2546] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 16 17:30:15 2022] DELETE /identity/v3/users/b0b96633bee24c718e8af89062493d0d => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:30:16.473724 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0b1a29-b397-4f5a-a11d-54d9c0424b93 None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:30:16.491006 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0b1a29-b397-4f5a-a11d-54d9c0424b93 None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:30:16.554299 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f4780a-7075-4450-8f8a-d84086dee0ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:30:16.555231 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f4780a-7075-4450-8f8a-d84086dee0ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:30:16.555528 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f4780a-7075-4450-8f8a-d84086dee0ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:30:16.555810 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f4780a-7075-4450-8f8a-d84086dee0ba admin admin] PATH_INFO: `/v3/projects/10122bee002b4e2f9c0619415552b6bf` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:30:16.557064 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f4780a-7075-4450-8f8a-d84086dee0ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=10122bee002b4e2f9c0619415552b6bf)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:30:16.559031 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f4780a-7075-4450-8f8a-d84086dee0ba admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:30:16.561887 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:30:16.694640 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-d9f4780a-7075-4450-8f8a-d84086dee0ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10122bee002b4e2f9c0619415552b6bf', 'request_id': 'req-d9f4780a-7075-4450-8f8a-d84086dee0ba'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:30:16.700150 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-d9f4780a-7075-4450-8f8a-d84086dee0ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10122bee002b4e2f9c0619415552b6bf', 'request_id': 'req-d9f4780a-7075-4450-8f8a-d84086dee0ba'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:30:16.830830 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-d9f4780a-7075-4450-8f8a-d84086dee0ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10122bee002b4e2f9c0619415552b6bf', 'request_id': 'req-d9f4780a-7075-4450-8f8a-d84086dee0ba'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:30:16.842583 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-d9f4780a-7075-4450-8f8a-d84086dee0ba admin admin] The token cache is being invalidate because project 10122bee002b4e2f9c0619415552b6bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80874) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 17:30:16.842946 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-d9f4780a-7075-4450-8f8a-d84086dee0ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:30:16.843607 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-d9f4780a-7075-4450-8f8a-d84086dee0ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:30:16.848682 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1275/2547] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 16 17:30:16 2022] DELETE /identity/v3/projects/10122bee002b4e2f9c0619415552b6bf => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:30:20.122232 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cb2afe-8f74-4d8f-a466-ae1c563752eb admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:30:20.128350 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-e5cb2afe-8f74-4d8f-a466-ae1c563752eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:30:20.156157 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:30:20.192369 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cb2afe-8f74-4d8f-a466-ae1c563752eb admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:30:20.243543 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59040b63-244e-4f9a-af2d-7d276818a2e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5d25bfa8dc042329d57cd55fa7b7b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:30:20.244204 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59040b63-244e-4f9a-af2d-7d276818a2e1 service neutron] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:30:20.244496 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59040b63-244e-4f9a-af2d-7d276818a2e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:30:20.244782 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59040b63-244e-4f9a-af2d-7d276818a2e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:30:20.246667 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-59040b63-244e-4f9a-af2d-7d276818a2e1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:30:20.319342 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59040b63-244e-4f9a-af2d-7d276818a2e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:30:20.320889 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59040b63-244e-4f9a-af2d-7d276818a2e1 service neutron] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:30:20.334004 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1273/2548] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:30:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:30:21.556657 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f4780a-7075-4450-8f8a-d84086dee0ba admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:30:21.558241 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-d9f4780a-7075-4450-8f8a-d84086dee0ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:30:21.571463 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f4780a-7075-4450-8f8a-d84086dee0ba admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:30:21.575121 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afd6bab-8bc4-4599-89ea-fed96a854ae1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5d25bfa8dc042329d57cd55fa7b7b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:30:21.575759 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afd6bab-8bc4-4599-89ea-fed96a854ae1 service neutron] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:30:21.578834 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afd6bab-8bc4-4599-89ea-fed96a854ae1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:30:21.578834 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afd6bab-8bc4-4599-89ea-fed96a854ae1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:30:21.578834 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-3afd6bab-8bc4-4599-89ea-fed96a854ae1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:30:21.591599 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afd6bab-8bc4-4599-89ea-fed96a854ae1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:30:21.593017 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afd6bab-8bc4-4599-89ea-fed96a854ae1 service neutron] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:30:21.604791 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1276/2549] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:30:21 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:30:30.329145 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=62 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:30:31.599370 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=29,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:30:33.191448 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59040b63-244e-4f9a-af2d-7d276818a2e1 service neutron] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:30:33.192900 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-59040b63-244e-4f9a-af2d-7d276818a2e1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:30:33.254008 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59040b63-244e-4f9a-af2d-7d276818a2e1 service neutron] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:30:33.257861 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea71a55c-acbb-4043-8074-90acb82989bf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef37136b89d34edc9cd94c7aa81b2095', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:30:33.258526 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea71a55c-acbb-4043-8074-90acb82989bf service cinder] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:30:33.258813 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea71a55c-acbb-4043-8074-90acb82989bf service cinder] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:30:33.259132 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea71a55c-acbb-4043-8074-90acb82989bf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:30:33.261520 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-ea71a55c-acbb-4043-8074-90acb82989bf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:30:33.325592 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea71a55c-acbb-4043-8074-90acb82989bf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:30:33.327083 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea71a55c-acbb-4043-8074-90acb82989bf service cinder] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:30:33.337176 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1274/2550] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:30:33 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:30:43.332217 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=48 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:30:53.523593 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afd6bab-8bc4-4599-89ea-fed96a854ae1 service neutron] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:30:53.532279 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afd6bab-8bc4-4599-89ea-fed96a854ae1 service neutron] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:30:53.536031 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6114e083-f6b4-4956-b79f-2c9e040d95c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5d25bfa8dc042329d57cd55fa7b7b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:30:53.536672 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6114e083-f6b4-4956-b79f-2c9e040d95c8 service neutron] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:30:53.536964 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6114e083-f6b4-4956-b79f-2c9e040d95c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:30:53.537254 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6114e083-f6b4-4956-b79f-2c9e040d95c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:30:53.539053 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-6114e083-f6b4-4956-b79f-2c9e040d95c8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:30:53.611618 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6114e083-f6b4-4956-b79f-2c9e040d95c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:30:53.613919 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6114e083-f6b4-4956-b79f-2c9e040d95c8 service neutron] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:30:53.624052 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1277/2551] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:30:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:30:57.457001 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea71a55c-acbb-4043-8074-90acb82989bf service cinder] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:30:57.459028 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-ea71a55c-acbb-4043-8074-90acb82989bf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:30:57.473259 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea71a55c-acbb-4043-8074-90acb82989bf service cinder] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:30:57.478806 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ec0e52-03a8-4bb5-a179-d305dc46b8fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:30:57.479687 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ec0e52-03a8-4bb5-a179-d305dc46b8fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:30:57.481496 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ec0e52-03a8-4bb5-a179-d305dc46b8fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:30:57.481496 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ec0e52-03a8-4bb5-a179-d305dc46b8fc admin admin] PATH_INFO: `/v3/users/9497772835074d40b7f748507eb539b7` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:30:57.481496 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ec0e52-03a8-4bb5-a179-d305dc46b8fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=9497772835074d40b7f748507eb539b7)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:30:57.483352 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ec0e52-03a8-4bb5-a179-d305dc46b8fc admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:30:57.662424 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-79ec0e52-03a8-4bb5-a179-d305dc46b8fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9497772835074d40b7f748507eb539b7'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:30:57.663114 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-79ec0e52-03a8-4bb5-a179-d305dc46b8fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9497772835074d40b7f748507eb539b7'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:30:57.663752 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-79ec0e52-03a8-4bb5-a179-d305dc46b8fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9497772835074d40b7f748507eb539b7'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:30:57.735299 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-79ec0e52-03a8-4bb5-a179-d305dc46b8fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9497772835074d40b7f748507eb539b7'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:30:57.749305 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-79ec0e52-03a8-4bb5-a179-d305dc46b8fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9497772835074d40b7f748507eb539b7'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:30:57.780297 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6114e083-f6b4-4956-b79f-2c9e040d95c8 service neutron] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:30:57.781806 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-6114e083-f6b4-4956-b79f-2c9e040d95c8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:30:57.785404 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1275/2552] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 16 17:30:57 2022] DELETE /identity/v3/users/9497772835074d40b7f748507eb539b7 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:30:57.809595 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6114e083-f6b4-4956-b79f-2c9e040d95c8 service neutron] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:30:57.983782 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108c6cd3-3ef5-4b3f-a19d-3168962df52f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d381bb41dea4f1e90c3cf3815ac88dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:30:57.984668 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108c6cd3-3ef5-4b3f-a19d-3168962df52f service nova] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:30:57.985170 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108c6cd3-3ef5-4b3f-a19d-3168962df52f service nova] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:30:57.985988 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108c6cd3-3ef5-4b3f-a19d-3168962df52f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:30:57.988897 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-108c6cd3-3ef5-4b3f-a19d-3168962df52f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:30:58.008929 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108c6cd3-3ef5-4b3f-a19d-3168962df52f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:30:58.010696 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108c6cd3-3ef5-4b3f-a19d-3168962df52f service nova] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:30:58.026151 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1278/2553] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:30:57 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:30:58.092849 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ec0e52-03a8-4bb5-a179-d305dc46b8fc admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:30:58.092849 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-79ec0e52-03a8-4bb5-a179-d305dc46b8fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:30:58.139809 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108c6cd3-3ef5-4b3f-a19d-3168962df52f service nova] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:30:58.141717 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-108c6cd3-3ef5-4b3f-a19d-3168962df52f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:30:58.194402 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ec0e52-03a8-4bb5-a179-d305dc46b8fc admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:30:58.200163 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1def430-48ec-4f5a-b118-5f15f4df0c2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:30:58.201035 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1def430-48ec-4f5a-b118-5f15f4df0c2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:30:58.201329 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1def430-48ec-4f5a-b118-5f15f4df0c2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:30:58.201630 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1def430-48ec-4f5a-b118-5f15f4df0c2c admin admin] PATH_INFO: `/v3/projects/0c7f641c33de487eb9f4a6c75734caaa` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:30:58.203019 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1def430-48ec-4f5a-b118-5f15f4df0c2c admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c7f641c33de487eb9f4a6c75734caaa)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:30:58.205218 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1def430-48ec-4f5a-b118-5f15f4df0c2c admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:30:58.249249 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108c6cd3-3ef5-4b3f-a19d-3168962df52f service nova] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:30:58.253563 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02857ef5-00ef-4e93-ad58-223d2f056b4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5d25bfa8dc042329d57cd55fa7b7b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:30:58.254393 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02857ef5-00ef-4e93-ad58-223d2f056b4d service neutron] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:30:58.260789 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02857ef5-00ef-4e93-ad58-223d2f056b4d service neutron] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:30:58.260789 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02857ef5-00ef-4e93-ad58-223d2f056b4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:30:58.260789 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-02857ef5-00ef-4e93-ad58-223d2f056b4d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:30:58.268096 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02857ef5-00ef-4e93-ad58-223d2f056b4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:30:58.269836 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02857ef5-00ef-4e93-ad58-223d2f056b4d service neutron] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:30:58.282158 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1279/2554] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:30:58 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:30:58.371084 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-b1def430-48ec-4f5a-b118-5f15f4df0c2c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c7f641c33de487eb9f4a6c75734caaa', 'request_id': 'req-b1def430-48ec-4f5a-b118-5f15f4df0c2c'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:30:58.379128 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-b1def430-48ec-4f5a-b118-5f15f4df0c2c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c7f641c33de487eb9f4a6c75734caaa', 'request_id': 'req-b1def430-48ec-4f5a-b118-5f15f4df0c2c'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:30:58.386823 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-b1def430-48ec-4f5a-b118-5f15f4df0c2c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c7f641c33de487eb9f4a6c75734caaa', 'request_id': 'req-b1def430-48ec-4f5a-b118-5f15f4df0c2c'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:30:58.460152 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-b1def430-48ec-4f5a-b118-5f15f4df0c2c admin admin] The token cache is being invalidate because project 0c7f641c33de487eb9f4a6c75734caaa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80873) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 17:30:58.466671 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-b1def430-48ec-4f5a-b118-5f15f4df0c2c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:30:58.466671 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-b1def430-48ec-4f5a-b118-5f15f4df0c2c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:30:58.466671 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1276/2555] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 16 17:30:58 2022] DELETE /identity/v3/projects/0c7f641c33de487eb9f4a6c75734caaa => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:30:58.467859 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a749c50d-1e52-4572-bf81-8bd73e37185a None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:30:58.468161 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a749c50d-1e52-4572-bf81-8bd73e37185a None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:30:58.468445 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a749c50d-1e52-4572-bf81-8bd73e37185a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:30:58.488819 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-a749c50d-1e52-4572-bf81-8bd73e37185a None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:30:58.490189 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-a749c50d-1e52-4572-bf81-8bd73e37185a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:30:58.509331 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:30:58.552583 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1280/2556] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:30:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:30:58.560722 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c607a5-6039-4215-924c-d01fe2b9f851 None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:30:58.561016 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c607a5-6039-4215-924c-d01fe2b9f851 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:30:58.561300 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c607a5-6039-4215-924c-d01fe2b9f851 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:30:58.571186 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:30:58.584532 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-52c607a5-6039-4215-924c-d01fe2b9f851 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:30:58.586025 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-52c607a5-6039-4215-924c-d01fe2b9f851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:30:58.594200 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1277/2557] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:30:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 17:30:58.598796 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a749c50d-1e52-4572-bf81-8bd73e37185a None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:30:58.608860 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a749c50d-1e52-4572-bf81-8bd73e37185a None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:30:58.613609 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1ffc1e-29be-4be9-a9b1-be94cfe3d1a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:30:58.614316 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1ffc1e-29be-4be9-a9b1-be94cfe3d1a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:30:58.614602 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1ffc1e-29be-4be9-a9b1-be94cfe3d1a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:30:58.614880 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1ffc1e-29be-4be9-a9b1-be94cfe3d1a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:30:58.615608 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1ffc1e-29be-4be9-a9b1-be94cfe3d1a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:30:58.615952 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1ffc1e-29be-4be9-a9b1-be94cfe3d1a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:30:58.617547 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1ffc1e-29be-4be9-a9b1-be94cfe3d1a8 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:30:58.631037 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1281/2558] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 16 17:30:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:30:58.635638 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c607a5-6039-4215-924c-d01fe2b9f851 None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:30:58.645913 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c607a5-6039-4215-924c-d01fe2b9f851 None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:30:58.651074 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d693d9-d88f-453c-b779-405effd00f87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:30:58.651817 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d693d9-d88f-453c-b779-405effd00f87 admin admin] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:30:58.652199 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d693d9-d88f-453c-b779-405effd00f87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:30:58.652530 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d693d9-d88f-453c-b779-405effd00f87 admin admin] PATH_INFO: `/v3/projects` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:30:58.653306 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d693d9-d88f-453c-b779-405effd00f87 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:30:58.655339 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d693d9-d88f-453c-b779-405effd00f87 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:30:58.775782 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1278/2559] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 16 17:30:58 2022] POST /identity/v3/projects => generated 405 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 17:30:58.780179 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1ffc1e-29be-4be9-a9b1-be94cfe3d1a8 admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:30:58.791554 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1ffc1e-29be-4be9-a9b1-be94cfe3d1a8 admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:30:58.859397 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00eab683-10f1-4a1b-b0c6-6892c57516b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:30:58.860069 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eab683-10f1-4a1b-b0c6-6892c57516b6 admin admin] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:30:58.860545 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eab683-10f1-4a1b-b0c6-6892c57516b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:30:58.860825 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eab683-10f1-4a1b-b0c6-6892c57516b6 admin admin] PATH_INFO: `/v3/users` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:30:58.861531 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00eab683-10f1-4a1b-b0c6-6892c57516b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:30:58.863493 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00eab683-10f1-4a1b-b0c6-6892c57516b6 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:30:58.971684 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1282/2560] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 16 17:30:58 2022] POST /identity/v3/users => generated 303 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:30:58.973164 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d693d9-d88f-453c-b779-405effd00f87 admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:30:58.984206 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d693d9-d88f-453c-b779-405effd00f87 admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:30:58.990392 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed94b24-f07d-4ac7-993b-301cf281d686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:30:58.991103 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed94b24-f07d-4ac7-993b-301cf281d686 admin admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:30:58.991424 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed94b24-f07d-4ac7-993b-301cf281d686 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:30:58.991714 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed94b24-f07d-4ac7-993b-301cf281d686 admin admin] PATH_INFO: `/v3/roles` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:30:58.992462 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed94b24-f07d-4ac7-993b-301cf281d686 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:30:58.994121 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed94b24-f07d-4ac7-993b-301cf281d686 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:30:59.005745 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1279/2561] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 17:30:58 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:30:59.009901 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00eab683-10f1-4a1b-b0c6-6892c57516b6 admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:30:59.020409 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00eab683-10f1-4a1b-b0c6-6892c57516b6 admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:30:59.025125 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac572811-ebe9-4c87-8d3f-baf59a503a41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:30:59.025810 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac572811-ebe9-4c87-8d3f-baf59a503a41 admin admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:30:59.026099 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac572811-ebe9-4c87-8d3f-baf59a503a41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:30:59.026379 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac572811-ebe9-4c87-8d3f-baf59a503a41 admin admin] PATH_INFO: `/v3/roles` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:30:59.027161 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac572811-ebe9-4c87-8d3f-baf59a503a41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:30:59.028750 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac572811-ebe9-4c87-8d3f-baf59a503a41 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:30:59.040486 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1283/2562] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 17:30:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:30:59.044599 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed94b24-f07d-4ac7-993b-301cf281d686 admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:30:59.055887 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed94b24-f07d-4ac7-993b-301cf281d686 admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:30:59.062823 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0436bdf-84fa-4052-ab35-415000df81d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:30:59.063863 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0436bdf-84fa-4052-ab35-415000df81d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:30:59.064343 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0436bdf-84fa-4052-ab35-415000df81d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:30:59.064712 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0436bdf-84fa-4052-ab35-415000df81d4 admin admin] PATH_INFO: `/v3/projects/2ee061b293154c6591a2d1ba81cf658f/users/2a3e5e965c144828859039be1a7d94b8/roles/896bff49c5d6464eb612a15f4aa9badc` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:30:59.087102 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0436bdf-84fa-4052-ab35-415000df81d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ee061b293154c6591a2d1ba81cf658f, user_id=2a3e5e965c144828859039be1a7d94b8, role_id=896bff49c5d6464eb612a15f4aa9badc)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:30:59.090009 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0436bdf-84fa-4052-ab35-415000df81d4 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:30:59.095041 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac572811-ebe9-4c87-8d3f-baf59a503a41 admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:30:59.099302 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-ac572811-ebe9-4c87-8d3f-baf59a503a41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:30:59.181159 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1280/2563] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 17:30:59 2022] PUT /identity/v3/projects/2ee061b293154c6591a2d1ba81cf658f/users/2a3e5e965c144828859039be1a7d94b8/roles/896bff49c5d6464eb612a15f4aa9badc => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:30:59.183054 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597efd23-4831-4ffb-9211-0808f1b5eae2 None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:30:59.183344 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597efd23-4831-4ffb-9211-0808f1b5eae2 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:30:59.183784 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597efd23-4831-4ffb-9211-0808f1b5eae2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:30:59.185630 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac572811-ebe9-4c87-8d3f-baf59a503a41 admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:30:59.215149 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-597efd23-4831-4ffb-9211-0808f1b5eae2 None None] MFA Rules not processed for user `2a3e5e965c144828859039be1a7d94b8`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:30:59.216651 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-597efd23-4831-4ffb-9211-0808f1b5eae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:30:59.227296 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:30:59.278821 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07dd4f3-1897-4f16-92ea-6e8435af05bc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d381bb41dea4f1e90c3cf3815ac88dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:30:59.286301 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07dd4f3-1897-4f16-92ea-6e8435af05bc service nova] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:30:59.286301 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07dd4f3-1897-4f16-92ea-6e8435af05bc service nova] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:30:59.286301 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07dd4f3-1897-4f16-92ea-6e8435af05bc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:30:59.286301 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-b07dd4f3-1897-4f16-92ea-6e8435af05bc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:30:59.296390 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07dd4f3-1897-4f16-92ea-6e8435af05bc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:30:59.296644 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1281/2564] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:30:59 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:30:59.298627 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07dd4f3-1897-4f16-92ea-6e8435af05bc service nova] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:30:59.302090 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597efd23-4831-4ffb-9211-0808f1b5eae2 None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:30:59.311373 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1284/2565] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:30:59 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 17:30:59.388001 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597efd23-4831-4ffb-9211-0808f1b5eae2 None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:30:59.393058 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237ba448-4a3a-47cc-a120-bc1256c03b28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:30:59.394199 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237ba448-4a3a-47cc-a120-bc1256c03b28 admin admin] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:30:59.394428 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237ba448-4a3a-47cc-a120-bc1256c03b28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:30:59.394930 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237ba448-4a3a-47cc-a120-bc1256c03b28 admin admin] PATH_INFO: `/v3/projects` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:30:59.395904 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237ba448-4a3a-47cc-a120-bc1256c03b28 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:30:59.397871 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237ba448-4a3a-47cc-a120-bc1256c03b28 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:30:59.516386 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1282/2566] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 16 17:30:59 2022] POST /identity/v3/projects => generated 401 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 17:30:59.519480 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07dd4f3-1897-4f16-92ea-6e8435af05bc service nova] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:30:59.531297 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07dd4f3-1897-4f16-92ea-6e8435af05bc service nova] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:30:59.612163 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594e2259-86c5-43a4-81b1-ee6533bf94a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:30:59.612955 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594e2259-86c5-43a4-81b1-ee6533bf94a0 admin admin] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:30:59.613680 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594e2259-86c5-43a4-81b1-ee6533bf94a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:30:59.614614 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594e2259-86c5-43a4-81b1-ee6533bf94a0 admin admin] PATH_INFO: `/v3/users` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:30:59.615567 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594e2259-86c5-43a4-81b1-ee6533bf94a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:30:59.617659 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594e2259-86c5-43a4-81b1-ee6533bf94a0 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:30:59.740405 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1285/2567] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 16 17:30:59 2022] POST /identity/v3/users => generated 307 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 17:30:59.744576 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237ba448-4a3a-47cc-a120-bc1256c03b28 admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:30:59.755745 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237ba448-4a3a-47cc-a120-bc1256c03b28 admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:30:59.760373 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634e5436-ff1b-46d4-b297-083a1fbe4ec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:30:59.761045 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634e5436-ff1b-46d4-b297-083a1fbe4ec4 admin admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:30:59.761340 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634e5436-ff1b-46d4-b297-083a1fbe4ec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:30:59.761661 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634e5436-ff1b-46d4-b297-083a1fbe4ec4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:30:59.762441 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634e5436-ff1b-46d4-b297-083a1fbe4ec4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:30:59.764048 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634e5436-ff1b-46d4-b297-083a1fbe4ec4 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:30:59.776971 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1283/2568] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 17:30:59 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:30:59.781127 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594e2259-86c5-43a4-81b1-ee6533bf94a0 admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:30:59.791443 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594e2259-86c5-43a4-81b1-ee6533bf94a0 admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:30:59.796178 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3608b678-480e-4a63-b0aa-975022deae37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:30:59.797069 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3608b678-480e-4a63-b0aa-975022deae37 admin admin] REQUEST_METHOD: `PUT` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:30:59.797362 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3608b678-480e-4a63-b0aa-975022deae37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:30:59.797780 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3608b678-480e-4a63-b0aa-975022deae37 admin admin] PATH_INFO: `/v3/projects/09519c1d70a94f50a820efa39496ce7a/users/7d018763d6b742c69cf8f60e8a55e801/roles/dba744f8ab2a4c45b9d3212f8d203aba` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:30:59.813689 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3608b678-480e-4a63-b0aa-975022deae37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=09519c1d70a94f50a820efa39496ce7a, user_id=7d018763d6b742c69cf8f60e8a55e801, role_id=dba744f8ab2a4c45b9d3212f8d203aba)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:30:59.816446 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3608b678-480e-4a63-b0aa-975022deae37 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:30:59.899858 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1286/2569] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 17:30:59 2022] PUT /identity/v3/projects/09519c1d70a94f50a820efa39496ce7a/users/7d018763d6b742c69cf8f60e8a55e801/roles/dba744f8ab2a4c45b9d3212f8d203aba => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:30:59.904423 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634e5436-ff1b-46d4-b297-083a1fbe4ec4 admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:30:59.909992 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:30:59.916128 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634e5436-ff1b-46d4-b297-083a1fbe4ec4 admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:30:59.986015 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94989d77-74ad-4ec0-858d-3ab175a34018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:30:59.986698 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94989d77-74ad-4ec0-858d-3ab175a34018 admin admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:30:59.986978 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94989d77-74ad-4ec0-858d-3ab175a34018 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:30:59.987258 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94989d77-74ad-4ec0-858d-3ab175a34018 admin admin] PATH_INFO: `/v3/roles` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:30:59.987980 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94989d77-74ad-4ec0-858d-3ab175a34018 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:30:59.990317 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94989d77-74ad-4ec0-858d-3ab175a34018 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:31:00.001030 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1284/2570] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 17:30:59 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:31:00.005382 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3608b678-480e-4a63-b0aa-975022deae37 admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:31:00.019267 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3608b678-480e-4a63-b0aa-975022deae37 admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:31:00.028479 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6909c34-2230-4ead-996c-445234f6fad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:31:00.029402 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6909c34-2230-4ead-996c-445234f6fad5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:31:00.029726 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6909c34-2230-4ead-996c-445234f6fad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:31:00.030048 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6909c34-2230-4ead-996c-445234f6fad5 admin admin] PATH_INFO: `/v3/projects/09519c1d70a94f50a820efa39496ce7a/users/7d018763d6b742c69cf8f60e8a55e801/roles/dba744f8ab2a4c45b9d3212f8d203aba` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:31:00.032512 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6909c34-2230-4ead-996c-445234f6fad5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=09519c1d70a94f50a820efa39496ce7a, user_id=7d018763d6b742c69cf8f60e8a55e801, role_id=dba744f8ab2a4c45b9d3212f8d203aba)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:31:00.037056 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6909c34-2230-4ead-996c-445234f6fad5 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:31:00.050064 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1287/2571] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 17:31:00 2022] PUT /identity/v3/projects/09519c1d70a94f50a820efa39496ce7a/users/7d018763d6b742c69cf8f60e8a55e801/roles/dba744f8ab2a4c45b9d3212f8d203aba => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 17:31:00.062777 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557973e0-f2da-4ce5-a135-e74b5256a86c None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:31:00.063159 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557973e0-f2da-4ce5-a135-e74b5256a86c None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:31:00.063511 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557973e0-f2da-4ce5-a135-e74b5256a86c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:31:00.094330 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-557973e0-f2da-4ce5-a135-e74b5256a86c None None] MFA Rules not processed for user `7d018763d6b742c69cf8f60e8a55e801`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:31:00.096537 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-557973e0-f2da-4ce5-a135-e74b5256a86c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:31:00.172267 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1285/2572] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:31:00 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:31:00.184714 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6909c34-2230-4ead-996c-445234f6fad5 admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:31:00.187865 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-e6909c34-2230-4ead-996c-445234f6fad5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:31:00.254764 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6909c34-2230-4ead-996c-445234f6fad5 admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:31:00.258904 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5127a774-249a-4301-9c91-76ea0d6c97ca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef37136b89d34edc9cd94c7aa81b2095', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:31:00.259574 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5127a774-249a-4301-9c91-76ea0d6c97ca service cinder] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:31:00.259865 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5127a774-249a-4301-9c91-76ea0d6c97ca service cinder] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:31:00.260149 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5127a774-249a-4301-9c91-76ea0d6c97ca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:31:00.270905 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5127a774-249a-4301-9c91-76ea0d6c97ca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:31:00.272285 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5127a774-249a-4301-9c91-76ea0d6c97ca service cinder] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:31:00.282356 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1288/2573] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:31:00 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:31:00.414553 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557973e0-f2da-4ce5-a135-e74b5256a86c None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:31:00.479423 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557973e0-f2da-4ce5-a135-e74b5256a86c None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:31:00.483978 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1defb35-0b0b-46d6-8e34-4369e1402808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:31:00.484845 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1defb35-0b0b-46d6-8e34-4369e1402808 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:31:00.485157 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1defb35-0b0b-46d6-8e34-4369e1402808 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:31:00.485439 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1defb35-0b0b-46d6-8e34-4369e1402808 admin admin] PATH_INFO: `/v3/users/2a3e5e965c144828859039be1a7d94b8` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:31:00.486700 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1defb35-0b0b-46d6-8e34-4369e1402808 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a3e5e965c144828859039be1a7d94b8)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:31:00.488659 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1defb35-0b0b-46d6-8e34-4369e1402808 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:31:00.552743 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:31:00.655662 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-c1defb35-0b0b-46d6-8e34-4369e1402808 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a3e5e965c144828859039be1a7d94b8'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:31:00.656433 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-c1defb35-0b0b-46d6-8e34-4369e1402808 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a3e5e965c144828859039be1a7d94b8'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:31:00.666080 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-c1defb35-0b0b-46d6-8e34-4369e1402808 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a3e5e965c144828859039be1a7d94b8'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:31:00.762125 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-c1defb35-0b0b-46d6-8e34-4369e1402808 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a3e5e965c144828859039be1a7d94b8'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:31:00.770036 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-c1defb35-0b0b-46d6-8e34-4369e1402808 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a3e5e965c144828859039be1a7d94b8'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:31:00.788194 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1286/2574] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 16 17:31:00 2022] DELETE /identity/v3/users/2a3e5e965c144828859039be1a7d94b8 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:31:00.792909 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bd9aad-fedc-4149-ab64-b46d0ae62850 None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:31:00.793210 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bd9aad-fedc-4149-ab64-b46d0ae62850 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:31:00.793502 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bd9aad-fedc-4149-ab64-b46d0ae62850 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:31:00.806290 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:31:00.812502 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-35bd9aad-fedc-4149-ab64-b46d0ae62850 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:31:00.813720 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-35bd9aad-fedc-4149-ab64-b46d0ae62850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:31:00.872742 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1289/2575] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:31:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 17:31:00.882540 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1defb35-0b0b-46d6-8e34-4369e1402808 admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:31:00.884061 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-c1defb35-0b0b-46d6-8e34-4369e1402808 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:31:00.944629 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1defb35-0b0b-46d6-8e34-4369e1402808 admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:31:00.948258 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c6c78f-0e03-46d8-b217-c99b6ffb1084 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5d25bfa8dc042329d57cd55fa7b7b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:31:00.948929 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c6c78f-0e03-46d8-b217-c99b6ffb1084 service neutron] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:31:00.949190 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c6c78f-0e03-46d8-b217-c99b6ffb1084 service neutron] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:31:00.949469 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c6c78f-0e03-46d8-b217-c99b6ffb1084 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:31:00.958818 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c6c78f-0e03-46d8-b217-c99b6ffb1084 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:31:00.960219 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c6c78f-0e03-46d8-b217-c99b6ffb1084 service neutron] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:31:00.969697 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1287/2576] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:31:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:31:01.529800 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bd9aad-fedc-4149-ab64-b46d0ae62850 None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:31:01.539870 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-35bd9aad-fedc-4149-ab64-b46d0ae62850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:31:01.544026 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bd9aad-fedc-4149-ab64-b46d0ae62850 None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:31:01.549307 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503e2512-7c73-4be2-989f-b4d357d5349d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:31:01.550195 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503e2512-7c73-4be2-989f-b4d357d5349d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:31:01.550481 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503e2512-7c73-4be2-989f-b4d357d5349d admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:31:01.550756 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503e2512-7c73-4be2-989f-b4d357d5349d admin admin] PATH_INFO: `/v3/projects/2ee061b293154c6591a2d1ba81cf658f` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:31:01.551950 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503e2512-7c73-4be2-989f-b4d357d5349d admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ee061b293154c6591a2d1ba81cf658f)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:31:01.554807 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503e2512-7c73-4be2-989f-b4d357d5349d admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:31:01.711633 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-503e2512-7c73-4be2-989f-b4d357d5349d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ee061b293154c6591a2d1ba81cf658f', 'request_id': 'req-503e2512-7c73-4be2-989f-b4d357d5349d'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:31:01.717103 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-503e2512-7c73-4be2-989f-b4d357d5349d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ee061b293154c6591a2d1ba81cf658f', 'request_id': 'req-503e2512-7c73-4be2-989f-b4d357d5349d'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:31:01.819814 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-503e2512-7c73-4be2-989f-b4d357d5349d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ee061b293154c6591a2d1ba81cf658f', 'request_id': 'req-503e2512-7c73-4be2-989f-b4d357d5349d'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:31:01.831615 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-503e2512-7c73-4be2-989f-b4d357d5349d admin admin] The token cache is being invalidate because project 2ee061b293154c6591a2d1ba81cf658f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80874) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 17:31:01.831906 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-503e2512-7c73-4be2-989f-b4d357d5349d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:31:01.832529 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-503e2512-7c73-4be2-989f-b4d357d5349d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:31:01.834753 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1290/2577] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 16 17:31:01 2022] DELETE /identity/v3/projects/2ee061b293154c6591a2d1ba81cf658f => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:31:01.838797 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c6c78f-0e03-46d8-b217-c99b6ffb1084 service neutron] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:31:01.848737 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c6c78f-0e03-46d8-b217-c99b6ffb1084 service neutron] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:31:01.905855 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2f413c-bc7c-4fd5-a546-331f85e8f8f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:31:01.909868 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2f413c-bc7c-4fd5-a546-331f85e8f8f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:31:01.909868 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2f413c-bc7c-4fd5-a546-331f85e8f8f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:31:01.909868 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2f413c-bc7c-4fd5-a546-331f85e8f8f9 admin admin] PATH_INFO: `/v3/users/7d018763d6b742c69cf8f60e8a55e801` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:31:01.909868 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2f413c-bc7c-4fd5-a546-331f85e8f8f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d018763d6b742c69cf8f60e8a55e801)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:31:01.910889 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2f413c-bc7c-4fd5-a546-331f85e8f8f9 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:31:02.117639 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-bd2f413c-bc7c-4fd5-a546-331f85e8f8f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d018763d6b742c69cf8f60e8a55e801'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:31:02.118365 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-bd2f413c-bc7c-4fd5-a546-331f85e8f8f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d018763d6b742c69cf8f60e8a55e801'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:31:02.118989 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-bd2f413c-bc7c-4fd5-a546-331f85e8f8f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d018763d6b742c69cf8f60e8a55e801'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:31:02.120753 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:31:02.201951 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-bd2f413c-bc7c-4fd5-a546-331f85e8f8f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d018763d6b742c69cf8f60e8a55e801'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:31:02.210097 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-bd2f413c-bc7c-4fd5-a546-331f85e8f8f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d018763d6b742c69cf8f60e8a55e801'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:31:02.228202 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1288/2578] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 16 17:31:01 2022] DELETE /identity/v3/users/7d018763d6b742c69cf8f60e8a55e801 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:31:02.707520 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503e2512-7c73-4be2-989f-b4d357d5349d admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:31:02.709102 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-503e2512-7c73-4be2-989f-b4d357d5349d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:31:02.724250 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503e2512-7c73-4be2-989f-b4d357d5349d admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:31:02.783457 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5a1330-c893-4b38-a46a-1e89017c95bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:31:02.784382 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5a1330-c893-4b38-a46a-1e89017c95bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:31:02.784670 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5a1330-c893-4b38-a46a-1e89017c95bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:31:02.784956 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5a1330-c893-4b38-a46a-1e89017c95bd admin admin] PATH_INFO: `/v3/projects/09519c1d70a94f50a820efa39496ce7a` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:31:02.786194 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5a1330-c893-4b38-a46a-1e89017c95bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=09519c1d70a94f50a820efa39496ce7a)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:31:02.788652 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5a1330-c893-4b38-a46a-1e89017c95bd admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:31:02.905448 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:31:02.917702 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-2f5a1330-c893-4b38-a46a-1e89017c95bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09519c1d70a94f50a820efa39496ce7a', 'request_id': 'req-2f5a1330-c893-4b38-a46a-1e89017c95bd'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:31:02.923224 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-2f5a1330-c893-4b38-a46a-1e89017c95bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09519c1d70a94f50a820efa39496ce7a', 'request_id': 'req-2f5a1330-c893-4b38-a46a-1e89017c95bd'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:31:03.036476 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-2f5a1330-c893-4b38-a46a-1e89017c95bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09519c1d70a94f50a820efa39496ce7a', 'request_id': 'req-2f5a1330-c893-4b38-a46a-1e89017c95bd'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:31:03.048921 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-2f5a1330-c893-4b38-a46a-1e89017c95bd admin admin] The token cache is being invalidate because project 09519c1d70a94f50a820efa39496ce7a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80874) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 17:31:03.049214 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-2f5a1330-c893-4b38-a46a-1e89017c95bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:31:03.049887 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-2f5a1330-c893-4b38-a46a-1e89017c95bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:31:03.051496 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1291/2579] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 16 17:31:02 2022] DELETE /identity/v3/projects/09519c1d70a94f50a820efa39496ce7a => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:31:03.056934 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7703eb60-10cd-456e-bdbc-efd9f8e71bbe None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:31:03.057496 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7703eb60-10cd-456e-bdbc-efd9f8e71bbe None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:31:03.057603 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7703eb60-10cd-456e-bdbc-efd9f8e71bbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:31:03.076138 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-7703eb60-10cd-456e-bdbc-efd9f8e71bbe None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:31:03.077358 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-7703eb60-10cd-456e-bdbc-efd9f8e71bbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:31:03.137028 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1289/2580] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:31:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:31:03.144881 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c252b410-8864-4b25-a8b0-c53f4b53fb3f None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:31:03.145178 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c252b410-8864-4b25-a8b0-c53f4b53fb3f None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:31:03.145456 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c252b410-8864-4b25-a8b0-c53f4b53fb3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:31:03.164500 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-c252b410-8864-4b25-a8b0-c53f4b53fb3f None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:31:03.165696 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-c252b410-8864-4b25-a8b0-c53f4b53fb3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:31:03.173524 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1292/2581] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:31:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 17:31:03.177753 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7703eb60-10cd-456e-bdbc-efd9f8e71bbe None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:31:03.187358 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7703eb60-10cd-456e-bdbc-efd9f8e71bbe None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:31:03.192071 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ac3e36-1a14-46c7-aa01-479d6028c836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:31:03.192720 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ac3e36-1a14-46c7-aa01-479d6028c836 admin admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:31:03.193012 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ac3e36-1a14-46c7-aa01-479d6028c836 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:31:03.193578 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ac3e36-1a14-46c7-aa01-479d6028c836 admin admin] PATH_INFO: `/v3/domains` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:31:03.194348 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ac3e36-1a14-46c7-aa01-479d6028c836 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80873) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:31:03.194665 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ac3e36-1a14-46c7-aa01-479d6028c836 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:31:03.196264 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ac3e36-1a14-46c7-aa01-479d6028c836 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:31:03.208063 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1290/2582] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 16 17:31:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:31:03.212723 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c252b410-8864-4b25-a8b0-c53f4b53fb3f None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:31:03.221867 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c252b410-8864-4b25-a8b0-c53f4b53fb3f None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:31:03.227178 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29674c3a-09c6-4892-acde-257586a22ccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:31:03.227821 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29674c3a-09c6-4892-acde-257586a22ccc admin admin] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:31:03.228110 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29674c3a-09c6-4892-acde-257586a22ccc admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:31:03.228388 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29674c3a-09c6-4892-acde-257586a22ccc admin admin] PATH_INFO: `/v3/projects` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:31:03.229083 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29674c3a-09c6-4892-acde-257586a22ccc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:31:03.231040 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29674c3a-09c6-4892-acde-257586a22ccc admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:31:03.311844 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1293/2583] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 16 17:31:03 2022] POST /identity/v3/projects => generated 361 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:31:03.315903 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ac3e36-1a14-46c7-aa01-479d6028c836 admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:31:03.326345 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ac3e36-1a14-46c7-aa01-479d6028c836 admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:31:03.383206 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed7eb79-58b4-4f99-ae0b-a98d6e34644b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:31:03.383873 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed7eb79-58b4-4f99-ae0b-a98d6e34644b admin admin] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:31:03.384164 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed7eb79-58b4-4f99-ae0b-a98d6e34644b admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:31:03.384447 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed7eb79-58b4-4f99-ae0b-a98d6e34644b admin admin] PATH_INFO: `/v3/users` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:31:03.385167 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed7eb79-58b4-4f99-ae0b-a98d6e34644b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:31:03.387151 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed7eb79-58b4-4f99-ae0b-a98d6e34644b admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:31:03.505574 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1291/2584] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 16 17:31:03 2022] POST /identity/v3/users => generated 281 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:31:03.510187 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29674c3a-09c6-4892-acde-257586a22ccc admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:31:03.520782 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29674c3a-09c6-4892-acde-257586a22ccc admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:31:03.526343 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e346f6-7ef7-4fed-a8b4-4d714c3ada0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:31:03.527014 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e346f6-7ef7-4fed-a8b4-4d714c3ada0c admin admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:31:03.527312 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e346f6-7ef7-4fed-a8b4-4d714c3ada0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:31:03.527590 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e346f6-7ef7-4fed-a8b4-4d714c3ada0c admin admin] PATH_INFO: `/v3/roles` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:31:03.528322 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e346f6-7ef7-4fed-a8b4-4d714c3ada0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:31:03.530015 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e346f6-7ef7-4fed-a8b4-4d714c3ada0c admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:31:03.541464 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1294/2585] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 17:31:03 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:31:03.545518 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed7eb79-58b4-4f99-ae0b-a98d6e34644b admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:31:03.556406 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed7eb79-58b4-4f99-ae0b-a98d6e34644b admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:31:03.561269 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8612d69b-2ef4-4050-aaed-ad34b46eba10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:31:03.562053 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8612d69b-2ef4-4050-aaed-ad34b46eba10 admin admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:31:03.562286 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8612d69b-2ef4-4050-aaed-ad34b46eba10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:31:03.562562 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8612d69b-2ef4-4050-aaed-ad34b46eba10 admin admin] PATH_INFO: `/v3/roles` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:31:03.563288 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8612d69b-2ef4-4050-aaed-ad34b46eba10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:31:03.564931 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8612d69b-2ef4-4050-aaed-ad34b46eba10 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:31:03.577197 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1292/2586] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 17:31:03 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:31:03.581362 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e346f6-7ef7-4fed-a8b4-4d714c3ada0c admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:31:03.591563 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e346f6-7ef7-4fed-a8b4-4d714c3ada0c admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:31:03.596254 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d828568-b66f-4805-b13f-7544060cc43e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:31:03.597130 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d828568-b66f-4805-b13f-7544060cc43e admin admin] REQUEST_METHOD: `PUT` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:31:03.597415 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d828568-b66f-4805-b13f-7544060cc43e admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:31:03.597694 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d828568-b66f-4805-b13f-7544060cc43e admin admin] PATH_INFO: `/v3/projects/d4f917d9f7e544c29a39782a0bfbec23/users/0efd21cc23b545b19424cde3eecddce6/roles/896bff49c5d6464eb612a15f4aa9badc` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:31:03.612410 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d828568-b66f-4805-b13f-7544060cc43e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4f917d9f7e544c29a39782a0bfbec23, user_id=0efd21cc23b545b19424cde3eecddce6, role_id=896bff49c5d6464eb612a15f4aa9badc)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:31:03.615765 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d828568-b66f-4805-b13f-7544060cc43e admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:31:03.676419 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1295/2587] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 17:31:03 2022] PUT /identity/v3/projects/d4f917d9f7e544c29a39782a0bfbec23/users/0efd21cc23b545b19424cde3eecddce6/roles/896bff49c5d6464eb612a15f4aa9badc => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:31:03.688560 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7113399b-5285-497a-ab40-8df0a397697c None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:31:03.688841 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7113399b-5285-497a-ab40-8df0a397697c None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:31:03.689130 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7113399b-5285-497a-ab40-8df0a397697c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:31:03.725003 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-7113399b-5285-497a-ab40-8df0a397697c None None] MFA Rules not processed for user `0efd21cc23b545b19424cde3eecddce6`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:31:03.726289 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-7113399b-5285-497a-ab40-8df0a397697c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:31:03.745421 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:INSERT=4,keystone:DELETE=3,keystone:SELECT=93 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:31:03.805680 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1293/2588] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:31:03 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:31:03.810206 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d828568-b66f-4805-b13f-7544060cc43e admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:31:03.875149 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d828568-b66f-4805-b13f-7544060cc43e admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:31:03.880004 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0e097e-5f56-4d60-a97e-a323895310db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:31:03.880792 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0e097e-5f56-4d60-a97e-a323895310db admin admin] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:31:03.881089 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0e097e-5f56-4d60-a97e-a323895310db admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:31:03.881375 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0e097e-5f56-4d60-a97e-a323895310db admin admin] PATH_INFO: `/v3/projects` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:31:03.882132 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0e097e-5f56-4d60-a97e-a323895310db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:31:03.884080 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0e097e-5f56-4d60-a97e-a323895310db admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:31:03.968957 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1296/2589] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 16 17:31:03 2022] POST /identity/v3/projects => generated 365 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:31:03.973120 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7113399b-5285-497a-ab40-8df0a397697c None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:31:03.983885 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7113399b-5285-497a-ab40-8df0a397697c None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:31:04.042283 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86bc231-fe11-4990-8c3e-14c68acf3b6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:31:04.043016 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86bc231-fe11-4990-8c3e-14c68acf3b6a admin admin] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:31:04.043344 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86bc231-fe11-4990-8c3e-14c68acf3b6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:31:04.043668 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86bc231-fe11-4990-8c3e-14c68acf3b6a admin admin] PATH_INFO: `/v3/users` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:31:04.044486 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86bc231-fe11-4990-8c3e-14c68acf3b6a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:31:04.046593 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86bc231-fe11-4990-8c3e-14c68acf3b6a admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:31:04.128609 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1294/2590] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 16 17:31:03 2022] POST /identity/v3/users => generated 289 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:31:04.132913 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0e097e-5f56-4d60-a97e-a323895310db admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:31:04.143647 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0e097e-5f56-4d60-a97e-a323895310db admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:31:04.149099 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7659a779-9adb-4b5a-a1d8-5488e1abc778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:31:04.149808 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7659a779-9adb-4b5a-a1d8-5488e1abc778 admin admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:31:04.150108 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7659a779-9adb-4b5a-a1d8-5488e1abc778 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:31:04.150390 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7659a779-9adb-4b5a-a1d8-5488e1abc778 admin admin] PATH_INFO: `/v3/roles` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:31:04.151117 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7659a779-9adb-4b5a-a1d8-5488e1abc778 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:31:04.152710 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7659a779-9adb-4b5a-a1d8-5488e1abc778 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:31:04.163924 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1297/2591] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 17:31:04 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:31:04.168098 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86bc231-fe11-4990-8c3e-14c68acf3b6a admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:31:04.177885 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86bc231-fe11-4990-8c3e-14c68acf3b6a admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:31:04.182471 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe4bd5e-4a68-4661-b18c-0e683961705b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:31:04.183337 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe4bd5e-4a68-4661-b18c-0e683961705b admin admin] REQUEST_METHOD: `PUT` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:31:04.183622 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe4bd5e-4a68-4661-b18c-0e683961705b admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:31:04.183899 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe4bd5e-4a68-4661-b18c-0e683961705b admin admin] PATH_INFO: `/v3/projects/b302c421377143018370839fd18e9f80/users/c6a852a3c6924584a99df1c8c0360f1c/roles/dba744f8ab2a4c45b9d3212f8d203aba` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:31:04.198592 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe4bd5e-4a68-4661-b18c-0e683961705b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b302c421377143018370839fd18e9f80, user_id=c6a852a3c6924584a99df1c8c0360f1c, role_id=dba744f8ab2a4c45b9d3212f8d203aba)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:31:04.201304 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe4bd5e-4a68-4661-b18c-0e683961705b admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:31:04.299406 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1295/2592] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 17:31:04 2022] PUT /identity/v3/projects/b302c421377143018370839fd18e9f80/users/c6a852a3c6924584a99df1c8c0360f1c/roles/dba744f8ab2a4c45b9d3212f8d203aba => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:31:04.303919 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7659a779-9adb-4b5a-a1d8-5488e1abc778 admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:31:04.313897 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7659a779-9adb-4b5a-a1d8-5488e1abc778 admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:31:04.345808 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:31:04.375345 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ccc571-ff45-48ac-ab0d-907db64f5064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:31:04.376028 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ccc571-ff45-48ac-ab0d-907db64f5064 admin admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:31:04.376322 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ccc571-ff45-48ac-ab0d-907db64f5064 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:31:04.376606 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ccc571-ff45-48ac-ab0d-907db64f5064 admin admin] PATH_INFO: `/v3/roles` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:31:04.377341 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ccc571-ff45-48ac-ab0d-907db64f5064 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:31:04.379418 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ccc571-ff45-48ac-ab0d-907db64f5064 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:31:04.390005 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1298/2593] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 17:31:04 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:31:04.393924 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe4bd5e-4a68-4661-b18c-0e683961705b admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:31:04.404868 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe4bd5e-4a68-4661-b18c-0e683961705b admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:31:04.409842 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026edee5-4f29-406a-bbf3-d220e19e8978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:31:04.410814 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026edee5-4f29-406a-bbf3-d220e19e8978 admin admin] REQUEST_METHOD: `PUT` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:31:04.411203 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026edee5-4f29-406a-bbf3-d220e19e8978 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:31:04.411534 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026edee5-4f29-406a-bbf3-d220e19e8978 admin admin] PATH_INFO: `/v3/projects/b302c421377143018370839fd18e9f80/users/c6a852a3c6924584a99df1c8c0360f1c/roles/dba744f8ab2a4c45b9d3212f8d203aba` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:31:04.414212 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026edee5-4f29-406a-bbf3-d220e19e8978 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b302c421377143018370839fd18e9f80, user_id=c6a852a3c6924584a99df1c8c0360f1c, role_id=dba744f8ab2a4c45b9d3212f8d203aba)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:31:04.416956 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026edee5-4f29-406a-bbf3-d220e19e8978 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:31:04.428341 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1296/2594] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 17:31:04 2022] PUT /identity/v3/projects/b302c421377143018370839fd18e9f80/users/c6a852a3c6924584a99df1c8c0360f1c/roles/dba744f8ab2a4c45b9d3212f8d203aba => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 17:31:04.438485 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173bd489-ea8e-4cbe-bdc0-46f4ed1eb27b None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:31:04.438778 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173bd489-ea8e-4cbe-bdc0-46f4ed1eb27b None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:31:04.439063 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173bd489-ea8e-4cbe-bdc0-46f4ed1eb27b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:31:04.466504 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-173bd489-ea8e-4cbe-bdc0-46f4ed1eb27b None None] MFA Rules not processed for user `c6a852a3c6924584a99df1c8c0360f1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:31:04.467741 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-173bd489-ea8e-4cbe-bdc0-46f4ed1eb27b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:31:04.548091 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1299/2595] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:31:04 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:31:04.560145 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026edee5-4f29-406a-bbf3-d220e19e8978 admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:31:04.561920 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-026edee5-4f29-406a-bbf3-d220e19e8978 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:31:04.620317 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026edee5-4f29-406a-bbf3-d220e19e8978 admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:31:04.624049 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8770c7d2-5282-42a7-ab6f-8a39fa526fb2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef37136b89d34edc9cd94c7aa81b2095', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:31:04.624705 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8770c7d2-5282-42a7-ab6f-8a39fa526fb2 service cinder] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:31:04.624988 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8770c7d2-5282-42a7-ab6f-8a39fa526fb2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:31:04.625266 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8770c7d2-5282-42a7-ab6f-8a39fa526fb2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:31:04.634639 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8770c7d2-5282-42a7-ab6f-8a39fa526fb2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:31:04.635990 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8770c7d2-5282-42a7-ab6f-8a39fa526fb2 service cinder] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:31:04.645581 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1297/2596] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:31:04 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:31:05.728817 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173bd489-ea8e-4cbe-bdc0-46f4ed1eb27b None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:31:05.793712 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173bd489-ea8e-4cbe-bdc0-46f4ed1eb27b None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:31:05.801505 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fff47c5-2337-423b-bcba-5da742940f1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:31:05.809238 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fff47c5-2337-423b-bcba-5da742940f1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:31:05.809238 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fff47c5-2337-423b-bcba-5da742940f1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:31:05.809238 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fff47c5-2337-423b-bcba-5da742940f1d admin admin] PATH_INFO: `/v3/users/0efd21cc23b545b19424cde3eecddce6` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:31:05.809238 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fff47c5-2337-423b-bcba-5da742940f1d admin admin] RBAC: Authorizing `identity:delete_user(user_id=0efd21cc23b545b19424cde3eecddce6)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:31:05.810772 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fff47c5-2337-423b-bcba-5da742940f1d admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:31:06.016073 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-4fff47c5-2337-423b-bcba-5da742940f1d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0efd21cc23b545b19424cde3eecddce6'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:31:06.022449 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:31:06.024704 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-4fff47c5-2337-423b-bcba-5da742940f1d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0efd21cc23b545b19424cde3eecddce6'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:31:06.100339 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-4fff47c5-2337-423b-bcba-5da742940f1d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0efd21cc23b545b19424cde3eecddce6'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:31:06.101026 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-4fff47c5-2337-423b-bcba-5da742940f1d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0efd21cc23b545b19424cde3eecddce6'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:31:06.113728 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-4fff47c5-2337-423b-bcba-5da742940f1d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0efd21cc23b545b19424cde3eecddce6'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:31:06.120795 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1300/2597] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 16 17:31:05 2022] DELETE /identity/v3/users/0efd21cc23b545b19424cde3eecddce6 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:31:06.125242 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0aa704-78f9-43bd-abde-e30383542ff3 None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:31:06.125716 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0aa704-78f9-43bd-abde-e30383542ff3 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:31:06.125847 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0aa704-78f9-43bd-abde-e30383542ff3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:31:06.143756 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-eb0aa704-78f9-43bd-abde-e30383542ff3 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:31:06.144964 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-eb0aa704-78f9-43bd-abde-e30383542ff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:31:06.157772 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:31:06.207533 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1298/2598] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:31:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:31:06.217674 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fff47c5-2337-423b-bcba-5da742940f1d admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:31:06.219125 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-4fff47c5-2337-423b-bcba-5da742940f1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:31:06.278651 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fff47c5-2337-423b-bcba-5da742940f1d admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:31:06.282305 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f564b98a-d5b6-4084-bf59-01d3ac32ef3f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5d25bfa8dc042329d57cd55fa7b7b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:31:06.282953 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f564b98a-d5b6-4084-bf59-01d3ac32ef3f service neutron] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:31:06.289083 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f564b98a-d5b6-4084-bf59-01d3ac32ef3f service neutron] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:31:06.289083 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f564b98a-d5b6-4084-bf59-01d3ac32ef3f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:31:06.294333 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f564b98a-d5b6-4084-bf59-01d3ac32ef3f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:31:06.295773 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f564b98a-d5b6-4084-bf59-01d3ac32ef3f service neutron] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:31:06.306077 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1301/2599] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:31:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:31:06.821338 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0aa704-78f9-43bd-abde-e30383542ff3 None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:31:06.824530 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-eb0aa704-78f9-43bd-abde-e30383542ff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:31:06.845272 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0aa704-78f9-43bd-abde-e30383542ff3 None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:31:06.851770 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031d4879-24f2-425d-9237-cbf702ad704a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:31:06.852750 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031d4879-24f2-425d-9237-cbf702ad704a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:31:06.853045 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031d4879-24f2-425d-9237-cbf702ad704a admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:31:06.853312 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031d4879-24f2-425d-9237-cbf702ad704a admin admin] PATH_INFO: `/v3/projects/d4f917d9f7e544c29a39782a0bfbec23` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:31:06.854524 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031d4879-24f2-425d-9237-cbf702ad704a admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4f917d9f7e544c29a39782a0bfbec23)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:31:06.856427 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031d4879-24f2-425d-9237-cbf702ad704a admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:31:06.953682 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-031d4879-24f2-425d-9237-cbf702ad704a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4f917d9f7e544c29a39782a0bfbec23', 'request_id': 'req-031d4879-24f2-425d-9237-cbf702ad704a'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:31:06.960747 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-031d4879-24f2-425d-9237-cbf702ad704a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4f917d9f7e544c29a39782a0bfbec23', 'request_id': 'req-031d4879-24f2-425d-9237-cbf702ad704a'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:31:06.966427 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-031d4879-24f2-425d-9237-cbf702ad704a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4f917d9f7e544c29a39782a0bfbec23', 'request_id': 'req-031d4879-24f2-425d-9237-cbf702ad704a'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:31:07.049746 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-031d4879-24f2-425d-9237-cbf702ad704a admin admin] The token cache is being invalidate because project d4f917d9f7e544c29a39782a0bfbec23 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80873) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 17:31:07.049746 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-031d4879-24f2-425d-9237-cbf702ad704a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:31:07.049746 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-031d4879-24f2-425d-9237-cbf702ad704a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:31:07.050151 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1299/2600] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 16 17:31:06 2022] DELETE /identity/v3/projects/d4f917d9f7e544c29a39782a0bfbec23 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:31:07.054330 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f564b98a-d5b6-4084-bf59-01d3ac32ef3f service neutron] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:31:07.065778 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f564b98a-d5b6-4084-bf59-01d3ac32ef3f service neutron] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:31:07.134426 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63cd1a3-cd66-493a-a8b7-d609f6c6ad75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:31:07.135312 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63cd1a3-cd66-493a-a8b7-d609f6c6ad75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:31:07.135619 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63cd1a3-cd66-493a-a8b7-d609f6c6ad75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:31:07.135885 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63cd1a3-cd66-493a-a8b7-d609f6c6ad75 admin admin] PATH_INFO: `/v3/users/c6a852a3c6924584a99df1c8c0360f1c` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:31:07.137098 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63cd1a3-cd66-493a-a8b7-d609f6c6ad75 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6a852a3c6924584a99df1c8c0360f1c)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:31:07.139237 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63cd1a3-cd66-493a-a8b7-d609f6c6ad75 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:31:07.207227 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b501e9e-1849-484a-bc7e-d4915ccfd025 None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:31:07.212737 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b501e9e-1849-484a-bc7e-d4915ccfd025 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:31:07.212737 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b501e9e-1849-484a-bc7e-d4915ccfd025 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:31:07.227059 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-0b501e9e-1849-484a-bc7e-d4915ccfd025 None None] MFA Rules not processed for user `f7f35c1c15a84a92863d4f3f96d76830`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:31:07.228280 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-0b501e9e-1849-484a-bc7e-d4915ccfd025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:31:07.284829 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1300/2601] 10.222.0.39 () {58 vars in 967 bytes} [Thu Jun 16 17:31:07 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:31:07.327715 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b501e9e-1849-484a-bc7e-d4915ccfd025 None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:31:07.327715 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-0b501e9e-1849-484a-bc7e-d4915ccfd025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:31:07.372784 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:31:07.396799 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b501e9e-1849-484a-bc7e-d4915ccfd025 None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:31:07.402161 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301812ce-91ad-4e72-b75d-af6561abb5ab service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbec2dfe63764ed88a23e172ead0afa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:31:07.402819 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301812ce-91ad-4e72-b75d-af6561abb5ab service swift] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:31:07.403110 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301812ce-91ad-4e72-b75d-af6561abb5ab service swift] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:31:07.403394 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301812ce-91ad-4e72-b75d-af6561abb5ab service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:31:07.414917 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301812ce-91ad-4e72-b75d-af6561abb5ab service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:31:07.419131 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301812ce-91ad-4e72-b75d-af6561abb5ab service swift] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:31:07.422454 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-a63cd1a3-cd66-493a-a8b7-d609f6c6ad75 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6a852a3c6924584a99df1c8c0360f1c'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:31:07.425684 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1301/2602] 10.222.0.39 () {60 vars in 1384 bytes} [Thu Jun 16 17:31:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 16 17:31:07.431453 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-a63cd1a3-cd66-493a-a8b7-d609f6c6ad75 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6a852a3c6924584a99df1c8c0360f1c'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:31:07.510853 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-a63cd1a3-cd66-493a-a8b7-d609f6c6ad75 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6a852a3c6924584a99df1c8c0360f1c'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:31:07.511498 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-a63cd1a3-cd66-493a-a8b7-d609f6c6ad75 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6a852a3c6924584a99df1c8c0360f1c'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:31:07.522547 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=86,keystone:INSERT=2,keystone:DELETE=12 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:31:07.525391 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-a63cd1a3-cd66-493a-a8b7-d609f6c6ad75 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6a852a3c6924584a99df1c8c0360f1c'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:31:07.531233 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1302/2603] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 16 17:31:07 2022] DELETE /identity/v3/users/c6a852a3c6924584a99df1c8c0360f1c => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:31:08.044329 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301812ce-91ad-4e72-b75d-af6561abb5ab service swift] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:31:08.045799 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-301812ce-91ad-4e72-b75d-af6561abb5ab service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:31:08.060835 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301812ce-91ad-4e72-b75d-af6561abb5ab service swift] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:31:08.127368 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d9a074-6730-4089-ada9-aff6c83575bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:31:08.135255 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d9a074-6730-4089-ada9-aff6c83575bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:31:08.135255 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d9a074-6730-4089-ada9-aff6c83575bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:31:08.135255 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d9a074-6730-4089-ada9-aff6c83575bc admin admin] PATH_INFO: `/v3/projects/b302c421377143018370839fd18e9f80` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:31:08.135255 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d9a074-6730-4089-ada9-aff6c83575bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=b302c421377143018370839fd18e9f80)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:31:08.135255 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d9a074-6730-4089-ada9-aff6c83575bc admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:31:08.276605 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-e3d9a074-6730-4089-ada9-aff6c83575bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b302c421377143018370839fd18e9f80', 'request_id': 'req-e3d9a074-6730-4089-ada9-aff6c83575bc'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:31:08.282892 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-e3d9a074-6730-4089-ada9-aff6c83575bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b302c421377143018370839fd18e9f80', 'request_id': 'req-e3d9a074-6730-4089-ada9-aff6c83575bc'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:31:08.288430 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-e3d9a074-6730-4089-ada9-aff6c83575bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b302c421377143018370839fd18e9f80', 'request_id': 'req-e3d9a074-6730-4089-ada9-aff6c83575bc'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:31:08.396593 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-e3d9a074-6730-4089-ada9-aff6c83575bc admin admin] The token cache is being invalidate because project b302c421377143018370839fd18e9f80 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80873) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 17:31:08.396887 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-e3d9a074-6730-4089-ada9-aff6c83575bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:31:08.397618 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-e3d9a074-6730-4089-ada9-aff6c83575bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:31:08.399961 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1302/2604] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 16 17:31:08 2022] DELETE /identity/v3/projects/b302c421377143018370839fd18e9f80 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:31:08.404907 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bed4b4-f730-47a7-9992-f6d1a1f12d16 None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:31:08.411593 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bed4b4-f730-47a7-9992-f6d1a1f12d16 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:31:08.411593 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bed4b4-f730-47a7-9992-f6d1a1f12d16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:31:08.424038 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-53bed4b4-f730-47a7-9992-f6d1a1f12d16 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:31:08.425348 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-53bed4b4-f730-47a7-9992-f6d1a1f12d16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:31:08.496590 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1303/2605] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:31:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:31:08.504490 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef1853c-5aac-40fb-8a2d-3443134ce2c6 None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:31:08.504790 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef1853c-5aac-40fb-8a2d-3443134ce2c6 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:31:08.505082 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef1853c-5aac-40fb-8a2d-3443134ce2c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:31:08.525421 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-fef1853c-5aac-40fb-8a2d-3443134ce2c6 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:31:08.526662 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-fef1853c-5aac-40fb-8a2d-3443134ce2c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:31:08.534671 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1303/2606] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:31:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:31:08.538984 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bed4b4-f730-47a7-9992-f6d1a1f12d16 None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:31:08.549209 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bed4b4-f730-47a7-9992-f6d1a1f12d16 None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:31:08.554270 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3bbf3c-36cf-4435-8ce7-fb58294090a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:31:08.554934 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3bbf3c-36cf-4435-8ce7-fb58294090a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:31:08.555247 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3bbf3c-36cf-4435-8ce7-fb58294090a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:31:08.555526 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3bbf3c-36cf-4435-8ce7-fb58294090a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:31:08.556285 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3bbf3c-36cf-4435-8ce7-fb58294090a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:31:08.556610 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3bbf3c-36cf-4435-8ce7-fb58294090a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:31:08.558228 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3bbf3c-36cf-4435-8ce7-fb58294090a1 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:31:08.570826 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1304/2607] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 16 17:31:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:31:08.575306 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef1853c-5aac-40fb-8a2d-3443134ce2c6 None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:31:08.585800 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef1853c-5aac-40fb-8a2d-3443134ce2c6 None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:31:08.590846 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a19171-8780-4d8f-85c1-bca395cd38c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:31:08.591511 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a19171-8780-4d8f-85c1-bca395cd38c4 admin admin] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:31:08.591796 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a19171-8780-4d8f-85c1-bca395cd38c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:31:08.592075 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a19171-8780-4d8f-85c1-bca395cd38c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:31:08.592770 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a19171-8780-4d8f-85c1-bca395cd38c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:31:08.594696 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a19171-8780-4d8f-85c1-bca395cd38c4 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:31:08.690118 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1304/2608] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 16 17:31:08 2022] POST /identity/v3/projects => generated 369 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 17:31:08.695276 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3bbf3c-36cf-4435-8ce7-fb58294090a1 admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:31:08.706249 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3bbf3c-36cf-4435-8ce7-fb58294090a1 admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:31:08.772802 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd07a5d1-348a-4b58-b8bf-55f697a57aab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:31:08.773634 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd07a5d1-348a-4b58-b8bf-55f697a57aab admin admin] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:31:08.774684 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd07a5d1-348a-4b58-b8bf-55f697a57aab admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:31:08.775099 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd07a5d1-348a-4b58-b8bf-55f697a57aab admin admin] PATH_INFO: `/v3/users` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:31:08.775961 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd07a5d1-348a-4b58-b8bf-55f697a57aab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:31:08.778120 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd07a5d1-348a-4b58-b8bf-55f697a57aab admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:31:08.871089 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1305/2609] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 16 17:31:08 2022] POST /identity/v3/users => generated 285 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:31:08.875128 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a19171-8780-4d8f-85c1-bca395cd38c4 admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:31:08.892000 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a19171-8780-4d8f-85c1-bca395cd38c4 admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:31:08.897035 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ed912f-f5ea-45ed-a75d-890d6a0fef56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:31:08.897741 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ed912f-f5ea-45ed-a75d-890d6a0fef56 admin admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:31:08.898063 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ed912f-f5ea-45ed-a75d-890d6a0fef56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:31:08.898344 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ed912f-f5ea-45ed-a75d-890d6a0fef56 admin admin] PATH_INFO: `/v3/roles` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:31:08.899690 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ed912f-f5ea-45ed-a75d-890d6a0fef56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:31:08.901431 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ed912f-f5ea-45ed-a75d-890d6a0fef56 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:31:08.912584 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1305/2610] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 17:31:08 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:31:08.923664 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd07a5d1-348a-4b58-b8bf-55f697a57aab admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:31:08.935803 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd07a5d1-348a-4b58-b8bf-55f697a57aab admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:31:08.941060 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9592f1bc-541a-4e0d-8a1c-a184ef8486aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:31:08.941487 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9592f1bc-541a-4e0d-8a1c-a184ef8486aa admin admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:31:08.941808 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9592f1bc-541a-4e0d-8a1c-a184ef8486aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:31:08.942103 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9592f1bc-541a-4e0d-8a1c-a184ef8486aa admin admin] PATH_INFO: `/v3/roles` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:31:08.943031 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9592f1bc-541a-4e0d-8a1c-a184ef8486aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:31:08.945553 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9592f1bc-541a-4e0d-8a1c-a184ef8486aa admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:31:08.957833 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1306/2611] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 17:31:08 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:31:08.960941 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ed912f-f5ea-45ed-a75d-890d6a0fef56 admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:31:08.972985 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ed912f-f5ea-45ed-a75d-890d6a0fef56 admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:31:08.977684 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaf23ed-fb99-4f7b-9162-f4d856777520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:31:08.985380 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaf23ed-fb99-4f7b-9162-f4d856777520 admin admin] REQUEST_METHOD: `PUT` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:31:08.985380 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaf23ed-fb99-4f7b-9162-f4d856777520 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:31:08.985380 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaf23ed-fb99-4f7b-9162-f4d856777520 admin admin] PATH_INFO: `/v3/projects/eda07c7af3844322b274b5f2b7509966/users/6b796622a4a14549ac9df17d2c7ebde2/roles/896bff49c5d6464eb612a15f4aa9badc` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:31:08.997012 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aaf23ed-fb99-4f7b-9162-f4d856777520 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eda07c7af3844322b274b5f2b7509966, user_id=6b796622a4a14549ac9df17d2c7ebde2, role_id=896bff49c5d6464eb612a15f4aa9badc)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:31:08.999933 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aaf23ed-fb99-4f7b-9162-f4d856777520 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:31:09.098258 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:31:09.104808 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1306/2612] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 17:31:08 2022] PUT /identity/v3/projects/eda07c7af3844322b274b5f2b7509966/users/6b796622a4a14549ac9df17d2c7ebde2/roles/896bff49c5d6464eb612a15f4aa9badc => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:31:09.116477 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea3352e-f920-46cc-8970-9e08bb1468c1 None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:31:09.123895 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea3352e-f920-46cc-8970-9e08bb1468c1 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:31:09.123895 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea3352e-f920-46cc-8970-9e08bb1468c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:31:09.147694 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-5ea3352e-f920-46cc-8970-9e08bb1468c1 None None] MFA Rules not processed for user `6b796622a4a14549ac9df17d2c7ebde2`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:31:09.150753 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-5ea3352e-f920-46cc-8970-9e08bb1468c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:31:09.207139 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:31:09.230259 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1307/2613] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:31:09 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 17:31:09.234549 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaf23ed-fb99-4f7b-9162-f4d856777520 admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:31:09.313532 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaf23ed-fb99-4f7b-9162-f4d856777520 admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:31:09.318782 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424fcd66-f5de-4c75-87d4-ff4c295c34b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:31:09.321670 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424fcd66-f5de-4c75-87d4-ff4c295c34b5 admin admin] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:31:09.321670 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424fcd66-f5de-4c75-87d4-ff4c295c34b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:31:09.321670 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424fcd66-f5de-4c75-87d4-ff4c295c34b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:31:09.321670 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424fcd66-f5de-4c75-87d4-ff4c295c34b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:31:09.323470 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424fcd66-f5de-4c75-87d4-ff4c295c34b5 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:31:09.444345 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1307/2614] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 16 17:31:09 2022] POST /identity/v3/projects => generated 367 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:31:09.449271 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea3352e-f920-46cc-8970-9e08bb1468c1 None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:31:09.460690 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea3352e-f920-46cc-8970-9e08bb1468c1 None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:31:09.551379 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1424c309-b6e5-48bf-83b7-52f7f4e62cdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:31:09.552098 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1424c309-b6e5-48bf-83b7-52f7f4e62cdc admin admin] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:31:09.552390 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1424c309-b6e5-48bf-83b7-52f7f4e62cdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:31:09.552673 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1424c309-b6e5-48bf-83b7-52f7f4e62cdc admin admin] PATH_INFO: `/v3/users` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:31:09.553524 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1424c309-b6e5-48bf-83b7-52f7f4e62cdc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:31:09.556075 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1424c309-b6e5-48bf-83b7-52f7f4e62cdc admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:31:09.722635 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1308/2615] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 16 17:31:09 2022] POST /identity/v3/users => generated 290 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:31:09.726606 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424fcd66-f5de-4c75-87d4-ff4c295c34b5 admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:31:09.737256 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424fcd66-f5de-4c75-87d4-ff4c295c34b5 admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:31:09.742107 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76c367f-2df6-476e-af93-c709db8e1076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:31:09.742833 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76c367f-2df6-476e-af93-c709db8e1076 admin admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:31:09.743211 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76c367f-2df6-476e-af93-c709db8e1076 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:31:09.743499 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76c367f-2df6-476e-af93-c709db8e1076 admin admin] PATH_INFO: `/v3/roles` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:31:09.744373 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76c367f-2df6-476e-af93-c709db8e1076 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:31:09.746092 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76c367f-2df6-476e-af93-c709db8e1076 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:31:09.764532 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1308/2616] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 17:31:09 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 17:31:09.769554 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1424c309-b6e5-48bf-83b7-52f7f4e62cdc admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:31:09.787010 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1424c309-b6e5-48bf-83b7-52f7f4e62cdc admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:31:09.791915 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42aa771f-de6c-44a0-b28c-e5a7367c23fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:31:09.792828 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42aa771f-de6c-44a0-b28c-e5a7367c23fb admin admin] REQUEST_METHOD: `PUT` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:31:09.793112 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42aa771f-de6c-44a0-b28c-e5a7367c23fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:31:09.793397 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42aa771f-de6c-44a0-b28c-e5a7367c23fb admin admin] PATH_INFO: `/v3/projects/25bcbda369cb48d5bce2e4336daf8b1c/users/10d238a6db854d519861ee2415b15091/roles/dba744f8ab2a4c45b9d3212f8d203aba` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:31:09.813258 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42aa771f-de6c-44a0-b28c-e5a7367c23fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=25bcbda369cb48d5bce2e4336daf8b1c, user_id=10d238a6db854d519861ee2415b15091, role_id=dba744f8ab2a4c45b9d3212f8d203aba)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:31:09.816100 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42aa771f-de6c-44a0-b28c-e5a7367c23fb admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:31:09.957026 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1309/2617] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 17:31:09 2022] PUT /identity/v3/projects/25bcbda369cb48d5bce2e4336daf8b1c/users/10d238a6db854d519861ee2415b15091/roles/dba744f8ab2a4c45b9d3212f8d203aba => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:31:09.961249 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76c367f-2df6-476e-af93-c709db8e1076 admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:31:09.975357 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76c367f-2df6-476e-af93-c709db8e1076 admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:31:10.035436 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd083057-d805-4d31-9862-03a0bd9120d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:31:10.036084 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd083057-d805-4d31-9862-03a0bd9120d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:31:10.036398 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd083057-d805-4d31-9862-03a0bd9120d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:31:10.036700 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd083057-d805-4d31-9862-03a0bd9120d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:31:10.037463 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd083057-d805-4d31-9862-03a0bd9120d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:31:10.039814 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd083057-d805-4d31-9862-03a0bd9120d7 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:31:10.055721 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1309/2618] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 17:31:09 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:31:10.057462 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42aa771f-de6c-44a0-b28c-e5a7367c23fb admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:31:10.068603 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42aa771f-de6c-44a0-b28c-e5a7367c23fb admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:31:10.074496 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b85bb1f-bce7-4ac9-a774-e48d5475e41b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:31:10.075382 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b85bb1f-bce7-4ac9-a774-e48d5475e41b admin admin] REQUEST_METHOD: `PUT` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:31:10.075668 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b85bb1f-bce7-4ac9-a774-e48d5475e41b admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:31:10.075973 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b85bb1f-bce7-4ac9-a774-e48d5475e41b admin admin] PATH_INFO: `/v3/projects/25bcbda369cb48d5bce2e4336daf8b1c/users/10d238a6db854d519861ee2415b15091/roles/dba744f8ab2a4c45b9d3212f8d203aba` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:31:10.077998 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b85bb1f-bce7-4ac9-a774-e48d5475e41b admin admin] RBAC: Authorizing `identity:create_grant(project_id=25bcbda369cb48d5bce2e4336daf8b1c, user_id=10d238a6db854d519861ee2415b15091, role_id=dba744f8ab2a4c45b9d3212f8d203aba)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:31:10.080844 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b85bb1f-bce7-4ac9-a774-e48d5475e41b admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:31:10.091504 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1310/2619] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 17:31:10 2022] PUT /identity/v3/projects/25bcbda369cb48d5bce2e4336daf8b1c/users/10d238a6db854d519861ee2415b15091/roles/dba744f8ab2a4c45b9d3212f8d203aba => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 17:31:10.101700 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34846b86-8020-4289-9264-c2c74b793b33 None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:31:10.102093 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34846b86-8020-4289-9264-c2c74b793b33 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:31:10.102385 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34846b86-8020-4289-9264-c2c74b793b33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:31:10.129603 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-34846b86-8020-4289-9264-c2c74b793b33 None None] MFA Rules not processed for user `10d238a6db854d519861ee2415b15091`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:31:10.130850 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-34846b86-8020-4289-9264-c2c74b793b33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:31:10.192091 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:31:10.202030 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1310/2620] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:31:10 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:31:10.213067 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b85bb1f-bce7-4ac9-a774-e48d5475e41b admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:31:10.214940 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-3b85bb1f-bce7-4ac9-a774-e48d5475e41b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:31:10.272925 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b85bb1f-bce7-4ac9-a774-e48d5475e41b admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:31:10.276602 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea40839-4004-4a6e-8f11-d30c79736ac8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef37136b89d34edc9cd94c7aa81b2095', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:31:10.277255 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea40839-4004-4a6e-8f11-d30c79736ac8 service cinder] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:31:10.277538 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea40839-4004-4a6e-8f11-d30c79736ac8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:31:10.277843 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea40839-4004-4a6e-8f11-d30c79736ac8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:31:10.294276 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea40839-4004-4a6e-8f11-d30c79736ac8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:31:10.296070 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea40839-4004-4a6e-8f11-d30c79736ac8 service cinder] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:31:10.309280 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1311/2621] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:31:10 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:31:10.447919 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34846b86-8020-4289-9264-c2c74b793b33 None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:31:10.449673 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-34846b86-8020-4289-9264-c2c74b793b33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:31:10.462993 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34846b86-8020-4289-9264-c2c74b793b33 None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:31:10.467284 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6f179c-4580-489e-a573-e244d7ea5953 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef37136b89d34edc9cd94c7aa81b2095', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:31:10.467951 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6f179c-4580-489e-a573-e244d7ea5953 service cinder] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:31:10.468236 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6f179c-4580-489e-a573-e244d7ea5953 service cinder] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:31:10.468521 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6f179c-4580-489e-a573-e244d7ea5953 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:31:10.535397 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6f179c-4580-489e-a573-e244d7ea5953 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:31:10.536878 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6f179c-4580-489e-a573-e244d7ea5953 service cinder] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:31:10.547011 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1311/2622] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:31:10 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:31:15.515682 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea40839-4004-4a6e-8f11-d30c79736ac8 service cinder] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:31:15.598848 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:31:15.621641 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea40839-4004-4a6e-8f11-d30c79736ac8 service cinder] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:31:15.626791 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3369f741-df28-4108-8ce2-2ea379e2bb50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:31:15.627874 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3369f741-df28-4108-8ce2-2ea379e2bb50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:31:15.628317 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3369f741-df28-4108-8ce2-2ea379e2bb50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:31:15.628912 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3369f741-df28-4108-8ce2-2ea379e2bb50 admin admin] PATH_INFO: `/v3/users/6b796622a4a14549ac9df17d2c7ebde2` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:31:15.630545 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3369f741-df28-4108-8ce2-2ea379e2bb50 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b796622a4a14549ac9df17d2c7ebde2)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:31:15.632760 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3369f741-df28-4108-8ce2-2ea379e2bb50 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:31:15.917059 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-3369f741-df28-4108-8ce2-2ea379e2bb50 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b796622a4a14549ac9df17d2c7ebde2'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:31:15.934908 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-3369f741-df28-4108-8ce2-2ea379e2bb50 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b796622a4a14549ac9df17d2c7ebde2'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:31:16.070593 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-3369f741-df28-4108-8ce2-2ea379e2bb50 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b796622a4a14549ac9df17d2c7ebde2'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:31:16.071237 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-3369f741-df28-4108-8ce2-2ea379e2bb50 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b796622a4a14549ac9df17d2c7ebde2'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:31:16.092545 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-3369f741-df28-4108-8ce2-2ea379e2bb50 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b796622a4a14549ac9df17d2c7ebde2'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:31:16.100571 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1312/2623] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 16 17:31:15 2022] DELETE /identity/v3/users/6b796622a4a14549ac9df17d2c7ebde2 => generated 0 bytes in 585 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:31:16.106396 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c785f047-4d52-4053-a1f0-81ded652d4c5 None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:31:16.106926 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c785f047-4d52-4053-a1f0-81ded652d4c5 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:31:16.107155 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c785f047-4d52-4053-a1f0-81ded652d4c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:31:16.132045 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-c785f047-4d52-4053-a1f0-81ded652d4c5 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:31:16.133608 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-c785f047-4d52-4053-a1f0-81ded652d4c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:31:16.213148 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1312/2624] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:31:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:31:16.220602 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3369f741-df28-4108-8ce2-2ea379e2bb50 admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:31:16.222327 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-3369f741-df28-4108-8ce2-2ea379e2bb50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:31:16.290984 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3369f741-df28-4108-8ce2-2ea379e2bb50 admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:31:16.295029 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d021390d-aa5e-4953-b11e-2ef2384c61f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5d25bfa8dc042329d57cd55fa7b7b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:31:16.295876 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d021390d-aa5e-4953-b11e-2ef2384c61f3 service neutron] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:31:16.296329 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d021390d-aa5e-4953-b11e-2ef2384c61f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:31:16.297477 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d021390d-aa5e-4953-b11e-2ef2384c61f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:31:16.307877 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d021390d-aa5e-4953-b11e-2ef2384c61f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:31:16.309279 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d021390d-aa5e-4953-b11e-2ef2384c61f3 service neutron] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:31:16.322407 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1313/2625] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:31:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:31:16.454657 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c785f047-4d52-4053-a1f0-81ded652d4c5 None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:31:16.456149 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-c785f047-4d52-4053-a1f0-81ded652d4c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:31:16.478773 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c785f047-4d52-4053-a1f0-81ded652d4c5 None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:31:16.478773 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d69520-8b68-4264-8e9b-310dde928aca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:31:16.478773 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d69520-8b68-4264-8e9b-310dde928aca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:31:16.478773 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d69520-8b68-4264-8e9b-310dde928aca admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:31:16.479157 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d69520-8b68-4264-8e9b-310dde928aca admin admin] PATH_INFO: `/v3/users/17fe859be6a44cbeb39dd9b62b99ecb2` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:31:16.479157 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d69520-8b68-4264-8e9b-310dde928aca admin admin] RBAC: Authorizing `identity:delete_user(user_id=17fe859be6a44cbeb39dd9b62b99ecb2)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:31:16.479386 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d69520-8b68-4264-8e9b-310dde928aca admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:31:16.663382 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-b8d69520-8b68-4264-8e9b-310dde928aca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17fe859be6a44cbeb39dd9b62b99ecb2'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:31:16.664166 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-b8d69520-8b68-4264-8e9b-310dde928aca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17fe859be6a44cbeb39dd9b62b99ecb2'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:31:16.664847 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-b8d69520-8b68-4264-8e9b-310dde928aca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17fe859be6a44cbeb39dd9b62b99ecb2'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:31:16.756633 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-b8d69520-8b68-4264-8e9b-310dde928aca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17fe859be6a44cbeb39dd9b62b99ecb2'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:31:16.764258 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d021390d-aa5e-4953-b11e-2ef2384c61f3 service neutron] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:31:16.766371 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-d021390d-aa5e-4953-b11e-2ef2384c61f3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:31:16.767808 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-b8d69520-8b68-4264-8e9b-310dde928aca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17fe859be6a44cbeb39dd9b62b99ecb2'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:31:16.783025 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d021390d-aa5e-4953-b11e-2ef2384c61f3 service neutron] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:31:16.789323 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8c0855-2187-4ff6-af50-26a3ca050d20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:31:16.794108 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8c0855-2187-4ff6-af50-26a3ca050d20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:31:16.794108 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8c0855-2187-4ff6-af50-26a3ca050d20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:31:16.794108 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8c0855-2187-4ff6-af50-26a3ca050d20 admin admin] PATH_INFO: `/v3/projects/eda07c7af3844322b274b5f2b7509966` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:31:16.794108 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8c0855-2187-4ff6-af50-26a3ca050d20 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eda07c7af3844322b274b5f2b7509966)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:31:16.795078 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8c0855-2187-4ff6-af50-26a3ca050d20 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:31:16.796762 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1313/2626] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 16 17:31:16 2022] DELETE /identity/v3/users/17fe859be6a44cbeb39dd9b62b99ecb2 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:31:16.924182 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-2d8c0855-2187-4ff6-af50-26a3ca050d20 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eda07c7af3844322b274b5f2b7509966', 'request_id': 'req-2d8c0855-2187-4ff6-af50-26a3ca050d20'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:31:16.930234 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-2d8c0855-2187-4ff6-af50-26a3ca050d20 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eda07c7af3844322b274b5f2b7509966', 'request_id': 'req-2d8c0855-2187-4ff6-af50-26a3ca050d20'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:31:16.933406 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:31:17.082329 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-2d8c0855-2187-4ff6-af50-26a3ca050d20 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eda07c7af3844322b274b5f2b7509966', 'request_id': 'req-2d8c0855-2187-4ff6-af50-26a3ca050d20'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:31:17.103055 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d69520-8b68-4264-8e9b-310dde928aca admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:31:17.110451 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-b8d69520-8b68-4264-8e9b-310dde928aca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:31:17.112582 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-2d8c0855-2187-4ff6-af50-26a3ca050d20 admin admin] The token cache is being invalidate because project eda07c7af3844322b274b5f2b7509966 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80874) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 17:31:17.112888 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-2d8c0855-2187-4ff6-af50-26a3ca050d20 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:31:17.114989 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-2d8c0855-2187-4ff6-af50-26a3ca050d20 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:31:17.116632 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1314/2627] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 16 17:31:16 2022] DELETE /identity/v3/projects/eda07c7af3844322b274b5f2b7509966 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:31:17.119564 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:31:17.125840 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8c0855-2187-4ff6-af50-26a3ca050d20 admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:31:17.127495 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-2d8c0855-2187-4ff6-af50-26a3ca050d20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:31:17.182903 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d69520-8b68-4264-8e9b-310dde928aca admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:31:17.187691 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fae073-f7eb-4e35-93cc-57ed3f53be8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:31:17.188551 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fae073-f7eb-4e35-93cc-57ed3f53be8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:31:17.188842 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fae073-f7eb-4e35-93cc-57ed3f53be8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:31:17.189159 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fae073-f7eb-4e35-93cc-57ed3f53be8c admin admin] PATH_INFO: `/v3/projects/aee2f1938cb24dd39baa7814531854a1` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:31:17.190472 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fae073-f7eb-4e35-93cc-57ed3f53be8c admin admin] RBAC: Authorizing `identity:delete_project(project_id=aee2f1938cb24dd39baa7814531854a1)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:31:17.192426 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fae073-f7eb-4e35-93cc-57ed3f53be8c admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:31:17.192940 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8c0855-2187-4ff6-af50-26a3ca050d20 admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:31:17.198917 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e55eca3-d875-45d1-a146-f9762c0f78a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:31:17.199791 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e55eca3-d875-45d1-a146-f9762c0f78a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:31:17.200073 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e55eca3-d875-45d1-a146-f9762c0f78a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:31:17.200384 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e55eca3-d875-45d1-a146-f9762c0f78a8 admin admin] PATH_INFO: `/v3/users/10d238a6db854d519861ee2415b15091` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:31:17.201554 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e55eca3-d875-45d1-a146-f9762c0f78a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=10d238a6db854d519861ee2415b15091)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:31:17.203517 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e55eca3-d875-45d1-a146-f9762c0f78a8 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:31:17.376047 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-29fae073-f7eb-4e35-93cc-57ed3f53be8c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aee2f1938cb24dd39baa7814531854a1', 'request_id': 'req-29fae073-f7eb-4e35-93cc-57ed3f53be8c'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:31:17.380867 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-4e55eca3-d875-45d1-a146-f9762c0f78a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10d238a6db854d519861ee2415b15091'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:31:17.382288 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-29fae073-f7eb-4e35-93cc-57ed3f53be8c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aee2f1938cb24dd39baa7814531854a1', 'request_id': 'req-29fae073-f7eb-4e35-93cc-57ed3f53be8c'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:31:17.385945 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-4e55eca3-d875-45d1-a146-f9762c0f78a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10d238a6db854d519861ee2415b15091'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:31:17.388496 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-29fae073-f7eb-4e35-93cc-57ed3f53be8c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aee2f1938cb24dd39baa7814531854a1', 'request_id': 'req-29fae073-f7eb-4e35-93cc-57ed3f53be8c'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:31:17.475976 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-4e55eca3-d875-45d1-a146-f9762c0f78a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10d238a6db854d519861ee2415b15091'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:31:17.476658 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-4e55eca3-d875-45d1-a146-f9762c0f78a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10d238a6db854d519861ee2415b15091'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:31:17.489460 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-4e55eca3-d875-45d1-a146-f9762c0f78a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10d238a6db854d519861ee2415b15091'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:31:17.496041 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1315/2628] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 16 17:31:17 2022] DELETE /identity/v3/users/10d238a6db854d519861ee2415b15091 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:31:17.539270 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-29fae073-f7eb-4e35-93cc-57ed3f53be8c admin admin] The token cache is being invalidate because project aee2f1938cb24dd39baa7814531854a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80873) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 17:31:17.539771 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-29fae073-f7eb-4e35-93cc-57ed3f53be8c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:31:17.540480 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-29fae073-f7eb-4e35-93cc-57ed3f53be8c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:31:17.542121 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1314/2629] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 16 17:31:17 2022] DELETE /identity/v3/projects/aee2f1938cb24dd39baa7814531854a1 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 17:31:17.546279 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e55eca3-d875-45d1-a146-f9762c0f78a8 admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:31:17.547789 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-4e55eca3-d875-45d1-a146-f9762c0f78a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:31:17.618642 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e55eca3-d875-45d1-a146-f9762c0f78a8 admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:31:17.624072 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9873b9a1-2b24-41cd-be5c-09b88459d424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:31:17.624952 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9873b9a1-2b24-41cd-be5c-09b88459d424 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:31:17.625235 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9873b9a1-2b24-41cd-be5c-09b88459d424 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:31:17.625513 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9873b9a1-2b24-41cd-be5c-09b88459d424 admin admin] PATH_INFO: `/v3/users/8b8f58cfa65d4e6b83bc2a3c5199f2a9` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:31:17.626813 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9873b9a1-2b24-41cd-be5c-09b88459d424 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b8f58cfa65d4e6b83bc2a3c5199f2a9)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:31:17.628836 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9873b9a1-2b24-41cd-be5c-09b88459d424 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:31:17.799891 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-9873b9a1-2b24-41cd-be5c-09b88459d424 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b8f58cfa65d4e6b83bc2a3c5199f2a9'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:31:17.806998 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-9873b9a1-2b24-41cd-be5c-09b88459d424 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b8f58cfa65d4e6b83bc2a3c5199f2a9'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:31:17.842339 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:31:17.871483 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-9873b9a1-2b24-41cd-be5c-09b88459d424 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b8f58cfa65d4e6b83bc2a3c5199f2a9'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:31:17.872230 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-9873b9a1-2b24-41cd-be5c-09b88459d424 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b8f58cfa65d4e6b83bc2a3c5199f2a9'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:31:17.878535 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fae073-f7eb-4e35-93cc-57ed3f53be8c admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:31:17.880117 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-29fae073-f7eb-4e35-93cc-57ed3f53be8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:31:17.893194 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-9873b9a1-2b24-41cd-be5c-09b88459d424 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b8f58cfa65d4e6b83bc2a3c5199f2a9'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:31:17.900050 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1316/2630] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 16 17:31:17 2022] DELETE /identity/v3/users/8b8f58cfa65d4e6b83bc2a3c5199f2a9 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:31:17.973315 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fae073-f7eb-4e35-93cc-57ed3f53be8c admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:31:18.018958 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:31:18.036349 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222dcdd1-65a1-41ba-84b8-c3cb353d81da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:31:18.037253 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222dcdd1-65a1-41ba-84b8-c3cb353d81da admin admin] REQUEST_METHOD: `DELETE` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:31:18.037543 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222dcdd1-65a1-41ba-84b8-c3cb353d81da admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:31:18.037862 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222dcdd1-65a1-41ba-84b8-c3cb353d81da admin admin] PATH_INFO: `/v3/projects/25bcbda369cb48d5bce2e4336daf8b1c` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:31:18.039168 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222dcdd1-65a1-41ba-84b8-c3cb353d81da admin admin] RBAC: Authorizing `identity:delete_project(project_id=25bcbda369cb48d5bce2e4336daf8b1c)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:31:18.041180 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222dcdd1-65a1-41ba-84b8-c3cb353d81da admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:31:18.198162 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-222dcdd1-65a1-41ba-84b8-c3cb353d81da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25bcbda369cb48d5bce2e4336daf8b1c', 'request_id': 'req-222dcdd1-65a1-41ba-84b8-c3cb353d81da'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:31:18.204749 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-222dcdd1-65a1-41ba-84b8-c3cb353d81da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25bcbda369cb48d5bce2e4336daf8b1c', 'request_id': 'req-222dcdd1-65a1-41ba-84b8-c3cb353d81da'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:31:18.210440 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-222dcdd1-65a1-41ba-84b8-c3cb353d81da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25bcbda369cb48d5bce2e4336daf8b1c', 'request_id': 'req-222dcdd1-65a1-41ba-84b8-c3cb353d81da'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:31:18.299811 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-222dcdd1-65a1-41ba-84b8-c3cb353d81da admin admin] The token cache is being invalidate because project 25bcbda369cb48d5bce2e4336daf8b1c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80873) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 17:31:18.300211 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-222dcdd1-65a1-41ba-84b8-c3cb353d81da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:31:18.301140 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-222dcdd1-65a1-41ba-84b8-c3cb353d81da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:31:18.307183 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1315/2631] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 16 17:31:17 2022] DELETE /identity/v3/projects/25bcbda369cb48d5bce2e4336daf8b1c => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 17:31:18.308316 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4865af4-367c-4746-bcc3-7758a5656dba None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:31:18.308614 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4865af4-367c-4746-bcc3-7758a5656dba None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:31:18.308900 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4865af4-367c-4746-bcc3-7758a5656dba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:31:18.329028 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-c4865af4-367c-4746-bcc3-7758a5656dba None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:31:18.330303 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-c4865af4-367c-4746-bcc3-7758a5656dba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:31:18.406852 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1317/2632] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:31:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 17:31:18.414855 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3906476e-be92-4675-b35a-7b88d9241a54 None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:31:18.415152 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3906476e-be92-4675-b35a-7b88d9241a54 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:31:18.415442 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3906476e-be92-4675-b35a-7b88d9241a54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:31:18.435172 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-3906476e-be92-4675-b35a-7b88d9241a54 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:31:18.436399 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-3906476e-be92-4675-b35a-7b88d9241a54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:31:18.444831 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1316/2633] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:31:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:31:18.449176 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4865af4-367c-4746-bcc3-7758a5656dba None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:31:18.459244 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4865af4-367c-4746-bcc3-7758a5656dba None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:31:18.463942 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9acfdc9-e98a-4c84-acf9-e0740691f6a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:31:18.469083 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9acfdc9-e98a-4c84-acf9-e0740691f6a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:31:18.469083 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9acfdc9-e98a-4c84-acf9-e0740691f6a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:31:18.469083 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9acfdc9-e98a-4c84-acf9-e0740691f6a5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:31:18.469083 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9acfdc9-e98a-4c84-acf9-e0740691f6a5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:31:18.469083 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9acfdc9-e98a-4c84-acf9-e0740691f6a5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:31:18.469083 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9acfdc9-e98a-4c84-acf9-e0740691f6a5 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:31:18.480170 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1318/2634] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 16 17:31:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:31:18.484324 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3906476e-be92-4675-b35a-7b88d9241a54 None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:31:18.494142 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3906476e-be92-4675-b35a-7b88d9241a54 None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:31:18.499744 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18f3a52-f3cd-4472-8840-84adb0e11596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:31:18.500396 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18f3a52-f3cd-4472-8840-84adb0e11596 admin admin] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:31:18.500687 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18f3a52-f3cd-4472-8840-84adb0e11596 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:31:18.500973 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18f3a52-f3cd-4472-8840-84adb0e11596 admin admin] PATH_INFO: `/v3/projects` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:31:18.501688 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18f3a52-f3cd-4472-8840-84adb0e11596 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:31:18.503683 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18f3a52-f3cd-4472-8840-84adb0e11596 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:31:18.523544 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9acfdc9-e98a-4c84-acf9-e0740691f6a5 admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:31:18.525673 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-b9acfdc9-e98a-4c84-acf9-e0740691f6a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:31:18.538994 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9acfdc9-e98a-4c84-acf9-e0740691f6a5 admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:31:18.544561 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec23e33c-20a3-41dd-a7a8-b372ea024d87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:31:18.545476 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec23e33c-20a3-41dd-a7a8-b372ea024d87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:31:18.545913 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec23e33c-20a3-41dd-a7a8-b372ea024d87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:31:18.546180 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec23e33c-20a3-41dd-a7a8-b372ea024d87 admin admin] PATH_INFO: `/v3/projects/4565755e122841f6b92899133e0dc8cb` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:31:18.550752 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec23e33c-20a3-41dd-a7a8-b372ea024d87 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4565755e122841f6b92899133e0dc8cb)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:31:18.550752 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec23e33c-20a3-41dd-a7a8-b372ea024d87 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:31:18.586594 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1317/2635] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 16 17:31:18 2022] POST /identity/v3/projects => generated 391 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:31:18.590619 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18f3a52-f3cd-4472-8840-84adb0e11596 admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:31:18.639273 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-ec23e33c-20a3-41dd-a7a8-b372ea024d87 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4565755e122841f6b92899133e0dc8cb', 'request_id': 'req-ec23e33c-20a3-41dd-a7a8-b372ea024d87'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:31:18.646201 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-ec23e33c-20a3-41dd-a7a8-b372ea024d87 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4565755e122841f6b92899133e0dc8cb', 'request_id': 'req-ec23e33c-20a3-41dd-a7a8-b372ea024d87'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:31:18.653801 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18f3a52-f3cd-4472-8840-84adb0e11596 admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:31:18.704566 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-ec23e33c-20a3-41dd-a7a8-b372ea024d87 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4565755e122841f6b92899133e0dc8cb', 'request_id': 'req-ec23e33c-20a3-41dd-a7a8-b372ea024d87'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:31:18.704995 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:31:18.712645 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:31:18.715051 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2267a29-e657-4eb8-9b50-1d0b9ac263cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:31:18.715755 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2267a29-e657-4eb8-9b50-1d0b9ac263cc admin admin] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:31:18.716038 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2267a29-e657-4eb8-9b50-1d0b9ac263cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:31:18.717252 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2267a29-e657-4eb8-9b50-1d0b9ac263cc admin admin] PATH_INFO: `/v3/users` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:31:18.717252 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2267a29-e657-4eb8-9b50-1d0b9ac263cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:31:18.717648 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-ec23e33c-20a3-41dd-a7a8-b372ea024d87 admin admin] The token cache is being invalidate because project 4565755e122841f6b92899133e0dc8cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80874) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 17:31:18.717971 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-ec23e33c-20a3-41dd-a7a8-b372ea024d87 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:31:18.718629 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-ec23e33c-20a3-41dd-a7a8-b372ea024d87 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:31:18.718987 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2267a29-e657-4eb8-9b50-1d0b9ac263cc admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:31:18.720229 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1319/2636] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 16 17:31:18 2022] DELETE /identity/v3/projects/4565755e122841f6b92899133e0dc8cb => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 17:31:18.785901 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1318/2637] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 16 17:31:18 2022] POST /identity/v3/users => generated 296 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 17:31:18.790629 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec23e33c-20a3-41dd-a7a8-b372ea024d87 admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:31:18.793420 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-ec23e33c-20a3-41dd-a7a8-b372ea024d87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:31:18.820930 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec23e33c-20a3-41dd-a7a8-b372ea024d87 admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:31:18.826461 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b93056-150b-4d28-940f-ffd58a742f97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:31:18.827303 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b93056-150b-4d28-940f-ffd58a742f97 admin admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:31:18.827603 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b93056-150b-4d28-940f-ffd58a742f97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:31:18.827911 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b93056-150b-4d28-940f-ffd58a742f97 admin admin] PATH_INFO: `/v3/roles` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:31:18.828679 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b93056-150b-4d28-940f-ffd58a742f97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:31:18.830556 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b93056-150b-4d28-940f-ffd58a742f97 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:31:18.842085 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1320/2638] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 17:31:18 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 17:31:18.846371 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2267a29-e657-4eb8-9b50-1d0b9ac263cc admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:31:18.858446 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2267a29-e657-4eb8-9b50-1d0b9ac263cc admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:31:18.863384 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce85bce-9e95-4b0f-8d21-3bc012322e62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:31:18.864091 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce85bce-9e95-4b0f-8d21-3bc012322e62 admin admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:31:18.864383 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce85bce-9e95-4b0f-8d21-3bc012322e62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:31:18.864669 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce85bce-9e95-4b0f-8d21-3bc012322e62 admin admin] PATH_INFO: `/v3/roles` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:31:18.865416 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce85bce-9e95-4b0f-8d21-3bc012322e62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:31:18.867218 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce85bce-9e95-4b0f-8d21-3bc012322e62 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:31:18.879115 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1319/2639] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 17:31:18 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:31:18.886790 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b93056-150b-4d28-940f-ffd58a742f97 admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:31:18.900264 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b93056-150b-4d28-940f-ffd58a742f97 admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:31:18.906318 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed26298-970b-41d8-ba79-3485034124a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:31:18.907244 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed26298-970b-41d8-ba79-3485034124a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:31:18.907537 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed26298-970b-41d8-ba79-3485034124a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:31:18.907823 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed26298-970b-41d8-ba79-3485034124a9 admin admin] PATH_INFO: `/v3/projects/572994d4699d4499a8bde435e3abbf82/users/76f0e8f673bd411e8128ab0cd72db769/roles/896bff49c5d6464eb612a15f4aa9badc` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:31:18.925986 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed26298-970b-41d8-ba79-3485034124a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=572994d4699d4499a8bde435e3abbf82, user_id=76f0e8f673bd411e8128ab0cd72db769, role_id=896bff49c5d6464eb612a15f4aa9badc)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:31:18.928714 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed26298-970b-41d8-ba79-3485034124a9 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:31:19.043143 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1321/2640] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 17:31:18 2022] PUT /identity/v3/projects/572994d4699d4499a8bde435e3abbf82/users/76f0e8f673bd411e8128ab0cd72db769/roles/896bff49c5d6464eb612a15f4aa9badc => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:31:19.054294 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4195e849-f586-4503-9468-3b18834866c1 None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:31:19.054588 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4195e849-f586-4503-9468-3b18834866c1 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:31:19.054874 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4195e849-f586-4503-9468-3b18834866c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:31:19.081562 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-4195e849-f586-4503-9468-3b18834866c1 None None] MFA Rules not processed for user `76f0e8f673bd411e8128ab0cd72db769`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:31:19.082805 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-4195e849-f586-4503-9468-3b18834866c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:31:19.144629 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1320/2641] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:31:19 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:31:19.149187 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed26298-970b-41d8-ba79-3485034124a9 admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:31:19.210640 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed26298-970b-41d8-ba79-3485034124a9 admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:31:19.216482 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bf7dc1-1343-47ec-9f88-0977666d85ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:31:19.217125 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bf7dc1-1343-47ec-9f88-0977666d85ba admin admin] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:31:19.217414 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bf7dc1-1343-47ec-9f88-0977666d85ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:31:19.217697 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bf7dc1-1343-47ec-9f88-0977666d85ba admin admin] PATH_INFO: `/v3/projects` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:31:19.218430 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bf7dc1-1343-47ec-9f88-0977666d85ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:31:19.220326 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bf7dc1-1343-47ec-9f88-0977666d85ba admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:31:19.317136 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1322/2642] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 16 17:31:19 2022] POST /identity/v3/projects => generated 393 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:31:19.321389 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4195e849-f586-4503-9468-3b18834866c1 None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:31:19.333794 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4195e849-f586-4503-9468-3b18834866c1 None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:31:19.392289 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd734479-5955-4495-a743-de69b730d931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:31:19.392954 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd734479-5955-4495-a743-de69b730d931 admin admin] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:31:19.393349 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd734479-5955-4495-a743-de69b730d931 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:31:19.393510 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd734479-5955-4495-a743-de69b730d931 admin admin] PATH_INFO: `/v3/users` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:31:19.394256 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd734479-5955-4495-a743-de69b730d931 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:31:19.396495 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd734479-5955-4495-a743-de69b730d931 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:31:19.489733 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1321/2643] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 16 17:31:19 2022] POST /identity/v3/users => generated 303 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:31:19.493066 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bf7dc1-1343-47ec-9f88-0977666d85ba admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:31:19.504942 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bf7dc1-1343-47ec-9f88-0977666d85ba admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:31:19.510668 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fbccbe-f01a-44cf-8829-c15559baaef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:31:19.511383 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fbccbe-f01a-44cf-8829-c15559baaef8 admin admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:31:19.511677 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fbccbe-f01a-44cf-8829-c15559baaef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:31:19.511956 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fbccbe-f01a-44cf-8829-c15559baaef8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:31:19.512696 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fbccbe-f01a-44cf-8829-c15559baaef8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:31:19.514337 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fbccbe-f01a-44cf-8829-c15559baaef8 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:31:19.526803 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1323/2644] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 17:31:19 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:31:19.531147 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd734479-5955-4495-a743-de69b730d931 admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:31:19.541587 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd734479-5955-4495-a743-de69b730d931 admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:31:19.546697 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d4f5bf-f56e-416a-936d-9d104f78d9b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:31:19.547593 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d4f5bf-f56e-416a-936d-9d104f78d9b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:31:19.547886 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d4f5bf-f56e-416a-936d-9d104f78d9b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:31:19.548171 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d4f5bf-f56e-416a-936d-9d104f78d9b5 admin admin] PATH_INFO: `/v3/projects/9ad2da65774949fbbc5c91f94d9da8e4/users/9962501dc96d4c1098cbe3818ffbcdfb/roles/dba744f8ab2a4c45b9d3212f8d203aba` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:31:19.573815 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d4f5bf-f56e-416a-936d-9d104f78d9b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ad2da65774949fbbc5c91f94d9da8e4, user_id=9962501dc96d4c1098cbe3818ffbcdfb, role_id=dba744f8ab2a4c45b9d3212f8d203aba)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:31:19.576247 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d4f5bf-f56e-416a-936d-9d104f78d9b5 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:31:19.653970 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1322/2645] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 17:31:19 2022] PUT /identity/v3/projects/9ad2da65774949fbbc5c91f94d9da8e4/users/9962501dc96d4c1098cbe3818ffbcdfb/roles/dba744f8ab2a4c45b9d3212f8d203aba => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:31:19.657952 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fbccbe-f01a-44cf-8829-c15559baaef8 admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:31:19.668043 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fbccbe-f01a-44cf-8829-c15559baaef8 admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:31:19.724606 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5b1d8a-06c1-413e-a2e7-98b578a84578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:31:19.725315 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5b1d8a-06c1-413e-a2e7-98b578a84578 admin admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:31:19.725604 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5b1d8a-06c1-413e-a2e7-98b578a84578 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:31:19.725921 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5b1d8a-06c1-413e-a2e7-98b578a84578 admin admin] PATH_INFO: `/v3/roles` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:31:19.726655 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5b1d8a-06c1-413e-a2e7-98b578a84578 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:31:19.728258 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5b1d8a-06c1-413e-a2e7-98b578a84578 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:31:19.737968 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1324/2646] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 17:31:19 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:31:19.742171 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d4f5bf-f56e-416a-936d-9d104f78d9b5 admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:31:19.753339 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d4f5bf-f56e-416a-936d-9d104f78d9b5 admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:31:19.757981 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b08ec7a-9253-4e23-b986-7eb59619b4a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:31:19.758848 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b08ec7a-9253-4e23-b986-7eb59619b4a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:31:19.759132 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b08ec7a-9253-4e23-b986-7eb59619b4a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:31:19.759439 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b08ec7a-9253-4e23-b986-7eb59619b4a0 admin admin] PATH_INFO: `/v3/projects/9ad2da65774949fbbc5c91f94d9da8e4/users/9962501dc96d4c1098cbe3818ffbcdfb/roles/dba744f8ab2a4c45b9d3212f8d203aba` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:31:19.762012 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b08ec7a-9253-4e23-b986-7eb59619b4a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ad2da65774949fbbc5c91f94d9da8e4, user_id=9962501dc96d4c1098cbe3818ffbcdfb, role_id=dba744f8ab2a4c45b9d3212f8d203aba)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:31:19.764624 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b08ec7a-9253-4e23-b986-7eb59619b4a0 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:31:19.775073 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1323/2647] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 17:31:19 2022] PUT /identity/v3/projects/9ad2da65774949fbbc5c91f94d9da8e4/users/9962501dc96d4c1098cbe3818ffbcdfb/roles/dba744f8ab2a4c45b9d3212f8d203aba => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:31:19.787189 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c115a8fd-351a-4001-9189-a43a42e85d13 None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:31:19.787489 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c115a8fd-351a-4001-9189-a43a42e85d13 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:31:19.787780 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c115a8fd-351a-4001-9189-a43a42e85d13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:31:19.815897 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-c115a8fd-351a-4001-9189-a43a42e85d13 None None] MFA Rules not processed for user `9962501dc96d4c1098cbe3818ffbcdfb`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:31:19.817107 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-c115a8fd-351a-4001-9189-a43a42e85d13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:31:19.845812 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:31:19.890416 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1325/2648] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:31:19 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:31:19.902551 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b08ec7a-9253-4e23-b986-7eb59619b4a0 admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:31:19.904369 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-5b08ec7a-9253-4e23-b986-7eb59619b4a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:31:19.919351 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:31:19.974098 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b08ec7a-9253-4e23-b986-7eb59619b4a0 admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:31:19.978167 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f11bb08-441b-4481-8bf5-58026a02fbcd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef37136b89d34edc9cd94c7aa81b2095', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:31:19.979600 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f11bb08-441b-4481-8bf5-58026a02fbcd service cinder] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:31:19.980338 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f11bb08-441b-4481-8bf5-58026a02fbcd service cinder] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:31:19.980706 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f11bb08-441b-4481-8bf5-58026a02fbcd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:31:19.990274 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f11bb08-441b-4481-8bf5-58026a02fbcd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:31:19.991697 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f11bb08-441b-4481-8bf5-58026a02fbcd service cinder] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:31:20.002084 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1324/2649] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:31:19 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:31:20.047443 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c115a8fd-351a-4001-9189-a43a42e85d13 None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:31:20.048860 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-c115a8fd-351a-4001-9189-a43a42e85d13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:31:20.061448 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c115a8fd-351a-4001-9189-a43a42e85d13 None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:31:20.065130 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d8760a-e9d4-45ed-a000-d8af3e085c84 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef37136b89d34edc9cd94c7aa81b2095', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:31:20.065790 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d8760a-e9d4-45ed-a000-d8af3e085c84 service cinder] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:31:20.066095 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d8760a-e9d4-45ed-a000-d8af3e085c84 service cinder] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:31:20.066376 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d8760a-e9d4-45ed-a000-d8af3e085c84 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:31:20.123511 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d8760a-e9d4-45ed-a000-d8af3e085c84 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:31:20.124951 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d8760a-e9d4-45ed-a000-d8af3e085c84 service cinder] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:31:20.134277 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1326/2650] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:31:20 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:31:24.679610 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f11bb08-441b-4481-8bf5-58026a02fbcd service cinder] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:31:24.758858 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f11bb08-441b-4481-8bf5-58026a02fbcd service cinder] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:31:24.763507 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06414050-e5f9-4bf9-b24c-d5a8bad8a324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:31:24.764376 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06414050-e5f9-4bf9-b24c-d5a8bad8a324 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:31:24.764664 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06414050-e5f9-4bf9-b24c-d5a8bad8a324 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:31:24.764947 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06414050-e5f9-4bf9-b24c-d5a8bad8a324 admin admin] PATH_INFO: `/v3/users/76f0e8f673bd411e8128ab0cd72db769` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:31:24.766171 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06414050-e5f9-4bf9-b24c-d5a8bad8a324 admin admin] RBAC: Authorizing `identity:delete_user(user_id=76f0e8f673bd411e8128ab0cd72db769)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:31:24.768235 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06414050-e5f9-4bf9-b24c-d5a8bad8a324 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:31:24.907880 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-06414050-e5f9-4bf9-b24c-d5a8bad8a324 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76f0e8f673bd411e8128ab0cd72db769'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:31:24.908550 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-06414050-e5f9-4bf9-b24c-d5a8bad8a324 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76f0e8f673bd411e8128ab0cd72db769'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:31:24.909204 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-06414050-e5f9-4bf9-b24c-d5a8bad8a324 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76f0e8f673bd411e8128ab0cd72db769'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:31:24.956298 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-06414050-e5f9-4bf9-b24c-d5a8bad8a324 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76f0e8f673bd411e8128ab0cd72db769'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:31:24.964360 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-06414050-e5f9-4bf9-b24c-d5a8bad8a324 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76f0e8f673bd411e8128ab0cd72db769'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:31:24.982670 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1325/2651] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 16 17:31:24 2022] DELETE /identity/v3/users/76f0e8f673bd411e8128ab0cd72db769 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:31:24.987323 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e113d84-6537-42a9-a9f1-5a929b99cf9e None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:31:24.987797 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e113d84-6537-42a9-a9f1-5a929b99cf9e None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:31:24.987909 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e113d84-6537-42a9-a9f1-5a929b99cf9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:31:25.005052 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-6e113d84-6537-42a9-a9f1-5a929b99cf9e None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:31:25.010739 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-6e113d84-6537-42a9-a9f1-5a929b99cf9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:31:25.069779 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1327/2652] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:31:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:31:25.080160 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06414050-e5f9-4bf9-b24c-d5a8bad8a324 admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:31:25.081621 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-06414050-e5f9-4bf9-b24c-d5a8bad8a324 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:31:25.121817 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:31:25.139405 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06414050-e5f9-4bf9-b24c-d5a8bad8a324 admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:31:25.143138 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f033be65-c81c-4aef-9047-e2aaee84fa4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5d25bfa8dc042329d57cd55fa7b7b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:31:25.143787 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f033be65-c81c-4aef-9047-e2aaee84fa4c service neutron] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:31:25.144077 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f033be65-c81c-4aef-9047-e2aaee84fa4c service neutron] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:31:25.144360 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f033be65-c81c-4aef-9047-e2aaee84fa4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:31:25.154153 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f033be65-c81c-4aef-9047-e2aaee84fa4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:31:25.155580 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f033be65-c81c-4aef-9047-e2aaee84fa4c service neutron] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:31:25.165700 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1326/2653] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:31:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:31:25.586616 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e113d84-6537-42a9-a9f1-5a929b99cf9e None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:31:25.588165 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-6e113d84-6537-42a9-a9f1-5a929b99cf9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:31:25.602289 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e113d84-6537-42a9-a9f1-5a929b99cf9e None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:31:25.607472 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d75bdf-0c26-4b5b-aa35-f02cdbc73c0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:31:25.608467 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d75bdf-0c26-4b5b-aa35-f02cdbc73c0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:31:25.608758 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d75bdf-0c26-4b5b-aa35-f02cdbc73c0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:31:25.609171 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d75bdf-0c26-4b5b-aa35-f02cdbc73c0b admin admin] PATH_INFO: `/v3/projects/572994d4699d4499a8bde435e3abbf82` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:31:25.610312 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d75bdf-0c26-4b5b-aa35-f02cdbc73c0b admin admin] RBAC: Authorizing `identity:delete_project(project_id=572994d4699d4499a8bde435e3abbf82)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:31:25.612294 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d75bdf-0c26-4b5b-aa35-f02cdbc73c0b admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:31:25.699504 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-c2d75bdf-0c26-4b5b-aa35-f02cdbc73c0b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '572994d4699d4499a8bde435e3abbf82', 'request_id': 'req-c2d75bdf-0c26-4b5b-aa35-f02cdbc73c0b'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:31:25.701387 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:31:25.705203 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-c2d75bdf-0c26-4b5b-aa35-f02cdbc73c0b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '572994d4699d4499a8bde435e3abbf82', 'request_id': 'req-c2d75bdf-0c26-4b5b-aa35-f02cdbc73c0b'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:31:25.790400 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-c2d75bdf-0c26-4b5b-aa35-f02cdbc73c0b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '572994d4699d4499a8bde435e3abbf82', 'request_id': 'req-c2d75bdf-0c26-4b5b-aa35-f02cdbc73c0b'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:31:25.802696 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-c2d75bdf-0c26-4b5b-aa35-f02cdbc73c0b admin admin] The token cache is being invalidate because project 572994d4699d4499a8bde435e3abbf82 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80874) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 17:31:25.802991 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-c2d75bdf-0c26-4b5b-aa35-f02cdbc73c0b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:31:25.803627 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-c2d75bdf-0c26-4b5b-aa35-f02cdbc73c0b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:31:25.805248 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1328/2654] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 16 17:31:25 2022] DELETE /identity/v3/projects/572994d4699d4499a8bde435e3abbf82 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:31:25.809855 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f033be65-c81c-4aef-9047-e2aaee84fa4c service neutron] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:31:25.820131 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f033be65-c81c-4aef-9047-e2aaee84fa4c service neutron] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:31:25.879188 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f16293-aec5-4c4a-917b-39e11a6b487a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:31:25.880068 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f16293-aec5-4c4a-917b-39e11a6b487a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:31:25.880413 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f16293-aec5-4c4a-917b-39e11a6b487a admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:31:25.880743 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f16293-aec5-4c4a-917b-39e11a6b487a admin admin] PATH_INFO: `/v3/users/9962501dc96d4c1098cbe3818ffbcdfb` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:31:25.881979 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f16293-aec5-4c4a-917b-39e11a6b487a admin admin] RBAC: Authorizing `identity:delete_user(user_id=9962501dc96d4c1098cbe3818ffbcdfb)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:31:25.883915 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f16293-aec5-4c4a-917b-39e11a6b487a admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:31:26.057349 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-26f16293-aec5-4c4a-917b-39e11a6b487a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9962501dc96d4c1098cbe3818ffbcdfb'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:31:26.058030 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-26f16293-aec5-4c4a-917b-39e11a6b487a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9962501dc96d4c1098cbe3818ffbcdfb'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:31:26.058636 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-26f16293-aec5-4c4a-917b-39e11a6b487a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9962501dc96d4c1098cbe3818ffbcdfb'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:31:26.129791 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-26f16293-aec5-4c4a-917b-39e11a6b487a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9962501dc96d4c1098cbe3818ffbcdfb'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:31:26.141910 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-26f16293-aec5-4c4a-917b-39e11a6b487a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9962501dc96d4c1098cbe3818ffbcdfb'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:31:26.162385 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1327/2655] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 16 17:31:25 2022] DELETE /identity/v3/users/9962501dc96d4c1098cbe3818ffbcdfb => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:31:26.579467 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d75bdf-0c26-4b5b-aa35-f02cdbc73c0b admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:31:26.581013 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-c2d75bdf-0c26-4b5b-aa35-f02cdbc73c0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:31:26.594817 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d75bdf-0c26-4b5b-aa35-f02cdbc73c0b admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:31:26.656969 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba87abe0-dcd8-4376-9f85-2cb8745eb453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:31:26.657873 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba87abe0-dcd8-4376-9f85-2cb8745eb453 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:31:26.658173 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba87abe0-dcd8-4376-9f85-2cb8745eb453 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:31:26.658462 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba87abe0-dcd8-4376-9f85-2cb8745eb453 admin admin] PATH_INFO: `/v3/projects/9ad2da65774949fbbc5c91f94d9da8e4` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:31:26.659675 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba87abe0-dcd8-4376-9f85-2cb8745eb453 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ad2da65774949fbbc5c91f94d9da8e4)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:31:26.661620 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba87abe0-dcd8-4376-9f85-2cb8745eb453 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:31:26.768241 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-ba87abe0-dcd8-4376-9f85-2cb8745eb453 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ad2da65774949fbbc5c91f94d9da8e4', 'request_id': 'req-ba87abe0-dcd8-4376-9f85-2cb8745eb453'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:31:26.773838 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-ba87abe0-dcd8-4376-9f85-2cb8745eb453 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ad2da65774949fbbc5c91f94d9da8e4', 'request_id': 'req-ba87abe0-dcd8-4376-9f85-2cb8745eb453'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:31:26.852859 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-ba87abe0-dcd8-4376-9f85-2cb8745eb453 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ad2da65774949fbbc5c91f94d9da8e4', 'request_id': 'req-ba87abe0-dcd8-4376-9f85-2cb8745eb453'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:31:26.865018 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-ba87abe0-dcd8-4376-9f85-2cb8745eb453 admin admin] The token cache is being invalidate because project 9ad2da65774949fbbc5c91f94d9da8e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80874) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 17:31:26.865308 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-ba87abe0-dcd8-4376-9f85-2cb8745eb453 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:31:26.865978 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-ba87abe0-dcd8-4376-9f85-2cb8745eb453 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:31:26.867522 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1329/2656] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 16 17:31:26 2022] DELETE /identity/v3/projects/9ad2da65774949fbbc5c91f94d9da8e4 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:31:26.872366 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3504ff51-3d95-41f2-b19f-2e4e61fae69d None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:31:26.872849 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3504ff51-3d95-41f2-b19f-2e4e61fae69d None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:31:26.873071 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3504ff51-3d95-41f2-b19f-2e4e61fae69d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:31:26.899297 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-3504ff51-3d95-41f2-b19f-2e4e61fae69d None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:31:26.899297 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-3504ff51-3d95-41f2-b19f-2e4e61fae69d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:31:26.944356 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:31:26.953846 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1328/2657] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:31:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:31:26.962436 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d40897-359e-4113-8759-98db37e67fd9 None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:31:26.962755 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d40897-359e-4113-8759-98db37e67fd9 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:31:26.965899 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d40897-359e-4113-8759-98db37e67fd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:31:26.982431 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-a2d40897-359e-4113-8759-98db37e67fd9 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:31:26.983637 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-a2d40897-359e-4113-8759-98db37e67fd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:31:26.991940 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1330/2658] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:31:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:31:26.996247 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3504ff51-3d95-41f2-b19f-2e4e61fae69d None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:31:27.005984 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3504ff51-3d95-41f2-b19f-2e4e61fae69d None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:31:27.010644 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1a3aa3-cf04-4fb9-a64e-fec05fa5cc81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:31:27.011408 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1a3aa3-cf04-4fb9-a64e-fec05fa5cc81 admin admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:31:27.011743 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1a3aa3-cf04-4fb9-a64e-fec05fa5cc81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:31:27.012244 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1a3aa3-cf04-4fb9-a64e-fec05fa5cc81 admin admin] PATH_INFO: `/v3/domains` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:31:27.013151 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1a3aa3-cf04-4fb9-a64e-fec05fa5cc81 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80873) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:31:27.013873 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1a3aa3-cf04-4fb9-a64e-fec05fa5cc81 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:31:27.015543 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1a3aa3-cf04-4fb9-a64e-fec05fa5cc81 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:31:27.027537 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1329/2659] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 16 17:31:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:31:27.033038 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d40897-359e-4113-8759-98db37e67fd9 None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:31:27.043336 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d40897-359e-4113-8759-98db37e67fd9 None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:31:27.048008 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea440da-4c59-4217-b0fa-695d570b71cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:31:27.048657 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea440da-4c59-4217-b0fa-695d570b71cd admin admin] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:31:27.048941 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea440da-4c59-4217-b0fa-695d570b71cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:31:27.049221 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea440da-4c59-4217-b0fa-695d570b71cd admin admin] PATH_INFO: `/v3/projects` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:31:27.050057 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea440da-4c59-4217-b0fa-695d570b71cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:31:27.051959 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea440da-4c59-4217-b0fa-695d570b71cd admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:31:27.146042 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1331/2660] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 16 17:31:27 2022] POST /identity/v3/projects => generated 381 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:31:27.150350 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1a3aa3-cf04-4fb9-a64e-fec05fa5cc81 admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:31:27.161358 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1a3aa3-cf04-4fb9-a64e-fec05fa5cc81 admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:31:27.217744 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71da9951-9974-4400-b3d9-5e28618ed164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:31:27.218587 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71da9951-9974-4400-b3d9-5e28618ed164 admin admin] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:31:27.218875 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71da9951-9974-4400-b3d9-5e28618ed164 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:31:27.219154 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71da9951-9974-4400-b3d9-5e28618ed164 admin admin] PATH_INFO: `/v3/users` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:31:27.219847 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71da9951-9974-4400-b3d9-5e28618ed164 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:31:27.221780 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71da9951-9974-4400-b3d9-5e28618ed164 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:31:27.287975 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1330/2661] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 16 17:31:27 2022] POST /identity/v3/users => generated 291 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:31:27.292440 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea440da-4c59-4217-b0fa-695d570b71cd admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:31:27.302932 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea440da-4c59-4217-b0fa-695d570b71cd admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:31:27.308353 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f6d05a-8e9d-44a2-ae7a-e9af8f1b575c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:31:27.309031 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f6d05a-8e9d-44a2-ae7a-e9af8f1b575c admin admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:31:27.309435 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f6d05a-8e9d-44a2-ae7a-e9af8f1b575c admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:31:27.309726 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f6d05a-8e9d-44a2-ae7a-e9af8f1b575c admin admin] PATH_INFO: `/v3/roles` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:31:27.310484 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f6d05a-8e9d-44a2-ae7a-e9af8f1b575c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:31:27.312091 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f6d05a-8e9d-44a2-ae7a-e9af8f1b575c admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:31:27.323408 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1332/2662] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 17:31:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 17:31:27.327434 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71da9951-9974-4400-b3d9-5e28618ed164 admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:31:27.337585 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71da9951-9974-4400-b3d9-5e28618ed164 admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:31:27.343719 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5a2b4d-844b-4534-8c20-9e258529e7d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:31:27.343719 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5a2b4d-844b-4534-8c20-9e258529e7d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:31:27.343947 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5a2b4d-844b-4534-8c20-9e258529e7d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:31:27.344115 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5a2b4d-844b-4534-8c20-9e258529e7d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:31:27.344848 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5a2b4d-844b-4534-8c20-9e258529e7d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:31:27.346486 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5a2b4d-844b-4534-8c20-9e258529e7d1 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:31:27.356590 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1331/2663] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 17:31:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:31:27.360675 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f6d05a-8e9d-44a2-ae7a-e9af8f1b575c admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:31:27.370868 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f6d05a-8e9d-44a2-ae7a-e9af8f1b575c admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:31:27.375755 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee2e02f-2b94-4035-9515-b6a805938f7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:31:27.376637 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee2e02f-2b94-4035-9515-b6a805938f7b admin admin] REQUEST_METHOD: `PUT` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:31:27.376927 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee2e02f-2b94-4035-9515-b6a805938f7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:31:27.377235 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee2e02f-2b94-4035-9515-b6a805938f7b admin admin] PATH_INFO: `/v3/projects/ce096999cae442b2b20c9f05ca2aa9ee/users/911a4eb377a34befa0132eac49958594/roles/896bff49c5d6464eb612a15f4aa9badc` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:31:27.392487 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee2e02f-2b94-4035-9515-b6a805938f7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce096999cae442b2b20c9f05ca2aa9ee, user_id=911a4eb377a34befa0132eac49958594, role_id=896bff49c5d6464eb612a15f4aa9badc)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:31:27.395242 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee2e02f-2b94-4035-9515-b6a805938f7b admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:31:27.442856 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:31:27.449928 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1333/2664] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 17:31:27 2022] PUT /identity/v3/projects/ce096999cae442b2b20c9f05ca2aa9ee/users/911a4eb377a34befa0132eac49958594/roles/896bff49c5d6464eb612a15f4aa9badc => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:31:27.460795 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea72eea0-6fd6-485e-a10b-8e3a951d0fbd None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:31:27.461093 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea72eea0-6fd6-485e-a10b-8e3a951d0fbd None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:31:27.461376 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea72eea0-6fd6-485e-a10b-8e3a951d0fbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:31:27.488286 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-ea72eea0-6fd6-485e-a10b-8e3a951d0fbd None None] MFA Rules not processed for user `911a4eb377a34befa0132eac49958594`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:31:27.489511 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-ea72eea0-6fd6-485e-a10b-8e3a951d0fbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:31:27.555895 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1332/2665] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:31:27 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 17:31:27.560947 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee2e02f-2b94-4035-9515-b6a805938f7b admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:31:27.623796 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee2e02f-2b94-4035-9515-b6a805938f7b admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:31:27.628896 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f621b54-edab-4cf5-b102-a68fd806b829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:31:27.629644 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f621b54-edab-4cf5-b102-a68fd806b829 admin admin] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:31:27.629967 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f621b54-edab-4cf5-b102-a68fd806b829 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:31:27.630251 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f621b54-edab-4cf5-b102-a68fd806b829 admin admin] PATH_INFO: `/v3/projects` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:31:27.631001 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f621b54-edab-4cf5-b102-a68fd806b829 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:31:27.633142 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f621b54-edab-4cf5-b102-a68fd806b829 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:31:27.726713 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1334/2666] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 16 17:31:27 2022] POST /identity/v3/projects => generated 379 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:31:27.728301 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea72eea0-6fd6-485e-a10b-8e3a951d0fbd None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:31:27.739489 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea72eea0-6fd6-485e-a10b-8e3a951d0fbd None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:31:27.789570 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:31:27.799204 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed445b6-d82e-451a-84a1-fc4fd7b9e0a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:31:27.799906 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed445b6-d82e-451a-84a1-fc4fd7b9e0a1 admin admin] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:31:27.800195 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed445b6-d82e-451a-84a1-fc4fd7b9e0a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:31:27.800472 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed445b6-d82e-451a-84a1-fc4fd7b9e0a1 admin admin] PATH_INFO: `/v3/users` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:31:27.801176 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed445b6-d82e-451a-84a1-fc4fd7b9e0a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:31:27.803421 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed445b6-d82e-451a-84a1-fc4fd7b9e0a1 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:31:27.830803 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edccaaf5-4f24-49fa-a2ec-9500d71948e1 None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:31:27.831104 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edccaaf5-4f24-49fa-a2ec-9500d71948e1 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:31:27.831394 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edccaaf5-4f24-49fa-a2ec-9500d71948e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:31:27.850235 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-edccaaf5-4f24-49fa-a2ec-9500d71948e1 None None] MFA Rules not processed for user `f7f35c1c15a84a92863d4f3f96d76830`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:31:27.851468 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-edccaaf5-4f24-49fa-a2ec-9500d71948e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:31:27.871636 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1333/2667] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 16 17:31:27 2022] POST /identity/v3/users => generated 296 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:31:27.875717 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed445b6-d82e-451a-84a1-fc4fd7b9e0a1 admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:31:27.887966 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed445b6-d82e-451a-84a1-fc4fd7b9e0a1 admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:31:27.893198 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a015287a-ec98-4aa2-8a65-31633d28149c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:31:27.894002 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a015287a-ec98-4aa2-8a65-31633d28149c admin admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:31:27.894351 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a015287a-ec98-4aa2-8a65-31633d28149c admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:31:27.894708 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a015287a-ec98-4aa2-8a65-31633d28149c admin admin] PATH_INFO: `/v3/roles` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:31:27.895640 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a015287a-ec98-4aa2-8a65-31633d28149c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:31:27.898692 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a015287a-ec98-4aa2-8a65-31633d28149c admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:31:27.912343 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1334/2668] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 17:31:27 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 17:31:27.913436 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a015287a-ec98-4aa2-8a65-31633d28149c admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:31:27.924227 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1335/2669] 10.222.0.39 () {58 vars in 1009 bytes} [Thu Jun 16 17:31:27 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 17:31:27.927061 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a015287a-ec98-4aa2-8a65-31633d28149c admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:31:27.933043 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39de7268-8b81-4c01-9971-d1b836225015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:31:27.933965 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39de7268-8b81-4c01-9971-d1b836225015 admin admin] REQUEST_METHOD: `PUT` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:31:27.934253 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39de7268-8b81-4c01-9971-d1b836225015 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:31:27.934535 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39de7268-8b81-4c01-9971-d1b836225015 admin admin] PATH_INFO: `/v3/projects/01e73f0f81d244cfb16a932d14a68910/users/4f7022c1726048b6bd1a825429ad5597/roles/dba744f8ab2a4c45b9d3212f8d203aba` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:31:27.941062 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edccaaf5-4f24-49fa-a2ec-9500d71948e1 None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:31:27.942490 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-edccaaf5-4f24-49fa-a2ec-9500d71948e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:31:27.951316 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39de7268-8b81-4c01-9971-d1b836225015 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01e73f0f81d244cfb16a932d14a68910, user_id=4f7022c1726048b6bd1a825429ad5597, role_id=dba744f8ab2a4c45b9d3212f8d203aba)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:31:27.954006 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39de7268-8b81-4c01-9971-d1b836225015 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:31:28.014909 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edccaaf5-4f24-49fa-a2ec-9500d71948e1 None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:31:28.022598 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca3b958-a7ec-481c-b5ad-63c5747cac71 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbec2dfe63764ed88a23e172ead0afa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:31:28.023316 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca3b958-a7ec-481c-b5ad-63c5747cac71 service swift] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:31:28.023606 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca3b958-a7ec-481c-b5ad-63c5747cac71 service swift] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:31:28.023893 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca3b958-a7ec-481c-b5ad-63c5747cac71 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:31:28.033265 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca3b958-a7ec-481c-b5ad-63c5747cac71 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:31:28.036809 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca3b958-a7ec-481c-b5ad-63c5747cac71 service swift] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:31:28.037000 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1335/2670] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 17:31:27 2022] PUT /identity/v3/projects/01e73f0f81d244cfb16a932d14a68910/users/4f7022c1726048b6bd1a825429ad5597/roles/dba744f8ab2a4c45b9d3212f8d203aba => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:31:28.038127 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39de7268-8b81-4c01-9971-d1b836225015 admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:31:28.045582 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1336/2671] 10.222.0.39 () {60 vars in 1384 bytes} [Thu Jun 16 17:31:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 16 17:31:28.116336 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39de7268-8b81-4c01-9971-d1b836225015 admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:31:28.122141 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540a8f05-c2b4-4c32-a8ef-e7b32e49887c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:31:28.122916 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540a8f05-c2b4-4c32-a8ef-e7b32e49887c admin admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:31:28.124503 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540a8f05-c2b4-4c32-a8ef-e7b32e49887c admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:31:28.124503 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540a8f05-c2b4-4c32-a8ef-e7b32e49887c admin admin] PATH_INFO: `/v3/roles` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:31:28.124503 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540a8f05-c2b4-4c32-a8ef-e7b32e49887c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:31:28.126133 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540a8f05-c2b4-4c32-a8ef-e7b32e49887c admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:31:28.137635 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1336/2672] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 17:31:28 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:31:28.141810 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca3b958-a7ec-481c-b5ad-63c5747cac71 service swift] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:31:28.164290 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca3b958-a7ec-481c-b5ad-63c5747cac71 service swift] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:31:28.181595 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5728411-98c4-4b12-922a-4a49c4b70630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:31:28.183124 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5728411-98c4-4b12-922a-4a49c4b70630 admin admin] REQUEST_METHOD: `PUT` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:31:28.183492 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5728411-98c4-4b12-922a-4a49c4b70630 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:31:28.189839 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5728411-98c4-4b12-922a-4a49c4b70630 admin admin] PATH_INFO: `/v3/projects/01e73f0f81d244cfb16a932d14a68910/users/4f7022c1726048b6bd1a825429ad5597/roles/dba744f8ab2a4c45b9d3212f8d203aba` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:31:28.189839 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5728411-98c4-4b12-922a-4a49c4b70630 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01e73f0f81d244cfb16a932d14a68910, user_id=4f7022c1726048b6bd1a825429ad5597, role_id=dba744f8ab2a4c45b9d3212f8d203aba)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:31:28.192076 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5728411-98c4-4b12-922a-4a49c4b70630 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:31:28.207424 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1337/2673] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 17:31:28 2022] PUT /identity/v3/projects/01e73f0f81d244cfb16a932d14a68910/users/4f7022c1726048b6bd1a825429ad5597/roles/dba744f8ab2a4c45b9d3212f8d203aba => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:31:28.218496 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dc982a-b258-4bb4-8b94-692616157fa4 None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:31:28.218790 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dc982a-b258-4bb4-8b94-692616157fa4 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:31:28.219070 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dc982a-b258-4bb4-8b94-692616157fa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:31:28.232147 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5728411-98c4-4b12-922a-4a49c4b70630 admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:31:28.234109 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-e5728411-98c4-4b12-922a-4a49c4b70630 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:31:28.242878 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:31:28.254171 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-a3dc982a-b258-4bb4-8b94-692616157fa4 None None] MFA Rules not processed for user `4f7022c1726048b6bd1a825429ad5597`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:31:28.255521 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-a3dc982a-b258-4bb4-8b94-692616157fa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:31:28.339188 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1337/2674] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:31:28 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:31:28.351145 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dc982a-b258-4bb4-8b94-692616157fa4 None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:31:28.352564 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-a3dc982a-b258-4bb4-8b94-692616157fa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:31:28.367445 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5728411-98c4-4b12-922a-4a49c4b70630 admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:31:28.390190 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503433fa-13ac-48ba-a5b8-cbfbcd6f17de service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d381bb41dea4f1e90c3cf3815ac88dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:31:28.391029 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503433fa-13ac-48ba-a5b8-cbfbcd6f17de service nova] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:31:28.391520 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503433fa-13ac-48ba-a5b8-cbfbcd6f17de service nova] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:31:28.391871 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503433fa-13ac-48ba-a5b8-cbfbcd6f17de service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:31:28.394977 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-503433fa-13ac-48ba-a5b8-cbfbcd6f17de service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:31:28.404118 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:31:28.413087 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503433fa-13ac-48ba-a5b8-cbfbcd6f17de service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:31:28.418092 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503433fa-13ac-48ba-a5b8-cbfbcd6f17de service nova] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:31:28.446830 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1338/2675] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:31:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 17:31:28.446957 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dc982a-b258-4bb4-8b94-692616157fa4 None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:31:28.449388 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d99c81d-f0e6-4094-8ff1-5a0170def062 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef37136b89d34edc9cd94c7aa81b2095', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:31:28.450402 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d99c81d-f0e6-4094-8ff1-5a0170def062 service cinder] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:31:28.450605 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d99c81d-f0e6-4094-8ff1-5a0170def062 service cinder] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:31:28.450854 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d99c81d-f0e6-4094-8ff1-5a0170def062 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:31:28.462569 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d99c81d-f0e6-4094-8ff1-5a0170def062 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:31:28.464881 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d99c81d-f0e6-4094-8ff1-5a0170def062 service cinder] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:31:28.478610 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1338/2676] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:31:28 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 17:31:29.068713 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503433fa-13ac-48ba-a5b8-cbfbcd6f17de service nova] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:31:29.144437 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503433fa-13ac-48ba-a5b8-cbfbcd6f17de service nova] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:31:29.149350 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339e2e3e-ffc5-44b3-9d36-f6a963027ea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:31:29.150280 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339e2e3e-ffc5-44b3-9d36-f6a963027ea6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:31:29.150604 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339e2e3e-ffc5-44b3-9d36-f6a963027ea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:31:29.150866 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339e2e3e-ffc5-44b3-9d36-f6a963027ea6 admin admin] PATH_INFO: `/v3/users/911a4eb377a34befa0132eac49958594` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:31:29.152114 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339e2e3e-ffc5-44b3-9d36-f6a963027ea6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=911a4eb377a34befa0132eac49958594)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:31:29.154076 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339e2e3e-ffc5-44b3-9d36-f6a963027ea6 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:31:29.311485 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-339e2e3e-ffc5-44b3-9d36-f6a963027ea6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '911a4eb377a34befa0132eac49958594'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:31:29.323185 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-339e2e3e-ffc5-44b3-9d36-f6a963027ea6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '911a4eb377a34befa0132eac49958594'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:31:29.384809 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-339e2e3e-ffc5-44b3-9d36-f6a963027ea6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '911a4eb377a34befa0132eac49958594'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:31:29.385589 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-339e2e3e-ffc5-44b3-9d36-f6a963027ea6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '911a4eb377a34befa0132eac49958594'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:31:29.402907 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-339e2e3e-ffc5-44b3-9d36-f6a963027ea6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '911a4eb377a34befa0132eac49958594'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:31:29.409301 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1339/2677] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 16 17:31:29 2022] DELETE /identity/v3/users/911a4eb377a34befa0132eac49958594 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:31:29.416092 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3e6a01-0827-4f73-9bd3-3f941a5be5ad None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:31:29.417170 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3e6a01-0827-4f73-9bd3-3f941a5be5ad None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:31:29.417653 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3e6a01-0827-4f73-9bd3-3f941a5be5ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:31:29.439577 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-cc3e6a01-0827-4f73-9bd3-3f941a5be5ad None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:31:29.440987 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-cc3e6a01-0827-4f73-9bd3-3f941a5be5ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:31:29.529208 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1339/2678] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:31:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:31:29.540373 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339e2e3e-ffc5-44b3-9d36-f6a963027ea6 admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:31:29.542529 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-339e2e3e-ffc5-44b3-9d36-f6a963027ea6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:31:29.554544 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:31:29.616528 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339e2e3e-ffc5-44b3-9d36-f6a963027ea6 admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:31:29.621369 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d646b969-f9ba-4553-82de-525c37a7b548 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5d25bfa8dc042329d57cd55fa7b7b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:31:29.622173 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d646b969-f9ba-4553-82de-525c37a7b548 service neutron] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:31:29.622705 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d646b969-f9ba-4553-82de-525c37a7b548 service neutron] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:31:29.623092 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d646b969-f9ba-4553-82de-525c37a7b548 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:31:29.635375 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d646b969-f9ba-4553-82de-525c37a7b548 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:31:29.640616 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d646b969-f9ba-4553-82de-525c37a7b548 service neutron] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:31:29.647542 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1340/2679] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:31:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:31:30.092067 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3e6a01-0827-4f73-9bd3-3f941a5be5ad None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:31:30.093635 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-cc3e6a01-0827-4f73-9bd3-3f941a5be5ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:31:30.112601 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3e6a01-0827-4f73-9bd3-3f941a5be5ad None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:31:30.118218 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8c30ce-bbba-4833-8cd0-be65418ab902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:31:30.119091 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8c30ce-bbba-4833-8cd0-be65418ab902 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:31:30.119945 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8c30ce-bbba-4833-8cd0-be65418ab902 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:31:30.120743 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8c30ce-bbba-4833-8cd0-be65418ab902 admin admin] PATH_INFO: `/v3/projects/ce096999cae442b2b20c9f05ca2aa9ee` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:31:30.122031 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8c30ce-bbba-4833-8cd0-be65418ab902 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce096999cae442b2b20c9f05ca2aa9ee)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:31:30.124830 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8c30ce-bbba-4833-8cd0-be65418ab902 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:31:30.235102 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-af8c30ce-bbba-4833-8cd0-be65418ab902 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce096999cae442b2b20c9f05ca2aa9ee', 'request_id': 'req-af8c30ce-bbba-4833-8cd0-be65418ab902'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:31:30.243611 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-af8c30ce-bbba-4833-8cd0-be65418ab902 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce096999cae442b2b20c9f05ca2aa9ee', 'request_id': 'req-af8c30ce-bbba-4833-8cd0-be65418ab902'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:31:30.252149 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-af8c30ce-bbba-4833-8cd0-be65418ab902 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce096999cae442b2b20c9f05ca2aa9ee', 'request_id': 'req-af8c30ce-bbba-4833-8cd0-be65418ab902'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:31:30.328263 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-af8c30ce-bbba-4833-8cd0-be65418ab902 admin admin] The token cache is being invalidate because project ce096999cae442b2b20c9f05ca2aa9ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80873) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 17:31:30.328575 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-af8c30ce-bbba-4833-8cd0-be65418ab902 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:31:30.329255 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-af8c30ce-bbba-4833-8cd0-be65418ab902 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:31:30.331236 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1340/2680] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 16 17:31:30 2022] DELETE /identity/v3/projects/ce096999cae442b2b20c9f05ca2aa9ee => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:31:30.334879 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d646b969-f9ba-4553-82de-525c37a7b548 service neutron] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:31:30.345321 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d646b969-f9ba-4553-82de-525c37a7b548 service neutron] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:31:30.421551 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dfe6ce-00ab-49ee-8222-d22554258fb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:31:30.422582 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dfe6ce-00ab-49ee-8222-d22554258fb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:31:30.424150 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dfe6ce-00ab-49ee-8222-d22554258fb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:31:30.424150 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dfe6ce-00ab-49ee-8222-d22554258fb3 admin admin] PATH_INFO: `/v3/users/4f7022c1726048b6bd1a825429ad5597` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:31:30.425183 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dfe6ce-00ab-49ee-8222-d22554258fb3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f7022c1726048b6bd1a825429ad5597)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:31:30.427230 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dfe6ce-00ab-49ee-8222-d22554258fb3 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:31:30.627633 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-13dfe6ce-00ab-49ee-8222-d22554258fb3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f7022c1726048b6bd1a825429ad5597'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:31:30.638834 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-13dfe6ce-00ab-49ee-8222-d22554258fb3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f7022c1726048b6bd1a825429ad5597'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:31:30.705311 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-13dfe6ce-00ab-49ee-8222-d22554258fb3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f7022c1726048b6bd1a825429ad5597'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:31:30.706008 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-13dfe6ce-00ab-49ee-8222-d22554258fb3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f7022c1726048b6bd1a825429ad5597'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:31:30.719825 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-13dfe6ce-00ab-49ee-8222-d22554258fb3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f7022c1726048b6bd1a825429ad5597'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:31:30.727014 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1341/2681] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 16 17:31:30 2022] DELETE /identity/v3/users/4f7022c1726048b6bd1a825429ad5597 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:31:31.386936 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8c30ce-bbba-4833-8cd0-be65418ab902 admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:31:31.388516 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-af8c30ce-bbba-4833-8cd0-be65418ab902 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:31:31.411792 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8c30ce-bbba-4833-8cd0-be65418ab902 admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:31:31.494084 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:31:31.501179 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656da046-36bc-405e-ae33-3fb02e05f3a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:31:31.502189 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656da046-36bc-405e-ae33-3fb02e05f3a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:31:31.502477 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656da046-36bc-405e-ae33-3fb02e05f3a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:31:31.502774 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656da046-36bc-405e-ae33-3fb02e05f3a5 admin admin] PATH_INFO: `/v3/projects/01e73f0f81d244cfb16a932d14a68910` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:31:31.504254 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656da046-36bc-405e-ae33-3fb02e05f3a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=01e73f0f81d244cfb16a932d14a68910)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:31:31.506307 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656da046-36bc-405e-ae33-3fb02e05f3a5 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:31:31.614141 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-656da046-36bc-405e-ae33-3fb02e05f3a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01e73f0f81d244cfb16a932d14a68910', 'request_id': 'req-656da046-36bc-405e-ae33-3fb02e05f3a5'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:31:31.625475 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-656da046-36bc-405e-ae33-3fb02e05f3a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01e73f0f81d244cfb16a932d14a68910', 'request_id': 'req-656da046-36bc-405e-ae33-3fb02e05f3a5'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:31:31.634855 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-656da046-36bc-405e-ae33-3fb02e05f3a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01e73f0f81d244cfb16a932d14a68910', 'request_id': 'req-656da046-36bc-405e-ae33-3fb02e05f3a5'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:31:31.717147 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-656da046-36bc-405e-ae33-3fb02e05f3a5 admin admin] The token cache is being invalidate because project 01e73f0f81d244cfb16a932d14a68910 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80873) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 17:31:31.717437 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-656da046-36bc-405e-ae33-3fb02e05f3a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:31:31.718714 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-656da046-36bc-405e-ae33-3fb02e05f3a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:31:31.720436 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1341/2682] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 16 17:31:31 2022] DELETE /identity/v3/projects/01e73f0f81d244cfb16a932d14a68910 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:31:31.725618 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49014d69-85e9-4f1c-8f4b-38b0215a08cf None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:31:31.726132 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49014d69-85e9-4f1c-8f4b-38b0215a08cf None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:31:31.730268 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49014d69-85e9-4f1c-8f4b-38b0215a08cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:31:31.753670 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-49014d69-85e9-4f1c-8f4b-38b0215a08cf None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:31:31.755096 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-49014d69-85e9-4f1c-8f4b-38b0215a08cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:31:31.787724 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:31:31.836269 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1342/2683] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:31:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:31:31.838461 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83412c9-f69a-471e-b92f-45b366c366c8 None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:31:31.838841 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83412c9-f69a-471e-b92f-45b366c366c8 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:31:31.839221 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83412c9-f69a-471e-b92f-45b366c366c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:31:31.863151 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-c83412c9-f69a-471e-b92f-45b366c366c8 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:31:31.864488 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-c83412c9-f69a-471e-b92f-45b366c366c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:31:31.873180 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1342/2684] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:31:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:31:31.878226 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49014d69-85e9-4f1c-8f4b-38b0215a08cf None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:31:31.890036 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49014d69-85e9-4f1c-8f4b-38b0215a08cf None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:31:31.900230 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c8f919-04c4-402f-8251-1532e19808f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:31:31.903138 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c8f919-04c4-402f-8251-1532e19808f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:31:31.903138 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c8f919-04c4-402f-8251-1532e19808f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:31:31.903138 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c8f919-04c4-402f-8251-1532e19808f2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:31:31.904123 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c8f919-04c4-402f-8251-1532e19808f2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:31:31.904123 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c8f919-04c4-402f-8251-1532e19808f2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:31:31.905329 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c8f919-04c4-402f-8251-1532e19808f2 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:31:31.921815 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1343/2685] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 16 17:31:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:31:31.923700 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83412c9-f69a-471e-b92f-45b366c366c8 None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:31:31.935898 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83412c9-f69a-471e-b92f-45b366c366c8 None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:31:31.941077 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054470cc-0506-4a25-aa61-2fc9e5f2d3ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:31:31.941793 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054470cc-0506-4a25-aa61-2fc9e5f2d3ab admin admin] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:31:31.942071 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054470cc-0506-4a25-aa61-2fc9e5f2d3ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:31:31.942363 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054470cc-0506-4a25-aa61-2fc9e5f2d3ab admin admin] PATH_INFO: `/v3/projects` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:31:31.943333 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054470cc-0506-4a25-aa61-2fc9e5f2d3ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:31:31.945257 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054470cc-0506-4a25-aa61-2fc9e5f2d3ab admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:31:32.033137 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1343/2686] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 16 17:31:31 2022] POST /identity/v3/projects => generated 371 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:31:32.038078 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c8f919-04c4-402f-8251-1532e19808f2 admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:31:32.049192 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c8f919-04c4-402f-8251-1532e19808f2 admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:31:32.165319 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316d46d8-346f-42e3-b20a-e7f2cb69e078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:31:32.165319 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316d46d8-346f-42e3-b20a-e7f2cb69e078 admin admin] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:31:32.165319 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316d46d8-346f-42e3-b20a-e7f2cb69e078 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:31:32.165319 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316d46d8-346f-42e3-b20a-e7f2cb69e078 admin admin] PATH_INFO: `/v3/users` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:31:32.166608 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316d46d8-346f-42e3-b20a-e7f2cb69e078 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:31:32.166608 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316d46d8-346f-42e3-b20a-e7f2cb69e078 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:31:32.363225 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1344/2687] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 16 17:31:32 2022] POST /identity/v3/users => generated 286 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:31:32.367166 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054470cc-0506-4a25-aa61-2fc9e5f2d3ab admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:31:32.376936 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054470cc-0506-4a25-aa61-2fc9e5f2d3ab admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:31:32.382011 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18433ce-f993-4d8e-819c-f90d9a7fc5d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:31:32.382699 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18433ce-f993-4d8e-819c-f90d9a7fc5d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:31:32.383005 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18433ce-f993-4d8e-819c-f90d9a7fc5d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:31:32.383363 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18433ce-f993-4d8e-819c-f90d9a7fc5d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:31:32.384152 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18433ce-f993-4d8e-819c-f90d9a7fc5d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:31:32.386059 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18433ce-f993-4d8e-819c-f90d9a7fc5d5 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:31:32.402533 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1344/2688] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 17:31:32 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:31:32.406399 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316d46d8-346f-42e3-b20a-e7f2cb69e078 admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:31:32.423674 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316d46d8-346f-42e3-b20a-e7f2cb69e078 admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:31:32.429310 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c3993a-5064-420a-bc9f-bac13002424d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:31:32.430253 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c3993a-5064-420a-bc9f-bac13002424d admin admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:31:32.431161 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c3993a-5064-420a-bc9f-bac13002424d admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:31:32.431614 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c3993a-5064-420a-bc9f-bac13002424d admin admin] PATH_INFO: `/v3/roles` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:31:32.435605 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c3993a-5064-420a-bc9f-bac13002424d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:31:32.441519 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c3993a-5064-420a-bc9f-bac13002424d admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:31:32.458606 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1345/2689] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 17:31:32 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 17:31:32.462773 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18433ce-f993-4d8e-819c-f90d9a7fc5d5 admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:31:32.476139 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18433ce-f993-4d8e-819c-f90d9a7fc5d5 admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:31:32.481923 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd13d86-897f-4aca-9c97-a4a025799a87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:31:32.482826 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd13d86-897f-4aca-9c97-a4a025799a87 admin admin] REQUEST_METHOD: `PUT` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:31:32.483114 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd13d86-897f-4aca-9c97-a4a025799a87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:31:32.483420 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd13d86-897f-4aca-9c97-a4a025799a87 admin admin] PATH_INFO: `/v3/projects/c90a9a67d3dc4d4fb5abd94d30663f6a/users/beb349379d1e479c8756f5aafbc3de38/roles/896bff49c5d6464eb612a15f4aa9badc` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:31:32.513783 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd13d86-897f-4aca-9c97-a4a025799a87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c90a9a67d3dc4d4fb5abd94d30663f6a, user_id=beb349379d1e479c8756f5aafbc3de38, role_id=896bff49c5d6464eb612a15f4aa9badc)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:31:32.516966 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd13d86-897f-4aca-9c97-a4a025799a87 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:31:32.616930 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1345/2690] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 17:31:32 2022] PUT /identity/v3/projects/c90a9a67d3dc4d4fb5abd94d30663f6a/users/beb349379d1e479c8756f5aafbc3de38/roles/896bff49c5d6464eb612a15f4aa9badc => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:31:32.626188 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9abded-1706-446c-90cd-07b901af67a4 None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:31:32.626621 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9abded-1706-446c-90cd-07b901af67a4 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:31:32.627012 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9abded-1706-446c-90cd-07b901af67a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:31:32.651713 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-8f9abded-1706-446c-90cd-07b901af67a4 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:31:32.653391 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-8f9abded-1706-446c-90cd-07b901af67a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:31:32.734824 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1346/2691] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:31:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:31:32.745014 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd13d86-897f-4aca-9c97-a4a025799a87 admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:31:32.746455 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-5dd13d86-897f-4aca-9c97-a4a025799a87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:31:32.817423 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd13d86-897f-4aca-9c97-a4a025799a87 admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:31:32.821523 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13750195-5157-40b3-be44-ac95215d3d14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5d25bfa8dc042329d57cd55fa7b7b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:31:32.822824 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13750195-5157-40b3-be44-ac95215d3d14 service neutron] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:31:32.823240 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13750195-5157-40b3-be44-ac95215d3d14 service neutron] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:31:32.824299 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13750195-5157-40b3-be44-ac95215d3d14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:31:32.834747 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13750195-5157-40b3-be44-ac95215d3d14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:31:32.836223 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13750195-5157-40b3-be44-ac95215d3d14 service neutron] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:31:32.849175 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1346/2692] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:31:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:31:34.510849 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ed4b5c-f717-4f72-8935-5cb26259b02c None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:31:34.511428 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ed4b5c-f717-4f72-8935-5cb26259b02c None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:31:34.511428 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ed4b5c-f717-4f72-8935-5cb26259b02c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:31:34.540551 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-d8ed4b5c-f717-4f72-8935-5cb26259b02c None None] MFA Rules not processed for user `beb349379d1e479c8756f5aafbc3de38`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:31:34.542544 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-d8ed4b5c-f717-4f72-8935-5cb26259b02c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:31:34.577401 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:31:34.632373 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1347/2693] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:31:34 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:31:34.637230 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13750195-5157-40b3-be44-ac95215d3d14 service neutron] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:31:34.647831 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13750195-5157-40b3-be44-ac95215d3d14 service neutron] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:31:34.654844 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6355e463-bb96-4458-8407-fdec9fce9722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:31:34.655751 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6355e463-bb96-4458-8407-fdec9fce9722 admin admin] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:31:34.656213 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6355e463-bb96-4458-8407-fdec9fce9722 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:31:34.656496 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6355e463-bb96-4458-8407-fdec9fce9722 admin admin] PATH_INFO: `/v3/projects` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:31:34.657203 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6355e463-bb96-4458-8407-fdec9fce9722 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:31:34.660432 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6355e463-bb96-4458-8407-fdec9fce9722 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:31:34.756350 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1347/2694] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 16 17:31:34 2022] POST /identity/v3/projects => generated 373 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:31:34.762163 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ed4b5c-f717-4f72-8935-5cb26259b02c None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:31:34.780368 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ed4b5c-f717-4f72-8935-5cb26259b02c None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:31:34.852820 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602abd3e-a232-4637-a2f2-b73f8e230271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:31:34.853667 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602abd3e-a232-4637-a2f2-b73f8e230271 admin admin] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:31:34.854073 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602abd3e-a232-4637-a2f2-b73f8e230271 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:31:34.855031 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602abd3e-a232-4637-a2f2-b73f8e230271 admin admin] PATH_INFO: `/v3/users` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:31:34.855792 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602abd3e-a232-4637-a2f2-b73f8e230271 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:31:34.857843 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602abd3e-a232-4637-a2f2-b73f8e230271 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:31:34.924056 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1348/2695] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 16 17:31:34 2022] POST /identity/v3/users => generated 293 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 17:31:34.927633 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6355e463-bb96-4458-8407-fdec9fce9722 admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:31:34.933914 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:31:34.941095 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6355e463-bb96-4458-8407-fdec9fce9722 admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:31:34.944406 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483af5cf-5b61-4100-a9bb-685051e2936b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:31:34.945084 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483af5cf-5b61-4100-a9bb-685051e2936b admin admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:31:34.945372 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483af5cf-5b61-4100-a9bb-685051e2936b admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:31:34.945651 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483af5cf-5b61-4100-a9bb-685051e2936b admin admin] PATH_INFO: `/v3/roles` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:31:34.946425 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483af5cf-5b61-4100-a9bb-685051e2936b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:31:34.948574 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483af5cf-5b61-4100-a9bb-685051e2936b admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:31:34.964087 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1348/2696] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 17:31:34 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:31:34.967983 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602abd3e-a232-4637-a2f2-b73f8e230271 admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:31:34.982314 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602abd3e-a232-4637-a2f2-b73f8e230271 admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:31:34.988097 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63961755-0234-46ef-b1d5-4810595d79ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:31:34.989338 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63961755-0234-46ef-b1d5-4810595d79ac admin admin] REQUEST_METHOD: `PUT` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:31:34.989864 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63961755-0234-46ef-b1d5-4810595d79ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:31:34.990602 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63961755-0234-46ef-b1d5-4810595d79ac admin admin] PATH_INFO: `/v3/projects/d4d845b22b4c4eafa29ea6b33dd8a0d9/users/e5e79a1a2d5f497e9db829c5577cabab/roles/dba744f8ab2a4c45b9d3212f8d203aba` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:31:35.021072 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63961755-0234-46ef-b1d5-4810595d79ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4d845b22b4c4eafa29ea6b33dd8a0d9, user_id=e5e79a1a2d5f497e9db829c5577cabab, role_id=dba744f8ab2a4c45b9d3212f8d203aba)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:31:35.021072 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63961755-0234-46ef-b1d5-4810595d79ac admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:31:35.092405 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1349/2697] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 17:31:34 2022] PUT /identity/v3/projects/d4d845b22b4c4eafa29ea6b33dd8a0d9/users/e5e79a1a2d5f497e9db829c5577cabab/roles/dba744f8ab2a4c45b9d3212f8d203aba => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:31:35.096381 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483af5cf-5b61-4100-a9bb-685051e2936b admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:31:35.110507 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483af5cf-5b61-4100-a9bb-685051e2936b admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:31:35.184501 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b72b380-f093-4627-a559-08e7bc211234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:31:35.185229 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b72b380-f093-4627-a559-08e7bc211234 admin admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:31:35.185518 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b72b380-f093-4627-a559-08e7bc211234 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:31:35.185828 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b72b380-f093-4627-a559-08e7bc211234 admin admin] PATH_INFO: `/v3/roles` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:31:35.186568 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b72b380-f093-4627-a559-08e7bc211234 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:31:35.188175 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b72b380-f093-4627-a559-08e7bc211234 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:31:35.203311 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1349/2698] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 17:31:35 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:31:35.207174 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63961755-0234-46ef-b1d5-4810595d79ac admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:31:35.221378 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63961755-0234-46ef-b1d5-4810595d79ac admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:31:35.226526 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dd66ce-a2a2-4226-a85d-05d3cfd2335d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:31:35.227443 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dd66ce-a2a2-4226-a85d-05d3cfd2335d admin admin] REQUEST_METHOD: `PUT` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:31:35.227717 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dd66ce-a2a2-4226-a85d-05d3cfd2335d admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:31:35.228001 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dd66ce-a2a2-4226-a85d-05d3cfd2335d admin admin] PATH_INFO: `/v3/projects/d4d845b22b4c4eafa29ea6b33dd8a0d9/users/e5e79a1a2d5f497e9db829c5577cabab/roles/dba744f8ab2a4c45b9d3212f8d203aba` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:31:35.230796 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dd66ce-a2a2-4226-a85d-05d3cfd2335d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4d845b22b4c4eafa29ea6b33dd8a0d9, user_id=e5e79a1a2d5f497e9db829c5577cabab, role_id=dba744f8ab2a4c45b9d3212f8d203aba)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:31:35.233791 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dd66ce-a2a2-4226-a85d-05d3cfd2335d admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:31:35.246301 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1350/2699] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 17:31:35 2022] PUT /identity/v3/projects/d4d845b22b4c4eafa29ea6b33dd8a0d9/users/e5e79a1a2d5f497e9db829c5577cabab/roles/dba744f8ab2a4c45b9d3212f8d203aba => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:31:36.657824 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5075e4-65c5-407e-be25-c4fc39bf6d98 None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:31:36.658497 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5075e4-65c5-407e-be25-c4fc39bf6d98 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:31:36.658647 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5075e4-65c5-407e-be25-c4fc39bf6d98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:31:36.704270 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-ed5075e4-65c5-407e-be25-c4fc39bf6d98 None None] MFA Rules not processed for user `e5e79a1a2d5f497e9db829c5577cabab`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:31:36.706223 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-ed5075e4-65c5-407e-be25-c4fc39bf6d98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:31:36.823709 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1350/2700] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:31:36 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:31:36.834315 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3a84e9-2329-41ef-bcb0-fa42bc0b0783 None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:31:36.835214 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3a84e9-2329-41ef-bcb0-fa42bc0b0783 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:31:36.835506 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3a84e9-2329-41ef-bcb0-fa42bc0b0783 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:31:36.855315 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-3a3a84e9-2329-41ef-bcb0-fa42bc0b0783 None None] MFA Rules not processed for user `beb349379d1e479c8756f5aafbc3de38`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:31:36.856526 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-3a3a84e9-2329-41ef-bcb0-fa42bc0b0783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:31:36.951909 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1351/2701] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:31:36 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:31:36.963583 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5075e4-65c5-407e-be25-c4fc39bf6d98 None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:31:36.965027 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-ed5075e4-65c5-407e-be25-c4fc39bf6d98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:31:37.055455 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5075e4-65c5-407e-be25-c4fc39bf6d98 None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:31:37.061770 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c49cc2-dfdc-48c0-b918-86c0d7c891d9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d381bb41dea4f1e90c3cf3815ac88dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:31:37.062452 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c49cc2-dfdc-48c0-b918-86c0d7c891d9 service nova] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:31:37.062743 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c49cc2-dfdc-48c0-b918-86c0d7c891d9 service nova] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:31:37.063028 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c49cc2-dfdc-48c0-b918-86c0d7c891d9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:31:37.072679 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c49cc2-dfdc-48c0-b918-86c0d7c891d9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:31:37.074359 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c49cc2-dfdc-48c0-b918-86c0d7c891d9 service nova] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:31:37.078494 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=100 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:31:37.085699 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1351/2702] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:31:36 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:31:37.383732 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3a84e9-2329-41ef-bcb0-fa42bc0b0783 None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:31:37.383732 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-3a3a84e9-2329-41ef-bcb0-fa42bc0b0783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:31:37.403881 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:31:37.435913 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3a84e9-2329-41ef-bcb0-fa42bc0b0783 None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:31:37.440235 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a97bd73-8777-41ff-908a-ed006c809a11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5d25bfa8dc042329d57cd55fa7b7b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:31:37.440890 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a97bd73-8777-41ff-908a-ed006c809a11 service neutron] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:31:37.441180 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a97bd73-8777-41ff-908a-ed006c809a11 service neutron] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:31:37.441486 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a97bd73-8777-41ff-908a-ed006c809a11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:31:37.443619 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-1a97bd73-8777-41ff-908a-ed006c809a11 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:31:37.458736 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a97bd73-8777-41ff-908a-ed006c809a11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:31:37.460177 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a97bd73-8777-41ff-908a-ed006c809a11 service neutron] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:31:37.469831 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1352/2703] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:31:37 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 17:31:37.909626 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c49cc2-dfdc-48c0-b918-86c0d7c891d9 service nova] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:31:37.914391 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-99c49cc2-dfdc-48c0-b918-86c0d7c891d9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:31:38.012032 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c49cc2-dfdc-48c0-b918-86c0d7c891d9 service nova] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:31:38.021062 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530c0440-33fd-4df7-9d8c-a9b47dad80c6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2882f26811094d8e88c03701c94296fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:31:38.021738 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530c0440-33fd-4df7-9d8c-a9b47dad80c6 service placement] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:31:38.022062 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530c0440-33fd-4df7-9d8c-a9b47dad80c6 service placement] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:31:38.022347 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530c0440-33fd-4df7-9d8c-a9b47dad80c6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:31:38.026522 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-530c0440-33fd-4df7-9d8c-a9b47dad80c6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:31:38.039860 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530c0440-33fd-4df7-9d8c-a9b47dad80c6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:31:38.042245 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530c0440-33fd-4df7-9d8c-a9b47dad80c6 service placement] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:31:38.060803 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1352/2704] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:31:37 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:31:44.796194 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa5882a-2394-4b89-892d-1831a9ec8aea None None] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:31:44.796697 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa5882a-2394-4b89-892d-1831a9ec8aea None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:31:44.796841 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa5882a-2394-4b89-892d-1831a9ec8aea None None] PATH_INFO: `/` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:31:44.798361 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1353/2705] 10.222.0.39 () {54 vars in 921 bytes} [Thu Jun 16 17:31:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:31:44.807305 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7058aa5d-9413-4bd4-abca-e28fb61794fe None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:31:44.807884 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7058aa5d-9413-4bd4-abca-e28fb61794fe None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:31:44.807980 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7058aa5d-9413-4bd4-abca-e28fb61794fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:31:44.853027 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-7058aa5d-9413-4bd4-abca-e28fb61794fe None None] MFA Rules not processed for user `3d381bb41dea4f1e90c3cf3815ac88dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:31:44.854381 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-7058aa5d-9413-4bd4-abca-e28fb61794fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:31:44.871980 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1353/2706] 10.222.0.39 () {58 vars in 1018 bytes} [Thu Jun 16 17:31:44 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:31:44.877069 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa5882a-2394-4b89-892d-1831a9ec8aea None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:31:44.878836 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-efa5882a-2394-4b89-892d-1831a9ec8aea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:31:44.945321 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa5882a-2394-4b89-892d-1831a9ec8aea None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:31:44.949623 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5943fc-d0a3-41f5-b779-8169127da3b3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3985eae1ec3240129eec8d1f4d8d21e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:31:44.955349 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5943fc-d0a3-41f5-b779-8169127da3b3 service glance] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:31:44.955349 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5943fc-d0a3-41f5-b779-8169127da3b3 service glance] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:31:44.955349 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5943fc-d0a3-41f5-b779-8169127da3b3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:31:44.961297 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5943fc-d0a3-41f5-b779-8169127da3b3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:31:44.962837 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5943fc-d0a3-41f5-b779-8169127da3b3 service glance] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:31:44.973521 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1354/2707] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:31:44 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:31:45.124746 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846d95bc-f7f8-4dad-ac7f-fc3f49d5b889 None None] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:31:45.125042 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846d95bc-f7f8-4dad-ac7f-fc3f49d5b889 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:31:45.125384 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846d95bc-f7f8-4dad-ac7f-fc3f49d5b889 None None] PATH_INFO: `/` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:31:45.126938 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1354/2708] 10.222.0.39 () {54 vars in 921 bytes} [Thu Jun 16 17:31:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:31:45.131686 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221be023-d792-4bc5-a1a5-cb9c69a14aee None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:31:45.132135 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221be023-d792-4bc5-a1a5-cb9c69a14aee None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:31:45.132311 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221be023-d792-4bc5-a1a5-cb9c69a14aee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:31:45.151195 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-221be023-d792-4bc5-a1a5-cb9c69a14aee None None] MFA Rules not processed for user `b5d25bfa8dc042329d57cd55fa7b7b23`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:31:45.152462 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-221be023-d792-4bc5-a1a5-cb9c69a14aee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:31:45.159280 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1355/2709] 10.222.0.39 () {58 vars in 1018 bytes} [Thu Jun 16 17:31:45 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:31:45.171828 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846d95bc-f7f8-4dad-ac7f-fc3f49d5b889 None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:31:45.183815 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846d95bc-f7f8-4dad-ac7f-fc3f49d5b889 None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:31:45.187387 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0b6ef1-ce91-490b-a53b-2be5c06dd6e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5d25bfa8dc042329d57cd55fa7b7b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:31:45.188022 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0b6ef1-ce91-490b-a53b-2be5c06dd6e6 service neutron] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:31:45.188336 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0b6ef1-ce91-490b-a53b-2be5c06dd6e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:31:45.188612 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0b6ef1-ce91-490b-a53b-2be5c06dd6e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:31:45.196413 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0b6ef1-ce91-490b-a53b-2be5c06dd6e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:31:45.197826 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0b6ef1-ce91-490b-a53b-2be5c06dd6e6 service neutron] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:31:45.205725 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1355/2710] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:31:45 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:31:45.292331 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2194dbb1-f98f-4a1d-93f6-71390e576e48 None None] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:31:45.292699 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2194dbb1-f98f-4a1d-93f6-71390e576e48 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:31:45.292992 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2194dbb1-f98f-4a1d-93f6-71390e576e48 None None] PATH_INFO: `/` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:31:45.294414 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1356/2711] 10.222.0.39 () {54 vars in 921 bytes} [Thu Jun 16 17:31:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:31:45.299511 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb58aec-1a09-4d21-b472-79f9872cae79 None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:31:45.299806 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb58aec-1a09-4d21-b472-79f9872cae79 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:31:45.300128 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb58aec-1a09-4d21-b472-79f9872cae79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:31:45.319019 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-bbb58aec-1a09-4d21-b472-79f9872cae79 None None] MFA Rules not processed for user `3d381bb41dea4f1e90c3cf3815ac88dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:31:45.320215 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-bbb58aec-1a09-4d21-b472-79f9872cae79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:31:45.329578 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1356/2712] 10.222.0.39 () {58 vars in 1018 bytes} [Thu Jun 16 17:31:45 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:31:45.339731 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2194dbb1-f98f-4a1d-93f6-71390e576e48 None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:31:45.350891 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2194dbb1-f98f-4a1d-93f6-71390e576e48 None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:31:45.355170 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9499806b-065f-49b0-ba88-5cc136a04fde service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5d25bfa8dc042329d57cd55fa7b7b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:31:45.355812 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9499806b-065f-49b0-ba88-5cc136a04fde service neutron] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:31:45.356101 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9499806b-065f-49b0-ba88-5cc136a04fde service neutron] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:31:45.356383 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9499806b-065f-49b0-ba88-5cc136a04fde service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:31:45.366797 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9499806b-065f-49b0-ba88-5cc136a04fde service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:31:45.368222 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9499806b-065f-49b0-ba88-5cc136a04fde service neutron] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:31:45.379428 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1357/2713] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:31:45 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:31:48.665819 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445d6bd0-03e8-4ce5-b727-dc0c6ed9821c None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:31:48.666396 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445d6bd0-03e8-4ce5-b727-dc0c6ed9821c None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:31:48.666396 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445d6bd0-03e8-4ce5-b727-dc0c6ed9821c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:31:48.684550 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-445d6bd0-03e8-4ce5-b727-dc0c6ed9821c None None] MFA Rules not processed for user `f7f35c1c15a84a92863d4f3f96d76830`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:31:48.685774 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-445d6bd0-03e8-4ce5-b727-dc0c6ed9821c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:31:48.745299 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1357/2714] 10.222.0.39 () {58 vars in 1009 bytes} [Thu Jun 16 17:31:48 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:31:48.757225 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9499806b-065f-49b0-ba88-5cc136a04fde service neutron] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:31:48.760013 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-9499806b-065f-49b0-ba88-5cc136a04fde service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:31:48.832745 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9499806b-065f-49b0-ba88-5cc136a04fde service neutron] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:31:48.838580 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b2221f-4b90-48ea-ad15-d98918aadc19 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbec2dfe63764ed88a23e172ead0afa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:31:48.839237 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b2221f-4b90-48ea-ad15-d98918aadc19 service swift] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:31:48.839531 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b2221f-4b90-48ea-ad15-d98918aadc19 service swift] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:31:48.839849 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b2221f-4b90-48ea-ad15-d98918aadc19 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:31:48.848431 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b2221f-4b90-48ea-ad15-d98918aadc19 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:31:48.850031 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b2221f-4b90-48ea-ad15-d98918aadc19 service swift] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:31:48.859438 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1358/2715] 10.222.0.39 () {60 vars in 1384 bytes} [Thu Jun 16 17:31:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 17:31:58.735602 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=76 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:31:58.855706 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=82 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:32:01.486854 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445d6bd0-03e8-4ce5-b727-dc0c6ed9821c None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:32:01.488275 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-445d6bd0-03e8-4ce5-b727-dc0c6ed9821c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:32:01.546676 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445d6bd0-03e8-4ce5-b727-dc0c6ed9821c None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:32:01.550541 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db20d38d-ceb7-4dfe-b8d7-fe2b913b3c69 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef37136b89d34edc9cd94c7aa81b2095', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:32:01.551228 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db20d38d-ceb7-4dfe-b8d7-fe2b913b3c69 service cinder] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:32:01.551564 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db20d38d-ceb7-4dfe-b8d7-fe2b913b3c69 service cinder] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:32:01.551813 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db20d38d-ceb7-4dfe-b8d7-fe2b913b3c69 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:32:01.562096 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db20d38d-ceb7-4dfe-b8d7-fe2b913b3c69 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:32:01.563549 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db20d38d-ceb7-4dfe-b8d7-fe2b913b3c69 service cinder] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:32:01.574199 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1358/2716] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:32:01 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:32:05.317376 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7b72cb-4e32-4de2-b727-0165b415be69 None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:32:05.318189 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7b72cb-4e32-4de2-b727-0165b415be69 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:32:05.318323 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7b72cb-4e32-4de2-b727-0165b415be69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:32:05.336273 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-7e7b72cb-4e32-4de2-b727-0165b415be69 None None] MFA Rules not processed for user `f7f35c1c15a84a92863d4f3f96d76830`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:32:05.338373 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-7e7b72cb-4e32-4de2-b727-0165b415be69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:32:05.345854 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1359/2717] 10.222.0.39 () {58 vars in 967 bytes} [Thu Jun 16 17:32:05 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:32:05.358627 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db20d38d-ceb7-4dfe-b8d7-fe2b913b3c69 service cinder] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:32:05.370204 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db20d38d-ceb7-4dfe-b8d7-fe2b913b3c69 service cinder] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:32:05.375179 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb213ab-9f70-4412-9829-3e8bab3e3449 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbec2dfe63764ed88a23e172ead0afa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:32:05.375822 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb213ab-9f70-4412-9829-3e8bab3e3449 service swift] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:32:05.376255 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb213ab-9f70-4412-9829-3e8bab3e3449 service swift] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:32:05.376540 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb213ab-9f70-4412-9829-3e8bab3e3449 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:32:05.384981 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb213ab-9f70-4412-9829-3e8bab3e3449 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:32:05.386590 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb213ab-9f70-4412-9829-3e8bab3e3449 service swift] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:32:05.394878 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1359/2718] 10.222.0.39 () {60 vars in 1384 bytes} [Thu Jun 16 17:32:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 17:32:15.331300 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=3 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:32:15.391571 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=32 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:32:25.629461 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7b72cb-4e32-4de2-b727-0165b415be69 None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:32:25.631077 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-7e7b72cb-4e32-4de2-b727-0165b415be69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:32:25.646827 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7b72cb-4e32-4de2-b727-0165b415be69 None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:32:25.652813 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a31889a-54c7-492e-8dd4-c1ccc72939ce service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2882f26811094d8e88c03701c94296fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:32:25.653499 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a31889a-54c7-492e-8dd4-c1ccc72939ce service placement] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:32:25.653816 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a31889a-54c7-492e-8dd4-c1ccc72939ce service placement] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:32:25.654107 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a31889a-54c7-492e-8dd4-c1ccc72939ce service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:32:25.655926 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-7a31889a-54c7-492e-8dd4-c1ccc72939ce service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:32:25.668135 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a31889a-54c7-492e-8dd4-c1ccc72939ce service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:32:25.669728 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a31889a-54c7-492e-8dd4-c1ccc72939ce service placement] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:32:25.679954 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1360/2719] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:32:25 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:32:25.750152 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb213ab-9f70-4412-9829-3e8bab3e3449 service swift] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:32:25.815038 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb213ab-9f70-4412-9829-3e8bab3e3449 service swift] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:32:25.820044 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a83b49-ee53-4158-aa0c-b292acfc910b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:32:25.820920 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a83b49-ee53-4158-aa0c-b292acfc910b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:32:25.821209 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a83b49-ee53-4158-aa0c-b292acfc910b admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:32:25.822022 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a83b49-ee53-4158-aa0c-b292acfc910b admin admin] PATH_INFO: `/v3/users/beb349379d1e479c8756f5aafbc3de38` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:32:25.823236 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a83b49-ee53-4158-aa0c-b292acfc910b admin admin] RBAC: Authorizing `identity:delete_user(user_id=beb349379d1e479c8756f5aafbc3de38)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:32:25.825153 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a83b49-ee53-4158-aa0c-b292acfc910b admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:32:26.040238 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-f9a83b49-ee53-4158-aa0c-b292acfc910b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'beb349379d1e479c8756f5aafbc3de38'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:32:26.040823 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-f9a83b49-ee53-4158-aa0c-b292acfc910b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'beb349379d1e479c8756f5aafbc3de38'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:32:26.041426 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-f9a83b49-ee53-4158-aa0c-b292acfc910b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'beb349379d1e479c8756f5aafbc3de38'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:32:26.098310 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-f9a83b49-ee53-4158-aa0c-b292acfc910b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'beb349379d1e479c8756f5aafbc3de38'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:32:26.106236 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-f9a83b49-ee53-4158-aa0c-b292acfc910b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'beb349379d1e479c8756f5aafbc3de38'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:32:26.124411 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1360/2720] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 16 17:32:25 2022] DELETE /identity/v3/users/beb349379d1e479c8756f5aafbc3de38 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:32:26.397004 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a31889a-54c7-492e-8dd4-c1ccc72939ce service placement] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:32:26.410367 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a31889a-54c7-492e-8dd4-c1ccc72939ce service placement] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:32:26.471388 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd6cda0-81cf-4413-890f-4f2f47d9a0c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:32:26.472262 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd6cda0-81cf-4413-890f-4f2f47d9a0c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:32:26.472552 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd6cda0-81cf-4413-890f-4f2f47d9a0c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:32:26.472838 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd6cda0-81cf-4413-890f-4f2f47d9a0c6 admin admin] PATH_INFO: `/v3/projects/c90a9a67d3dc4d4fb5abd94d30663f6a` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:32:26.474091 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd6cda0-81cf-4413-890f-4f2f47d9a0c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c90a9a67d3dc4d4fb5abd94d30663f6a)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:32:26.476014 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd6cda0-81cf-4413-890f-4f2f47d9a0c6 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:32:26.595831 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-abd6cda0-81cf-4413-890f-4f2f47d9a0c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c90a9a67d3dc4d4fb5abd94d30663f6a', 'request_id': 'req-abd6cda0-81cf-4413-890f-4f2f47d9a0c6'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:32:26.601443 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-abd6cda0-81cf-4413-890f-4f2f47d9a0c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c90a9a67d3dc4d4fb5abd94d30663f6a', 'request_id': 'req-abd6cda0-81cf-4413-890f-4f2f47d9a0c6'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:32:26.669821 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-abd6cda0-81cf-4413-890f-4f2f47d9a0c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c90a9a67d3dc4d4fb5abd94d30663f6a', 'request_id': 'req-abd6cda0-81cf-4413-890f-4f2f47d9a0c6'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:32:26.689032 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-abd6cda0-81cf-4413-890f-4f2f47d9a0c6 admin admin] The token cache is being invalidate because project c90a9a67d3dc4d4fb5abd94d30663f6a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80874) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 17:32:26.689348 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-abd6cda0-81cf-4413-890f-4f2f47d9a0c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:32:26.690045 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-abd6cda0-81cf-4413-890f-4f2f47d9a0c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:32:26.691739 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1361/2721] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 16 17:32:26 2022] DELETE /identity/v3/projects/c90a9a67d3dc4d4fb5abd94d30663f6a => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:32:26.696485 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a83b49-ee53-4158-aa0c-b292acfc910b admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:32:26.698347 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-f9a83b49-ee53-4158-aa0c-b292acfc910b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:32:26.714318 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a83b49-ee53-4158-aa0c-b292acfc910b admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:32:26.770548 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb0d9fa-2c9e-42e4-9b86-deada59295b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:32:26.771477 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb0d9fa-2c9e-42e4-9b86-deada59295b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:32:26.771822 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb0d9fa-2c9e-42e4-9b86-deada59295b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:32:26.772152 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb0d9fa-2c9e-42e4-9b86-deada59295b3 admin admin] PATH_INFO: `/v3/users/e5e79a1a2d5f497e9db829c5577cabab` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:32:26.773342 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb0d9fa-2c9e-42e4-9b86-deada59295b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5e79a1a2d5f497e9db829c5577cabab)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:32:26.775896 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb0d9fa-2c9e-42e4-9b86-deada59295b3 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:32:26.797675 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:32:26.957852 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-6eb0d9fa-2c9e-42e4-9b86-deada59295b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5e79a1a2d5f497e9db829c5577cabab'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:32:26.958443 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-6eb0d9fa-2c9e-42e4-9b86-deada59295b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5e79a1a2d5f497e9db829c5577cabab'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:32:26.959052 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-6eb0d9fa-2c9e-42e4-9b86-deada59295b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5e79a1a2d5f497e9db829c5577cabab'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:32:27.029786 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-6eb0d9fa-2c9e-42e4-9b86-deada59295b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5e79a1a2d5f497e9db829c5577cabab'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:32:27.038172 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-6eb0d9fa-2c9e-42e4-9b86-deada59295b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5e79a1a2d5f497e9db829c5577cabab'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:32:27.057440 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1361/2722] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 16 17:32:26 2022] DELETE /identity/v3/users/e5e79a1a2d5f497e9db829c5577cabab => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 17:32:27.299999 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd6cda0-81cf-4413-890f-4f2f47d9a0c6 admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:32:27.301490 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-abd6cda0-81cf-4413-890f-4f2f47d9a0c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:32:27.314921 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd6cda0-81cf-4413-890f-4f2f47d9a0c6 admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:32:27.375332 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1d7bb4-5f16-4d92-825b-50005c653335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:32:27.376203 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1d7bb4-5f16-4d92-825b-50005c653335 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:32:27.376496 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1d7bb4-5f16-4d92-825b-50005c653335 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:32:27.376781 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1d7bb4-5f16-4d92-825b-50005c653335 admin admin] PATH_INFO: `/v3/projects/d4d845b22b4c4eafa29ea6b33dd8a0d9` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:32:27.378018 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1d7bb4-5f16-4d92-825b-50005c653335 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4d845b22b4c4eafa29ea6b33dd8a0d9)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:32:27.379945 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1d7bb4-5f16-4d92-825b-50005c653335 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:32:27.401632 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:32:27.504824 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-9b1d7bb4-5f16-4d92-825b-50005c653335 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4d845b22b4c4eafa29ea6b33dd8a0d9', 'request_id': 'req-9b1d7bb4-5f16-4d92-825b-50005c653335'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:32:27.510729 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-9b1d7bb4-5f16-4d92-825b-50005c653335 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4d845b22b4c4eafa29ea6b33dd8a0d9', 'request_id': 'req-9b1d7bb4-5f16-4d92-825b-50005c653335'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:32:27.583722 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-9b1d7bb4-5f16-4d92-825b-50005c653335 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4d845b22b4c4eafa29ea6b33dd8a0d9', 'request_id': 'req-9b1d7bb4-5f16-4d92-825b-50005c653335'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:32:27.596919 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-9b1d7bb4-5f16-4d92-825b-50005c653335 admin admin] The token cache is being invalidate because project d4d845b22b4c4eafa29ea6b33dd8a0d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80874) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 17:32:27.597205 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-9b1d7bb4-5f16-4d92-825b-50005c653335 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:32:27.597879 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-9b1d7bb4-5f16-4d92-825b-50005c653335 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:32:27.599510 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1362/2723] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 16 17:32:27 2022] DELETE /identity/v3/projects/d4d845b22b4c4eafa29ea6b33dd8a0d9 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:32:27.604747 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c6200c-1d47-4dbf-b423-769e601028ba None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:32:27.605040 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c6200c-1d47-4dbf-b423-769e601028ba None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:32:27.605402 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c6200c-1d47-4dbf-b423-769e601028ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:32:27.623776 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-83c6200c-1d47-4dbf-b423-769e601028ba None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:32:27.624990 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-83c6200c-1d47-4dbf-b423-769e601028ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:32:27.685216 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1362/2724] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:32:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 17:32:27.693486 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d62c2b-d206-4d44-8cc9-1faf6213aea0 None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:32:27.694016 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d62c2b-d206-4d44-8cc9-1faf6213aea0 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:32:27.694154 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d62c2b-d206-4d44-8cc9-1faf6213aea0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:32:27.712946 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-45d62c2b-d206-4d44-8cc9-1faf6213aea0 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:32:27.714190 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-45d62c2b-d206-4d44-8cc9-1faf6213aea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:32:27.722244 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1363/2725] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:32:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:32:27.726483 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c6200c-1d47-4dbf-b423-769e601028ba None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:32:27.736511 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c6200c-1d47-4dbf-b423-769e601028ba None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:32:27.741292 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c452468c-965c-4fff-90dc-617f50273478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:32:27.741985 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c452468c-965c-4fff-90dc-617f50273478 admin admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:32:27.742275 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c452468c-965c-4fff-90dc-617f50273478 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:32:27.742565 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c452468c-965c-4fff-90dc-617f50273478 admin admin] PATH_INFO: `/v3/domains` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:32:27.743805 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c452468c-965c-4fff-90dc-617f50273478 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80873) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:32:27.744118 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c452468c-965c-4fff-90dc-617f50273478 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:32:27.745741 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c452468c-965c-4fff-90dc-617f50273478 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:32:27.757260 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1363/2726] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 16 17:32:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:32:27.762120 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d62c2b-d206-4d44-8cc9-1faf6213aea0 None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:32:27.771423 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d62c2b-d206-4d44-8cc9-1faf6213aea0 None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:32:27.776198 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83686ab-7d3f-4578-b945-41905b7d713c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:32:27.776847 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83686ab-7d3f-4578-b945-41905b7d713c admin admin] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:32:27.777136 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83686ab-7d3f-4578-b945-41905b7d713c admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:32:27.777418 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83686ab-7d3f-4578-b945-41905b7d713c admin admin] PATH_INFO: `/v3/projects` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:32:27.778157 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83686ab-7d3f-4578-b945-41905b7d713c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:32:27.780041 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83686ab-7d3f-4578-b945-41905b7d713c admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:32:27.882511 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1364/2727] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 16 17:32:27 2022] POST /identity/v3/projects => generated 373 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:32:27.891911 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c452468c-965c-4fff-90dc-617f50273478 admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:32:27.902650 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c452468c-965c-4fff-90dc-617f50273478 admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:32:27.959523 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196fca5b-159e-4eff-ac7b-3f9b14a2457a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:32:27.960193 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196fca5b-159e-4eff-ac7b-3f9b14a2457a admin admin] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:32:27.960478 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196fca5b-159e-4eff-ac7b-3f9b14a2457a admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:32:27.960755 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196fca5b-159e-4eff-ac7b-3f9b14a2457a admin admin] PATH_INFO: `/v3/users` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:32:27.961447 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196fca5b-159e-4eff-ac7b-3f9b14a2457a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:32:27.963389 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196fca5b-159e-4eff-ac7b-3f9b14a2457a admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:32:28.031642 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1364/2728] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 16 17:32:27 2022] POST /identity/v3/users => generated 287 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:32:28.037173 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83686ab-7d3f-4578-b945-41905b7d713c admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:32:28.049340 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83686ab-7d3f-4578-b945-41905b7d713c admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:32:28.054272 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e021685-cc19-4162-a0ae-f509301b1300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:32:28.054939 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e021685-cc19-4162-a0ae-f509301b1300 admin admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:32:28.055223 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e021685-cc19-4162-a0ae-f509301b1300 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:32:28.055501 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e021685-cc19-4162-a0ae-f509301b1300 admin admin] PATH_INFO: `/v3/roles` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:32:28.056881 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e021685-cc19-4162-a0ae-f509301b1300 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:32:28.058496 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e021685-cc19-4162-a0ae-f509301b1300 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:32:28.069313 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1365/2729] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 17:32:28 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:32:28.073338 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196fca5b-159e-4eff-ac7b-3f9b14a2457a admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:32:28.083290 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196fca5b-159e-4eff-ac7b-3f9b14a2457a admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:32:28.088007 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4844906e-51ad-49ea-be87-f719bb450949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:32:28.088662 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4844906e-51ad-49ea-be87-f719bb450949 admin admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:32:28.088948 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4844906e-51ad-49ea-be87-f719bb450949 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:32:28.089229 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4844906e-51ad-49ea-be87-f719bb450949 admin admin] PATH_INFO: `/v3/roles` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:32:28.089990 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4844906e-51ad-49ea-be87-f719bb450949 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:32:28.091565 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4844906e-51ad-49ea-be87-f719bb450949 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:32:28.101716 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1365/2730] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 17:32:28 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:32:28.106323 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e021685-cc19-4162-a0ae-f509301b1300 admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:32:28.116525 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e021685-cc19-4162-a0ae-f509301b1300 admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:32:28.121808 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92186cb-4116-408d-b10c-726daf72d818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:32:28.122691 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92186cb-4116-408d-b10c-726daf72d818 admin admin] REQUEST_METHOD: `PUT` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:32:28.122981 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92186cb-4116-408d-b10c-726daf72d818 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:32:28.123265 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92186cb-4116-408d-b10c-726daf72d818 admin admin] PATH_INFO: `/v3/projects/3ba82a35492e408e9c021b2eb9dba83d/users/ce7b7d0d12ef45f896f84233ee7ef519/roles/896bff49c5d6464eb612a15f4aa9badc` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:32:28.138897 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92186cb-4116-408d-b10c-726daf72d818 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ba82a35492e408e9c021b2eb9dba83d, user_id=ce7b7d0d12ef45f896f84233ee7ef519, role_id=896bff49c5d6464eb612a15f4aa9badc)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:32:28.141519 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92186cb-4116-408d-b10c-726daf72d818 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:32:28.196154 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1366/2731] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 17:32:28 2022] PUT /identity/v3/projects/3ba82a35492e408e9c021b2eb9dba83d/users/ce7b7d0d12ef45f896f84233ee7ef519/roles/896bff49c5d6464eb612a15f4aa9badc => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 17:32:28.201844 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ceac52-ae8c-4b33-af09-e61f25a10590 None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:32:28.202145 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ceac52-ae8c-4b33-af09-e61f25a10590 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:32:28.202433 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ceac52-ae8c-4b33-af09-e61f25a10590 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:32:28.209589 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:32:28.221658 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-90ceac52-ae8c-4b33-af09-e61f25a10590 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:32:28.222983 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-90ceac52-ae8c-4b33-af09-e61f25a10590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:32:28.283981 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1366/2732] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:32:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:32:28.294249 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92186cb-4116-408d-b10c-726daf72d818 admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:32:28.295935 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-e92186cb-4116-408d-b10c-726daf72d818 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:32:28.360936 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92186cb-4116-408d-b10c-726daf72d818 admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:32:28.365332 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad09fa46-717c-4f5a-b45d-b089cf97e1ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5d25bfa8dc042329d57cd55fa7b7b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:32:28.366019 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad09fa46-717c-4f5a-b45d-b089cf97e1ca service neutron] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:32:28.366311 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad09fa46-717c-4f5a-b45d-b089cf97e1ca service neutron] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:32:28.366590 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad09fa46-717c-4f5a-b45d-b089cf97e1ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:32:28.375828 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad09fa46-717c-4f5a-b45d-b089cf97e1ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:32:28.377273 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad09fa46-717c-4f5a-b45d-b089cf97e1ca service neutron] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:32:28.386813 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1367/2733] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:32:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:32:33.525578 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d4afb2-73f3-458a-90c5-18579cd5cb89 None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:32:33.527205 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d4afb2-73f3-458a-90c5-18579cd5cb89 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:32:33.527205 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d4afb2-73f3-458a-90c5-18579cd5cb89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:32:33.556593 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-44d4afb2-73f3-458a-90c5-18579cd5cb89 None None] MFA Rules not processed for user `ce7b7d0d12ef45f896f84233ee7ef519`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:32:33.557928 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-44d4afb2-73f3-458a-90c5-18579cd5cb89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:32:33.630858 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1367/2734] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:32:33 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:32:33.631912 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad09fa46-717c-4f5a-b45d-b089cf97e1ca service neutron] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:32:33.642456 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad09fa46-717c-4f5a-b45d-b089cf97e1ca service neutron] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:32:33.647431 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e6d6e7-393e-4cab-a489-4b4c96d5742c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:32:33.648100 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e6d6e7-393e-4cab-a489-4b4c96d5742c admin admin] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:32:33.648389 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e6d6e7-393e-4cab-a489-4b4c96d5742c admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:32:33.648669 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e6d6e7-393e-4cab-a489-4b4c96d5742c admin admin] PATH_INFO: `/v3/projects` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:32:33.649975 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e6d6e7-393e-4cab-a489-4b4c96d5742c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:32:33.652075 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e6d6e7-393e-4cab-a489-4b4c96d5742c admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:32:33.740598 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1368/2735] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 16 17:32:33 2022] POST /identity/v3/projects => generated 373 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:32:33.744510 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d4afb2-73f3-458a-90c5-18579cd5cb89 None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:32:33.755448 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d4afb2-73f3-458a-90c5-18579cd5cb89 None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:32:33.815480 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6b1944-000c-4aeb-8037-9e46643554db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:32:33.816174 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6b1944-000c-4aeb-8037-9e46643554db admin admin] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:32:33.816463 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6b1944-000c-4aeb-8037-9e46643554db admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:32:33.816746 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6b1944-000c-4aeb-8037-9e46643554db admin admin] PATH_INFO: `/v3/users` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:32:33.817715 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6b1944-000c-4aeb-8037-9e46643554db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:32:33.819717 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6b1944-000c-4aeb-8037-9e46643554db admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:32:33.927380 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1368/2736] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 16 17:32:33 2022] POST /identity/v3/users => generated 293 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:32:33.928683 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e6d6e7-393e-4cab-a489-4b4c96d5742c admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:32:33.940391 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e6d6e7-393e-4cab-a489-4b4c96d5742c admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:32:33.945343 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfb4450-5c02-44d6-b7b9-c5be9fa53023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:32:33.946035 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfb4450-5c02-44d6-b7b9-c5be9fa53023 admin admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:32:33.946322 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfb4450-5c02-44d6-b7b9-c5be9fa53023 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:32:33.946603 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfb4450-5c02-44d6-b7b9-c5be9fa53023 admin admin] PATH_INFO: `/v3/roles` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:32:33.947328 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfb4450-5c02-44d6-b7b9-c5be9fa53023 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:32:33.948907 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfb4450-5c02-44d6-b7b9-c5be9fa53023 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:32:33.959866 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1369/2737] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 17:32:33 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 17:32:33.964074 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6b1944-000c-4aeb-8037-9e46643554db admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:32:33.974921 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6b1944-000c-4aeb-8037-9e46643554db admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:32:33.980316 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bef95c-df84-410a-bc40-583e2867b9ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:32:33.981216 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bef95c-df84-410a-bc40-583e2867b9ca admin admin] REQUEST_METHOD: `PUT` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:32:33.981504 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bef95c-df84-410a-bc40-583e2867b9ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:32:33.981811 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bef95c-df84-410a-bc40-583e2867b9ca admin admin] PATH_INFO: `/v3/projects/f1f2e2eca0374c9ead99f50d0b8080f1/users/1f5b7f61c1e948f496dcab0a27971143/roles/dba744f8ab2a4c45b9d3212f8d203aba` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:32:33.999704 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bef95c-df84-410a-bc40-583e2867b9ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1f2e2eca0374c9ead99f50d0b8080f1, user_id=1f5b7f61c1e948f496dcab0a27971143, role_id=dba744f8ab2a4c45b9d3212f8d203aba)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:32:34.003040 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bef95c-df84-410a-bc40-583e2867b9ca admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:32:34.077003 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:32:34.082027 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1369/2738] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 17:32:33 2022] PUT /identity/v3/projects/f1f2e2eca0374c9ead99f50d0b8080f1/users/1f5b7f61c1e948f496dcab0a27971143/roles/dba744f8ab2a4c45b9d3212f8d203aba => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:32:34.085953 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfb4450-5c02-44d6-b7b9-c5be9fa53023 admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:32:34.096299 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfb4450-5c02-44d6-b7b9-c5be9fa53023 admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:32:34.107038 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:32:34.155401 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fa3bd1-9954-4ba9-934d-942113319763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:32:34.156034 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fa3bd1-9954-4ba9-934d-942113319763 admin admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:32:34.156380 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fa3bd1-9954-4ba9-934d-942113319763 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:32:34.157047 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fa3bd1-9954-4ba9-934d-942113319763 admin admin] PATH_INFO: `/v3/roles` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:32:34.157335 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fa3bd1-9954-4ba9-934d-942113319763 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:32:34.158970 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fa3bd1-9954-4ba9-934d-942113319763 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:32:34.172193 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1370/2739] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 17:32:34 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:32:34.173995 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bef95c-df84-410a-bc40-583e2867b9ca admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:32:34.184311 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bef95c-df84-410a-bc40-583e2867b9ca admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:32:34.189971 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb261b3-bf99-4133-a37e-ba2d88873d9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:32:34.190892 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb261b3-bf99-4133-a37e-ba2d88873d9f admin admin] REQUEST_METHOD: `PUT` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:32:34.191245 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb261b3-bf99-4133-a37e-ba2d88873d9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:32:34.191559 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb261b3-bf99-4133-a37e-ba2d88873d9f admin admin] PATH_INFO: `/v3/projects/f1f2e2eca0374c9ead99f50d0b8080f1/users/1f5b7f61c1e948f496dcab0a27971143/roles/dba744f8ab2a4c45b9d3212f8d203aba` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:32:34.194051 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb261b3-bf99-4133-a37e-ba2d88873d9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1f2e2eca0374c9ead99f50d0b8080f1, user_id=1f5b7f61c1e948f496dcab0a27971143, role_id=dba744f8ab2a4c45b9d3212f8d203aba)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:32:34.202807 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb261b3-bf99-4133-a37e-ba2d88873d9f admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:32:34.208888 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1370/2740] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 17:32:34 2022] PUT /identity/v3/projects/f1f2e2eca0374c9ead99f50d0b8080f1/users/1f5b7f61c1e948f496dcab0a27971143/roles/dba744f8ab2a4c45b9d3212f8d203aba => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:32:40.060780 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1292df2-5104-4a5f-bfe1-68e2cadbf0c5 None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:32:40.062150 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1292df2-5104-4a5f-bfe1-68e2cadbf0c5 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:32:40.062912 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1292df2-5104-4a5f-bfe1-68e2cadbf0c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:32:40.098895 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-a1292df2-5104-4a5f-bfe1-68e2cadbf0c5 None None] MFA Rules not processed for user `1f5b7f61c1e948f496dcab0a27971143`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:32:40.108564 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-a1292df2-5104-4a5f-bfe1-68e2cadbf0c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:32:40.246869 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1371/2741] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:32:40 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:32:40.247068 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb261b3-bf99-4133-a37e-ba2d88873d9f admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:32:40.250083 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-1eb261b3-bf99-4133-a37e-ba2d88873d9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:32:40.367033 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb261b3-bf99-4133-a37e-ba2d88873d9f admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:32:40.373725 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13ff2c3-5749-40f8-806d-a3aa63ac0294 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d381bb41dea4f1e90c3cf3815ac88dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:32:40.374496 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13ff2c3-5749-40f8-806d-a3aa63ac0294 service nova] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:32:40.374856 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13ff2c3-5749-40f8-806d-a3aa63ac0294 service nova] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:32:40.375222 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13ff2c3-5749-40f8-806d-a3aa63ac0294 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:32:40.441653 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13ff2c3-5749-40f8-806d-a3aa63ac0294 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:32:40.444902 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13ff2c3-5749-40f8-806d-a3aa63ac0294 service nova] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:32:40.453973 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1371/2742] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:32:40 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:32:43.375986 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8758c8-0ba2-473a-9a06-e78dc6fc53e7 None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:32:43.376509 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8758c8-0ba2-473a-9a06-e78dc6fc53e7 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:32:43.376612 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8758c8-0ba2-473a-9a06-e78dc6fc53e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:32:43.397497 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-2d8758c8-0ba2-473a-9a06-e78dc6fc53e7 None None] MFA Rules not processed for user `ce7b7d0d12ef45f896f84233ee7ef519`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:32:43.399469 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-2d8758c8-0ba2-473a-9a06-e78dc6fc53e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:32:43.408414 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1372/2743] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:32:43 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:32:48.762340 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc09a4b8-76d7-45c2-984a-2c7c534f2665 None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:32:48.762848 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc09a4b8-76d7-45c2-984a-2c7c534f2665 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:32:48.762950 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc09a4b8-76d7-45c2-984a-2c7c534f2665 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:32:48.782081 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-dc09a4b8-76d7-45c2-984a-2c7c534f2665 None None] MFA Rules not processed for user `3de3de59b09148cd877c64735857c3a2`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:32:48.783318 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-dc09a4b8-76d7-45c2-984a-2c7c534f2665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:32:48.848931 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1372/2744] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:32:48 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:32:53.389965 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=60 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:32:57.263206 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8758c8-0ba2-473a-9a06-e78dc6fc53e7 None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:32:57.264638 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-2d8758c8-0ba2-473a-9a06-e78dc6fc53e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:32:57.321160 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8758c8-0ba2-473a-9a06-e78dc6fc53e7 None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:32:57.324795 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c59ce2-5968-447a-8899-bebd78446fdb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5d25bfa8dc042329d57cd55fa7b7b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:32:57.325443 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c59ce2-5968-447a-8899-bebd78446fdb service neutron] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:32:57.325731 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c59ce2-5968-447a-8899-bebd78446fdb service neutron] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:32:57.326056 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c59ce2-5968-447a-8899-bebd78446fdb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:32:57.327840 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-c0c59ce2-5968-447a-8899-bebd78446fdb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:32:57.337959 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c59ce2-5968-447a-8899-bebd78446fdb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:32:57.339391 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c59ce2-5968-447a-8899-bebd78446fdb service neutron] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:32:57.347388 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1373/2745] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:32:57 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:32:58.841513 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=86,keystone:INSERT=1 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:33:07.343894 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=26 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:33:11.362989 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc09a4b8-76d7-45c2-984a-2c7c534f2665 None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:33:11.373333 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc09a4b8-76d7-45c2-984a-2c7c534f2665 None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:33:11.377027 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db74dc4-427a-4940-a29e-73f36aed0bee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5d25bfa8dc042329d57cd55fa7b7b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:33:11.377668 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db74dc4-427a-4940-a29e-73f36aed0bee service neutron] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:33:11.377990 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db74dc4-427a-4940-a29e-73f36aed0bee service neutron] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:33:11.378273 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db74dc4-427a-4940-a29e-73f36aed0bee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:33:11.387352 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db74dc4-427a-4940-a29e-73f36aed0bee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:33:11.388800 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db74dc4-427a-4940-a29e-73f36aed0bee service neutron] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:33:11.398395 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1373/2746] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:33:11 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:33:19.436268 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c59ce2-5968-447a-8899-bebd78446fdb service neutron] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:33:19.437697 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-c0c59ce2-5968-447a-8899-bebd78446fdb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:33:19.506099 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c59ce2-5968-447a-8899-bebd78446fdb service neutron] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:33:19.511128 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e2847b-68dc-4527-b4ec-062946377d8a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2882f26811094d8e88c03701c94296fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:33:19.511781 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e2847b-68dc-4527-b4ec-062946377d8a service placement] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:33:19.512073 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e2847b-68dc-4527-b4ec-062946377d8a service placement] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:33:19.512358 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e2847b-68dc-4527-b4ec-062946377d8a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:33:19.514190 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-97e2847b-68dc-4527-b4ec-062946377d8a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:33:19.526054 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e2847b-68dc-4527-b4ec-062946377d8a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:33:19.527627 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e2847b-68dc-4527-b4ec-062946377d8a service placement] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:33:19.537498 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1374/2747] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:33:19 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:33:21.394151 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=6 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:33:29.533292 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=32 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:33:56.373392 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f579175-f986-4419-9769-6a196b35ec22 None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:33:56.373896 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f579175-f986-4419-9769-6a196b35ec22 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:33:56.374021 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f579175-f986-4419-9769-6a196b35ec22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:33:56.393005 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-9f579175-f986-4419-9769-6a196b35ec22 None None] MFA Rules not processed for user `f7f35c1c15a84a92863d4f3f96d76830`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:33:56.394219 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-9f579175-f986-4419-9769-6a196b35ec22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:33:56.451280 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1374/2748] 10.222.0.39 () {58 vars in 1009 bytes} [Thu Jun 16 17:33:56 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:33:56.639262 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e2847b-68dc-4527-b4ec-062946377d8a service placement] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:33:56.640708 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-97e2847b-68dc-4527-b4ec-062946377d8a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:33:56.709883 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e2847b-68dc-4527-b4ec-062946377d8a service placement] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:33:56.714804 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea58a33-19dd-4628-9bd1-ea35e458209c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbec2dfe63764ed88a23e172ead0afa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:33:56.715439 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea58a33-19dd-4628-9bd1-ea35e458209c service swift] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:33:56.715724 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea58a33-19dd-4628-9bd1-ea35e458209c service swift] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:33:56.716002 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea58a33-19dd-4628-9bd1-ea35e458209c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:33:56.724212 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea58a33-19dd-4628-9bd1-ea35e458209c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:33:56.725980 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea58a33-19dd-4628-9bd1-ea35e458209c service swift] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:33:56.734002 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1375/2749] 10.222.0.39 () {60 vars in 1384 bytes} [Thu Jun 16 17:33:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 17:34:06.444163 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=25 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:34:06.730754 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=32 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:34:12.826116 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eab355-b052-4e4b-82b1-15287c3d9eb8 None None] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:34:12.831023 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eab355-b052-4e4b-82b1-15287c3d9eb8 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:34:12.831023 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eab355-b052-4e4b-82b1-15287c3d9eb8 None None] PATH_INFO: `/` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:34:12.831023 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1375/2750] 10.222.0.39 () {54 vars in 921 bytes} [Thu Jun 16 17:34:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 17:34:12.834922 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fe55b2-1193-49a7-97de-132781a982e1 None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:34:12.835409 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fe55b2-1193-49a7-97de-132781a982e1 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:34:12.835505 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fe55b2-1193-49a7-97de-132781a982e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:34:12.853361 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-c2fe55b2-1193-49a7-97de-132781a982e1 None None] MFA Rules not processed for user `3d381bb41dea4f1e90c3cf3815ac88dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:34:12.854683 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-c2fe55b2-1193-49a7-97de-132781a982e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:34:12.868682 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1376/2751] 10.222.0.39 () {58 vars in 1018 bytes} [Thu Jun 16 17:34:12 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:34:12.876310 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11eab355-b052-4e4b-82b1-15287c3d9eb8 None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:34:12.878190 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-11eab355-b052-4e4b-82b1-15287c3d9eb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:34:12.941055 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11eab355-b052-4e4b-82b1-15287c3d9eb8 None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:34:12.945105 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29a611f-2e2c-4b7a-95da-f7d2d46b9c9a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3985eae1ec3240129eec8d1f4d8d21e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:34:12.945747 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29a611f-2e2c-4b7a-95da-f7d2d46b9c9a service glance] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:34:12.946057 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29a611f-2e2c-4b7a-95da-f7d2d46b9c9a service glance] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:34:12.946334 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29a611f-2e2c-4b7a-95da-f7d2d46b9c9a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:34:12.956556 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29a611f-2e2c-4b7a-95da-f7d2d46b9c9a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:34:12.958029 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29a611f-2e2c-4b7a-95da-f7d2d46b9c9a service glance] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:34:12.969684 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1376/2752] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:34:12 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:34:13.161501 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abb7b53-7812-458d-adc8-7a7cb062c887 None None] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:34:13.162442 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abb7b53-7812-458d-adc8-7a7cb062c887 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:34:13.162731 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abb7b53-7812-458d-adc8-7a7cb062c887 None None] PATH_INFO: `/` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:34:13.164125 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1377/2753] 10.222.0.39 () {54 vars in 921 bytes} [Thu Jun 16 17:34:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:34:13.169390 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e718cc56-9e73-4c97-8aa1-c800fd901a06 None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:34:13.169786 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e718cc56-9e73-4c97-8aa1-c800fd901a06 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:34:13.170070 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e718cc56-9e73-4c97-8aa1-c800fd901a06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:34:13.187950 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-e718cc56-9e73-4c97-8aa1-c800fd901a06 None None] MFA Rules not processed for user `b5d25bfa8dc042329d57cd55fa7b7b23`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:34:13.189176 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-e718cc56-9e73-4c97-8aa1-c800fd901a06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:34:13.195980 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1377/2754] 10.222.0.39 () {58 vars in 1018 bytes} [Thu Jun 16 17:34:13 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:34:13.207471 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abb7b53-7812-458d-adc8-7a7cb062c887 None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:34:13.219413 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abb7b53-7812-458d-adc8-7a7cb062c887 None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:34:13.223056 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ac3122-c660-4a1e-9e5d-fbf37202e5a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5d25bfa8dc042329d57cd55fa7b7b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:34:13.224177 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ac3122-c660-4a1e-9e5d-fbf37202e5a7 service neutron] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:34:13.225025 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ac3122-c660-4a1e-9e5d-fbf37202e5a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:34:13.225310 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ac3122-c660-4a1e-9e5d-fbf37202e5a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:34:13.232715 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ac3122-c660-4a1e-9e5d-fbf37202e5a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:34:13.234191 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ac3122-c660-4a1e-9e5d-fbf37202e5a7 service neutron] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:34:13.241995 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1378/2755] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:34:13 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:34:13.330128 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bbb87e-7e74-4847-bc11-02c60bd47990 None None] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:34:13.330425 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bbb87e-7e74-4847-bc11-02c60bd47990 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:34:13.330711 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bbb87e-7e74-4847-bc11-02c60bd47990 None None] PATH_INFO: `/` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:34:13.332125 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1378/2756] 10.222.0.39 () {54 vars in 921 bytes} [Thu Jun 16 17:34:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:34:13.338357 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be13557-981d-45f6-b6f6-1dcf0e8bfd42 None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:34:13.338650 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be13557-981d-45f6-b6f6-1dcf0e8bfd42 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:34:13.338932 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be13557-981d-45f6-b6f6-1dcf0e8bfd42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:34:13.357701 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-4be13557-981d-45f6-b6f6-1dcf0e8bfd42 None None] MFA Rules not processed for user `3d381bb41dea4f1e90c3cf3815ac88dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:34:13.359013 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-4be13557-981d-45f6-b6f6-1dcf0e8bfd42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:34:13.368409 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1379/2757] 10.222.0.39 () {58 vars in 1018 bytes} [Thu Jun 16 17:34:13 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:34:13.378858 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bbb87e-7e74-4847-bc11-02c60bd47990 None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:34:13.389774 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bbb87e-7e74-4847-bc11-02c60bd47990 None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:34:13.393437 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad48b54-3dab-445a-b4da-a673c5863c85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5d25bfa8dc042329d57cd55fa7b7b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:34:13.394114 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad48b54-3dab-445a-b4da-a673c5863c85 service neutron] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:34:13.394408 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad48b54-3dab-445a-b4da-a673c5863c85 service neutron] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:34:13.394810 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad48b54-3dab-445a-b4da-a673c5863c85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:34:13.406026 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad48b54-3dab-445a-b4da-a673c5863c85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:34:13.407455 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad48b54-3dab-445a-b4da-a673c5863c85 service neutron] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:34:13.418721 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1379/2758] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:34:13 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:34:15.581325 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec3931b-794c-485e-99dc-5501cef9c2f9 None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:34:15.581839 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec3931b-794c-485e-99dc-5501cef9c2f9 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:34:15.581955 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec3931b-794c-485e-99dc-5501cef9c2f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:34:15.603345 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-cec3931b-794c-485e-99dc-5501cef9c2f9 None None] MFA Rules not processed for user `f7f35c1c15a84a92863d4f3f96d76830`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:34:15.603345 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-cec3931b-794c-485e-99dc-5501cef9c2f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:34:15.610361 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1380/2759] 10.222.0.39 () {58 vars in 1009 bytes} [Thu Jun 16 17:34:15 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:34:15.625142 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad48b54-3dab-445a-b4da-a673c5863c85 service neutron] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:34:15.636396 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad48b54-3dab-445a-b4da-a673c5863c85 service neutron] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:34:15.642760 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da784884-992e-453a-8f83-9af58262db75 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbec2dfe63764ed88a23e172ead0afa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:34:15.643404 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da784884-992e-453a-8f83-9af58262db75 service swift] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:34:15.643693 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da784884-992e-453a-8f83-9af58262db75 service swift] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:34:15.643976 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da784884-992e-453a-8f83-9af58262db75 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:34:15.656256 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da784884-992e-453a-8f83-9af58262db75 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:34:15.657885 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da784884-992e-453a-8f83-9af58262db75 service swift] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:34:15.667152 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1380/2760] 10.222.0.39 () {60 vars in 1384 bytes} [Thu Jun 16 17:34:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 17:34:25.595287 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=15 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:34:25.663459 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=41 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:34:30.503483 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07b12f7-f685-44d9-a613-bd43ed3e41a8 None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:34:30.503929 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07b12f7-f685-44d9-a613-bd43ed3e41a8 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:34:30.504240 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07b12f7-f685-44d9-a613-bd43ed3e41a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:34:30.522907 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-b07b12f7-f685-44d9-a613-bd43ed3e41a8 None None] MFA Rules not processed for user `f7f35c1c15a84a92863d4f3f96d76830`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:34:30.524746 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-b07b12f7-f685-44d9-a613-bd43ed3e41a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:34:30.532063 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1381/2761] 10.222.0.39 () {58 vars in 967 bytes} [Thu Jun 16 17:34:30 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:34:30.544266 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da784884-992e-453a-8f83-9af58262db75 service swift] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:34:30.554800 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da784884-992e-453a-8f83-9af58262db75 service swift] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:34:30.560152 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88bfd80-0607-456d-918b-887d72508d9e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbec2dfe63764ed88a23e172ead0afa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:34:30.560809 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88bfd80-0607-456d-918b-887d72508d9e service swift] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:34:30.561100 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88bfd80-0607-456d-918b-887d72508d9e service swift] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:34:30.561380 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88bfd80-0607-456d-918b-887d72508d9e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:34:30.570245 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88bfd80-0607-456d-918b-887d72508d9e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:34:30.572385 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88bfd80-0607-456d-918b-887d72508d9e service swift] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:34:30.580636 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1381/2762] 10.222.0.39 () {60 vars in 1384 bytes} [Thu Jun 16 17:34:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 17:34:40.517508 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=3 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:34:40.577264 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=6 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:35:11.266488 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07b12f7-f685-44d9-a613-bd43ed3e41a8 None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:35:11.279305 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07b12f7-f685-44d9-a613-bd43ed3e41a8 None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:35:11.285275 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7764cbdd-8199-4ad0-a594-617d4f7f1d83 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d381bb41dea4f1e90c3cf3815ac88dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:35:11.285942 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7764cbdd-8199-4ad0-a594-617d4f7f1d83 service nova] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:35:11.286233 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7764cbdd-8199-4ad0-a594-617d4f7f1d83 service nova] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:35:11.286542 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7764cbdd-8199-4ad0-a594-617d4f7f1d83 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:35:11.288320 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-7764cbdd-8199-4ad0-a594-617d4f7f1d83 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:35:11.299579 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7764cbdd-8199-4ad0-a594-617d4f7f1d83 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:35:11.301151 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7764cbdd-8199-4ad0-a594-617d4f7f1d83 service nova] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:35:11.310145 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1382/2763] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:35:11 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:35:11.384848 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88bfd80-0607-456d-918b-887d72508d9e service swift] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:35:11.394271 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88bfd80-0607-456d-918b-887d72508d9e service swift] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:35:11.397787 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f169303b-cb44-4208-bd03-fe31a2258e36 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5d25bfa8dc042329d57cd55fa7b7b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:35:11.398482 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f169303b-cb44-4208-bd03-fe31a2258e36 service neutron] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:35:11.398774 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f169303b-cb44-4208-bd03-fe31a2258e36 service neutron] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:35:11.399055 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f169303b-cb44-4208-bd03-fe31a2258e36 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:35:11.400812 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-f169303b-cb44-4208-bd03-fe31a2258e36 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:35:11.473424 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f169303b-cb44-4208-bd03-fe31a2258e36 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:35:11.474906 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f169303b-cb44-4208-bd03-fe31a2258e36 service neutron] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:35:11.485612 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1382/2764] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:35:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:35:15.108389 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7764cbdd-8199-4ad0-a594-617d4f7f1d83 service nova] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:35:15.110185 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-7764cbdd-8199-4ad0-a594-617d4f7f1d83 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:35:15.124843 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7764cbdd-8199-4ad0-a594-617d4f7f1d83 service nova] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:35:15.129537 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9f25b9-5d22-49a5-87fc-ac0c3b39e3a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:35:15.130454 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9f25b9-5d22-49a5-87fc-ac0c3b39e3a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:35:15.130742 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9f25b9-5d22-49a5-87fc-ac0c3b39e3a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:35:15.131023 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9f25b9-5d22-49a5-87fc-ac0c3b39e3a7 admin admin] PATH_INFO: `/v3/users/3de3de59b09148cd877c64735857c3a2` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:35:15.132241 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9f25b9-5d22-49a5-87fc-ac0c3b39e3a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3de3de59b09148cd877c64735857c3a2)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:35:15.134207 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9f25b9-5d22-49a5-87fc-ac0c3b39e3a7 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:35:15.326741 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-df9f25b9-5d22-49a5-87fc-ac0c3b39e3a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3de3de59b09148cd877c64735857c3a2'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:35:15.333548 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-df9f25b9-5d22-49a5-87fc-ac0c3b39e3a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3de3de59b09148cd877c64735857c3a2'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:35:15.399232 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-df9f25b9-5d22-49a5-87fc-ac0c3b39e3a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3de3de59b09148cd877c64735857c3a2'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:35:15.399887 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-df9f25b9-5d22-49a5-87fc-ac0c3b39e3a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3de3de59b09148cd877c64735857c3a2'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:35:15.412646 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-df9f25b9-5d22-49a5-87fc-ac0c3b39e3a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3de3de59b09148cd877c64735857c3a2'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:35:15.419023 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1383/2765] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 16 17:35:15 2022] DELETE /identity/v3/users/3de3de59b09148cd877c64735857c3a2 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:35:15.703522 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f169303b-cb44-4208-bd03-fe31a2258e36 service neutron] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:35:15.713565 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f169303b-cb44-4208-bd03-fe31a2258e36 service neutron] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:35:15.785198 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b38cea8-d1ea-4a55-bbe2-294b7afbea5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:35:15.786118 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b38cea8-d1ea-4a55-bbe2-294b7afbea5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:35:15.786420 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b38cea8-d1ea-4a55-bbe2-294b7afbea5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:35:15.786709 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b38cea8-d1ea-4a55-bbe2-294b7afbea5a admin admin] PATH_INFO: `/v3/projects/fb012f5e60aa4c90b145443b46cd34f5` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:35:15.787923 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b38cea8-d1ea-4a55-bbe2-294b7afbea5a admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb012f5e60aa4c90b145443b46cd34f5)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:35:15.789865 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b38cea8-d1ea-4a55-bbe2-294b7afbea5a admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:35:15.914268 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-8b38cea8-d1ea-4a55-bbe2-294b7afbea5a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb012f5e60aa4c90b145443b46cd34f5', 'request_id': 'req-8b38cea8-d1ea-4a55-bbe2-294b7afbea5a'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:35:15.920689 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-8b38cea8-d1ea-4a55-bbe2-294b7afbea5a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb012f5e60aa4c90b145443b46cd34f5', 'request_id': 'req-8b38cea8-d1ea-4a55-bbe2-294b7afbea5a'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:35:15.926742 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-8b38cea8-d1ea-4a55-bbe2-294b7afbea5a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb012f5e60aa4c90b145443b46cd34f5', 'request_id': 'req-8b38cea8-d1ea-4a55-bbe2-294b7afbea5a'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:35:16.021786 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-8b38cea8-d1ea-4a55-bbe2-294b7afbea5a admin admin] The token cache is being invalidate because project fb012f5e60aa4c90b145443b46cd34f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80873) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 17:35:16.022100 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-8b38cea8-d1ea-4a55-bbe2-294b7afbea5a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:35:16.023665 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-8b38cea8-d1ea-4a55-bbe2-294b7afbea5a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:35:16.024566 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1383/2766] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 16 17:35:15 2022] DELETE /identity/v3/projects/fb012f5e60aa4c90b145443b46cd34f5 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:35:16.030476 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f5b07d-bd63-4932-aaaa-ed37603351f9 None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:35:16.030887 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f5b07d-bd63-4932-aaaa-ed37603351f9 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:35:16.031095 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f5b07d-bd63-4932-aaaa-ed37603351f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:35:16.050073 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-01f5b07d-bd63-4932-aaaa-ed37603351f9 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:35:16.051303 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-01f5b07d-bd63-4932-aaaa-ed37603351f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:35:16.120294 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1384/2767] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:35:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:35:16.128760 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7f111d-7370-45c3-bfe7-3b3c79129249 None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:35:16.129057 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7f111d-7370-45c3-bfe7-3b3c79129249 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:35:16.129341 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7f111d-7370-45c3-bfe7-3b3c79129249 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:35:16.148430 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-1a7f111d-7370-45c3-bfe7-3b3c79129249 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:35:16.149559 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-1a7f111d-7370-45c3-bfe7-3b3c79129249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:35:16.158417 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1384/2768] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:35:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:35:16.162734 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f5b07d-bd63-4932-aaaa-ed37603351f9 None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:35:16.172901 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f5b07d-bd63-4932-aaaa-ed37603351f9 None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:35:16.177450 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d27dd2-7f39-4124-a410-835b34f99e76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:35:16.178314 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d27dd2-7f39-4124-a410-835b34f99e76 admin admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:35:16.178484 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d27dd2-7f39-4124-a410-835b34f99e76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:35:16.178783 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d27dd2-7f39-4124-a410-835b34f99e76 admin admin] PATH_INFO: `/v3/domains` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:35:16.179512 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d27dd2-7f39-4124-a410-835b34f99e76 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:35:16.179824 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d27dd2-7f39-4124-a410-835b34f99e76 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:35:16.181407 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d27dd2-7f39-4124-a410-835b34f99e76 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:35:16.193744 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1385/2769] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 16 17:35:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 17:35:16.198084 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7f111d-7370-45c3-bfe7-3b3c79129249 None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:35:16.207348 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7f111d-7370-45c3-bfe7-3b3c79129249 None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:35:16.212094 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a63a8a4-ea53-48c9-9351-0666067281c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:35:16.212742 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a63a8a4-ea53-48c9-9351-0666067281c1 admin admin] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:35:16.213029 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a63a8a4-ea53-48c9-9351-0666067281c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:35:16.213312 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a63a8a4-ea53-48c9-9351-0666067281c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:35:16.214929 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a63a8a4-ea53-48c9-9351-0666067281c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:35:16.217447 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a63a8a4-ea53-48c9-9351-0666067281c1 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:35:16.231655 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:35:16.331075 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1385/2770] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 16 17:35:16 2022] POST /identity/v3/projects => generated 383 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:35:16.335168 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d27dd2-7f39-4124-a410-835b34f99e76 admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:35:16.346134 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d27dd2-7f39-4124-a410-835b34f99e76 admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:35:16.390001 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:35:16.402378 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2959094f-e1ab-4f5f-8b3c-133b1a4effb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:35:16.402909 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2959094f-e1ab-4f5f-8b3c-133b1a4effb8 admin admin] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:35:16.403196 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2959094f-e1ab-4f5f-8b3c-133b1a4effb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:35:16.403476 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2959094f-e1ab-4f5f-8b3c-133b1a4effb8 admin admin] PATH_INFO: `/v3/users` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:35:16.404162 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2959094f-e1ab-4f5f-8b3c-133b1a4effb8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:35:16.406763 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2959094f-e1ab-4f5f-8b3c-133b1a4effb8 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:35:16.497329 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1386/2771] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 16 17:35:16 2022] POST /identity/v3/users => generated 292 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:35:16.501475 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a63a8a4-ea53-48c9-9351-0666067281c1 admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:35:16.512257 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a63a8a4-ea53-48c9-9351-0666067281c1 admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:35:16.517640 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3800c697-7edb-4d77-9ce8-c600af78b3b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:35:16.518364 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3800c697-7edb-4d77-9ce8-c600af78b3b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:35:16.518651 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3800c697-7edb-4d77-9ce8-c600af78b3b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:35:16.518929 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3800c697-7edb-4d77-9ce8-c600af78b3b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:35:16.519654 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3800c697-7edb-4d77-9ce8-c600af78b3b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:35:16.521267 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3800c697-7edb-4d77-9ce8-c600af78b3b3 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:35:16.533994 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1386/2772] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 17:35:16 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:35:16.538009 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2959094f-e1ab-4f5f-8b3c-133b1a4effb8 admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:35:16.548227 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2959094f-e1ab-4f5f-8b3c-133b1a4effb8 admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:35:16.553037 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82110e9-f744-49bb-884e-2f9c773fc646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:35:16.553726 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82110e9-f744-49bb-884e-2f9c773fc646 admin admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:35:16.554069 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82110e9-f744-49bb-884e-2f9c773fc646 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:35:16.554352 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82110e9-f744-49bb-884e-2f9c773fc646 admin admin] PATH_INFO: `/v3/roles` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:35:16.555086 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82110e9-f744-49bb-884e-2f9c773fc646 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:35:16.556703 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82110e9-f744-49bb-884e-2f9c773fc646 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:35:16.567727 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1387/2773] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 17:35:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:35:16.571785 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3800c697-7edb-4d77-9ce8-c600af78b3b3 admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:35:16.582546 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3800c697-7edb-4d77-9ce8-c600af78b3b3 admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:35:16.587228 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589cfcdc-1aab-43e1-86b9-6bb46254962b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:35:16.588098 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589cfcdc-1aab-43e1-86b9-6bb46254962b admin admin] REQUEST_METHOD: `PUT` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:35:16.588383 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589cfcdc-1aab-43e1-86b9-6bb46254962b admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:35:16.588661 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589cfcdc-1aab-43e1-86b9-6bb46254962b admin admin] PATH_INFO: `/v3/projects/711b1b5ed1f849bb820162c47bf9db40/users/774d17f638a646d6b42cf50e6506356b/roles/896bff49c5d6464eb612a15f4aa9badc` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:35:16.604272 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589cfcdc-1aab-43e1-86b9-6bb46254962b admin admin] RBAC: Authorizing `identity:create_grant(project_id=711b1b5ed1f849bb820162c47bf9db40, user_id=774d17f638a646d6b42cf50e6506356b, role_id=896bff49c5d6464eb612a15f4aa9badc)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:35:16.606976 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589cfcdc-1aab-43e1-86b9-6bb46254962b admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:35:16.679768 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1387/2774] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 17:35:16 2022] PUT /identity/v3/projects/711b1b5ed1f849bb820162c47bf9db40/users/774d17f638a646d6b42cf50e6506356b/roles/896bff49c5d6464eb612a15f4aa9badc => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:35:16.684695 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c7c2ca-2302-48d5-826c-bf281a7bc975 None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:35:16.684990 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c7c2ca-2302-48d5-826c-bf281a7bc975 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:35:16.685270 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c7c2ca-2302-48d5-826c-bf281a7bc975 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:35:16.703129 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-20c7c2ca-2302-48d5-826c-bf281a7bc975 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:35:16.704391 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-20c7c2ca-2302-48d5-826c-bf281a7bc975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:35:16.764681 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1388/2775] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:35:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:35:16.774517 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589cfcdc-1aab-43e1-86b9-6bb46254962b admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:35:16.776525 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-589cfcdc-1aab-43e1-86b9-6bb46254962b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:35:16.833891 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589cfcdc-1aab-43e1-86b9-6bb46254962b admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:35:16.837572 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3e81df-decc-4f3d-85dd-aae98eed0efd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5d25bfa8dc042329d57cd55fa7b7b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:35:16.838257 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3e81df-decc-4f3d-85dd-aae98eed0efd service neutron] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:35:16.838551 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3e81df-decc-4f3d-85dd-aae98eed0efd service neutron] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:35:16.838860 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3e81df-decc-4f3d-85dd-aae98eed0efd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:35:16.848537 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3e81df-decc-4f3d-85dd-aae98eed0efd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:35:16.854869 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3e81df-decc-4f3d-85dd-aae98eed0efd service neutron] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:35:16.865819 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1388/2776] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:35:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:35:20.589637 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c7c2ca-2302-48d5-826c-bf281a7bc975 None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:35:20.591727 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-20c7c2ca-2302-48d5-826c-bf281a7bc975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:35:20.608622 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c7c2ca-2302-48d5-826c-bf281a7bc975 None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:35:20.613933 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bca8b2-bd95-4abb-bf22-68b33aded0bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5d25bfa8dc042329d57cd55fa7b7b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:35:20.614784 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bca8b2-bd95-4abb-bf22-68b33aded0bb service neutron] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:35:20.615170 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bca8b2-bd95-4abb-bf22-68b33aded0bb service neutron] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:35:20.615569 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bca8b2-bd95-4abb-bf22-68b33aded0bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:35:20.617604 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-01bca8b2-bd95-4abb-bf22-68b33aded0bb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:35:20.719293 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bca8b2-bd95-4abb-bf22-68b33aded0bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:35:20.721174 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bca8b2-bd95-4abb-bf22-68b33aded0bb service neutron] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:35:20.737319 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1389/2777] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:35:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:35:21.974405 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3e81df-decc-4f3d-85dd-aae98eed0efd service neutron] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:35:21.988132 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3e81df-decc-4f3d-85dd-aae98eed0efd service neutron] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:35:21.993803 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087aae24-ad1c-400d-ac80-f7d0e95913ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5d25bfa8dc042329d57cd55fa7b7b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:35:21.995070 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087aae24-ad1c-400d-ac80-f7d0e95913ea service neutron] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:35:21.996381 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087aae24-ad1c-400d-ac80-f7d0e95913ea service neutron] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:35:21.996831 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087aae24-ad1c-400d-ac80-f7d0e95913ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:35:21.999625 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-087aae24-ad1c-400d-ac80-f7d0e95913ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:35:22.018778 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087aae24-ad1c-400d-ac80-f7d0e95913ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:35:22.020760 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087aae24-ad1c-400d-ac80-f7d0e95913ea service neutron] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:35:22.038338 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1389/2778] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:35:21 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 17:35:22.507534 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f92dcf6-2b3a-417d-b773-9b320bd211ca None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:35:22.509524 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f92dcf6-2b3a-417d-b773-9b320bd211ca None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:35:22.509524 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f92dcf6-2b3a-417d-b773-9b320bd211ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:35:22.544020 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-6f92dcf6-2b3a-417d-b773-9b320bd211ca None None] MFA Rules not processed for user `774d17f638a646d6b42cf50e6506356b`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:35:22.545493 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-6f92dcf6-2b3a-417d-b773-9b320bd211ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:35:22.592919 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:35:22.633803 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1390/2779] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:35:22 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:35:22.644363 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087aae24-ad1c-400d-ac80-f7d0e95913ea service neutron] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:35:22.646090 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-087aae24-ad1c-400d-ac80-f7d0e95913ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:35:22.665139 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087aae24-ad1c-400d-ac80-f7d0e95913ea service neutron] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:35:22.671797 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a20c5f-7386-4e65-86f7-9c0e82b2493f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d381bb41dea4f1e90c3cf3815ac88dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:35:22.672655 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a20c5f-7386-4e65-86f7-9c0e82b2493f service nova] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:35:22.672938 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a20c5f-7386-4e65-86f7-9c0e82b2493f service nova] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:35:22.673309 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a20c5f-7386-4e65-86f7-9c0e82b2493f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:35:22.689962 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a20c5f-7386-4e65-86f7-9c0e82b2493f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:35:22.691848 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a20c5f-7386-4e65-86f7-9c0e82b2493f service nova] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:35:22.705151 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1390/2780] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:35:22 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:35:25.593833 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4afbdc-c1dd-4506-9706-b56ef66ea285 None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:35:25.598729 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4afbdc-c1dd-4506-9706-b56ef66ea285 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:35:25.598729 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4afbdc-c1dd-4506-9706-b56ef66ea285 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:35:25.617205 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-ec4afbdc-c1dd-4506-9706-b56ef66ea285 None None] MFA Rules not processed for user `774d17f638a646d6b42cf50e6506356b`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:35:25.618610 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-ec4afbdc-c1dd-4506-9706-b56ef66ea285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:35:25.628073 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1391/2781] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:35:25 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:35:32.697685 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=55,keystone:INSERT=1 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:35:35.611106 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=12 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:36:21.146756 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340025c3-7462-4618-9373-fbb983c15c31 None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:36:21.148308 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340025c3-7462-4618-9373-fbb983c15c31 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:36:21.148308 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340025c3-7462-4618-9373-fbb983c15c31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:36:21.165277 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-340025c3-7462-4618-9373-fbb983c15c31 None None] MFA Rules not processed for user `774d17f638a646d6b42cf50e6506356b`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:36:21.166659 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-340025c3-7462-4618-9373-fbb983c15c31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:36:21.173637 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1391/2782] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:36:21 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:36:21.328129 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4afbdc-c1dd-4506-9706-b56ef66ea285 None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:36:21.338669 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4afbdc-c1dd-4506-9706-b56ef66ea285 None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:36:21.344488 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3682da5f-b99f-4903-9fdd-13705b8786c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5d25bfa8dc042329d57cd55fa7b7b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:36:21.345657 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3682da5f-b99f-4903-9fdd-13705b8786c8 service neutron] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:36:21.346231 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3682da5f-b99f-4903-9fdd-13705b8786c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:36:21.346751 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3682da5f-b99f-4903-9fdd-13705b8786c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:36:21.349721 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-3682da5f-b99f-4903-9fdd-13705b8786c8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:36:21.364800 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3682da5f-b99f-4903-9fdd-13705b8786c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:36:21.366370 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3682da5f-b99f-4903-9fdd-13705b8786c8 service neutron] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:36:21.374792 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1392/2783] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:36:21 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:36:25.522649 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340025c3-7462-4618-9373-fbb983c15c31 None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:36:25.538061 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340025c3-7462-4618-9373-fbb983c15c31 None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:36:25.544418 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8051f0c-b544-42fa-949f-9db383d98d60 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d381bb41dea4f1e90c3cf3815ac88dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:36:25.545107 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8051f0c-b544-42fa-949f-9db383d98d60 service nova] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:36:25.545395 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8051f0c-b544-42fa-949f-9db383d98d60 service nova] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:36:25.545673 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8051f0c-b544-42fa-949f-9db383d98d60 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:36:25.547543 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-b8051f0c-b544-42fa-949f-9db383d98d60 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:36:25.562346 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8051f0c-b544-42fa-949f-9db383d98d60 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:36:25.564133 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8051f0c-b544-42fa-949f-9db383d98d60 service nova] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:36:25.578772 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1392/2784] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:36:25 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:36:29.791994 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3682da5f-b99f-4903-9fdd-13705b8786c8 service neutron] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:36:29.810137 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3682da5f-b99f-4903-9fdd-13705b8786c8 service neutron] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:36:29.811457 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f4f847-48a6-4564-81cc-2783270a20dd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d381bb41dea4f1e90c3cf3815ac88dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:36:29.812101 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f4f847-48a6-4564-81cc-2783270a20dd service nova] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:36:29.812386 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f4f847-48a6-4564-81cc-2783270a20dd service nova] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:36:29.812931 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f4f847-48a6-4564-81cc-2783270a20dd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:36:29.814773 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-93f4f847-48a6-4564-81cc-2783270a20dd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:36:29.828116 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f4f847-48a6-4564-81cc-2783270a20dd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:36:29.833230 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f4f847-48a6-4564-81cc-2783270a20dd service nova] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:36:29.841786 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1393/2785] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:36:29 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:36:33.815548 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8051f0c-b544-42fa-949f-9db383d98d60 service nova] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:36:33.817141 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-b8051f0c-b544-42fa-949f-9db383d98d60 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:36:33.830907 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8051f0c-b544-42fa-949f-9db383d98d60 service nova] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:36:33.837459 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d38b25-fbe0-47f8-9430-f96af6e69d4f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d381bb41dea4f1e90c3cf3815ac88dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:36:33.838147 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d38b25-fbe0-47f8-9430-f96af6e69d4f service nova] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:36:33.838438 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d38b25-fbe0-47f8-9430-f96af6e69d4f service nova] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:36:33.838747 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d38b25-fbe0-47f8-9430-f96af6e69d4f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:36:33.840538 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-37d38b25-fbe0-47f8-9430-f96af6e69d4f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:36:33.853813 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d38b25-fbe0-47f8-9430-f96af6e69d4f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:36:33.855350 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d38b25-fbe0-47f8-9430-f96af6e69d4f service nova] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:36:33.867315 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1393/2786] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:36:33 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:36:39.837258 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=12 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:36:43.862420 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=15 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:36:55.980271 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f4f847-48a6-4564-81cc-2783270a20dd service nova] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:36:55.983175 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-93f4f847-48a6-4564-81cc-2783270a20dd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:36:56.070986 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f4f847-48a6-4564-81cc-2783270a20dd service nova] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:36:56.076486 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4067204b-c070-4676-8840-b2fdb21d7914 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2882f26811094d8e88c03701c94296fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:36:56.081417 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4067204b-c070-4676-8840-b2fdb21d7914 service placement] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:36:56.081417 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4067204b-c070-4676-8840-b2fdb21d7914 service placement] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:36:56.081417 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4067204b-c070-4676-8840-b2fdb21d7914 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:36:56.081417 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-4067204b-c070-4676-8840-b2fdb21d7914 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:36:56.097024 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4067204b-c070-4676-8840-b2fdb21d7914 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:36:56.099430 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4067204b-c070-4676-8840-b2fdb21d7914 service placement] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:36:56.127196 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1394/2787] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:36:55 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:36:59.992714 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d38b25-fbe0-47f8-9430-f96af6e69d4f service nova] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:36:59.994493 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-37d38b25-fbe0-47f8-9430-f96af6e69d4f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:37:00.010046 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d38b25-fbe0-47f8-9430-f96af6e69d4f service nova] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:37:00.015481 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6544645-1c48-456f-b613-31d616a49ebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:37:00.016386 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6544645-1c48-456f-b613-31d616a49ebf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:37:00.016680 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6544645-1c48-456f-b613-31d616a49ebf admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:37:00.016967 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6544645-1c48-456f-b613-31d616a49ebf admin admin] PATH_INFO: `/v3/users/ce7b7d0d12ef45f896f84233ee7ef519` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:37:00.018235 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6544645-1c48-456f-b613-31d616a49ebf admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce7b7d0d12ef45f896f84233ee7ef519)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:37:00.020782 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6544645-1c48-456f-b613-31d616a49ebf admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:37:00.199327 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-f6544645-1c48-456f-b613-31d616a49ebf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce7b7d0d12ef45f896f84233ee7ef519'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:37:00.199991 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-f6544645-1c48-456f-b613-31d616a49ebf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce7b7d0d12ef45f896f84233ee7ef519'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:37:00.200604 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-f6544645-1c48-456f-b613-31d616a49ebf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce7b7d0d12ef45f896f84233ee7ef519'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:37:00.269823 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-f6544645-1c48-456f-b613-31d616a49ebf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce7b7d0d12ef45f896f84233ee7ef519'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:37:00.278200 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-f6544645-1c48-456f-b613-31d616a49ebf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce7b7d0d12ef45f896f84233ee7ef519'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:37:00.295423 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1394/2788] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 16 17:36:59 2022] DELETE /identity/v3/users/ce7b7d0d12ef45f896f84233ee7ef519 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:37:00.649005 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4067204b-c070-4676-8840-b2fdb21d7914 service placement] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:37:00.660562 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4067204b-c070-4676-8840-b2fdb21d7914 service placement] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:37:00.728336 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0358eba6-4b52-4d92-9c9d-5473830bc72b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:37:00.729730 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0358eba6-4b52-4d92-9c9d-5473830bc72b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:37:00.730236 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0358eba6-4b52-4d92-9c9d-5473830bc72b admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:37:00.730710 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0358eba6-4b52-4d92-9c9d-5473830bc72b admin admin] PATH_INFO: `/v3/projects/3ba82a35492e408e9c021b2eb9dba83d` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:37:00.732694 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0358eba6-4b52-4d92-9c9d-5473830bc72b admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ba82a35492e408e9c021b2eb9dba83d)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:37:00.736030 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0358eba6-4b52-4d92-9c9d-5473830bc72b admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:37:00.851809 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-0358eba6-4b52-4d92-9c9d-5473830bc72b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ba82a35492e408e9c021b2eb9dba83d', 'request_id': 'req-0358eba6-4b52-4d92-9c9d-5473830bc72b'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:37:00.856465 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-0358eba6-4b52-4d92-9c9d-5473830bc72b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ba82a35492e408e9c021b2eb9dba83d', 'request_id': 'req-0358eba6-4b52-4d92-9c9d-5473830bc72b'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:37:00.951415 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-0358eba6-4b52-4d92-9c9d-5473830bc72b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ba82a35492e408e9c021b2eb9dba83d', 'request_id': 'req-0358eba6-4b52-4d92-9c9d-5473830bc72b'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:37:00.964121 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-0358eba6-4b52-4d92-9c9d-5473830bc72b admin admin] The token cache is being invalidate because project 3ba82a35492e408e9c021b2eb9dba83d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80874) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 17:37:00.965828 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-0358eba6-4b52-4d92-9c9d-5473830bc72b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:37:00.965828 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-0358eba6-4b52-4d92-9c9d-5473830bc72b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:37:00.966938 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1395/2789] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 16 17:37:00 2022] DELETE /identity/v3/projects/3ba82a35492e408e9c021b2eb9dba83d => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:37:00.971199 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6544645-1c48-456f-b613-31d616a49ebf admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:37:00.972709 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-f6544645-1c48-456f-b613-31d616a49ebf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:37:00.987001 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6544645-1c48-456f-b613-31d616a49ebf admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:37:01.049576 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f8eb1b-207e-4ad1-b0a9-36ef3c58051a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:37:01.050507 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f8eb1b-207e-4ad1-b0a9-36ef3c58051a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:37:01.050801 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f8eb1b-207e-4ad1-b0a9-36ef3c58051a admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:37:01.051091 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f8eb1b-207e-4ad1-b0a9-36ef3c58051a admin admin] PATH_INFO: `/v3/users/1f5b7f61c1e948f496dcab0a27971143` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:37:01.053085 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f8eb1b-207e-4ad1-b0a9-36ef3c58051a admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f5b7f61c1e948f496dcab0a27971143)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:37:01.055108 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f8eb1b-207e-4ad1-b0a9-36ef3c58051a admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:37:01.262924 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-d9f8eb1b-207e-4ad1-b0a9-36ef3c58051a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f5b7f61c1e948f496dcab0a27971143'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:37:01.263609 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-d9f8eb1b-207e-4ad1-b0a9-36ef3c58051a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f5b7f61c1e948f496dcab0a27971143'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:37:01.264219 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-d9f8eb1b-207e-4ad1-b0a9-36ef3c58051a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f5b7f61c1e948f496dcab0a27971143'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:37:01.340003 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-d9f8eb1b-207e-4ad1-b0a9-36ef3c58051a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f5b7f61c1e948f496dcab0a27971143'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:37:01.347652 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-d9f8eb1b-207e-4ad1-b0a9-36ef3c58051a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f5b7f61c1e948f496dcab0a27971143'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:37:01.356849 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:37:01.367101 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1395/2790] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 16 17:37:00 2022] DELETE /identity/v3/users/1f5b7f61c1e948f496dcab0a27971143 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:37:01.622034 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0358eba6-4b52-4d92-9c9d-5473830bc72b admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:37:01.626890 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-0358eba6-4b52-4d92-9c9d-5473830bc72b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:37:01.637462 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0358eba6-4b52-4d92-9c9d-5473830bc72b admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:37:01.657202 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:37:01.708575 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5825f973-a444-4dad-bf7b-a8923bae3ce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:37:01.709586 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5825f973-a444-4dad-bf7b-a8923bae3ce0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:37:01.709884 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5825f973-a444-4dad-bf7b-a8923bae3ce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:37:01.710169 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5825f973-a444-4dad-bf7b-a8923bae3ce0 admin admin] PATH_INFO: `/v3/projects/f1f2e2eca0374c9ead99f50d0b8080f1` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:37:01.711412 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5825f973-a444-4dad-bf7b-a8923bae3ce0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1f2e2eca0374c9ead99f50d0b8080f1)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:37:01.713391 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5825f973-a444-4dad-bf7b-a8923bae3ce0 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:37:01.848647 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-5825f973-a444-4dad-bf7b-a8923bae3ce0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1f2e2eca0374c9ead99f50d0b8080f1', 'request_id': 'req-5825f973-a444-4dad-bf7b-a8923bae3ce0'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:37:01.854559 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-5825f973-a444-4dad-bf7b-a8923bae3ce0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1f2e2eca0374c9ead99f50d0b8080f1', 'request_id': 'req-5825f973-a444-4dad-bf7b-a8923bae3ce0'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:37:01.932461 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-5825f973-a444-4dad-bf7b-a8923bae3ce0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1f2e2eca0374c9ead99f50d0b8080f1', 'request_id': 'req-5825f973-a444-4dad-bf7b-a8923bae3ce0'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:37:01.945064 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-5825f973-a444-4dad-bf7b-a8923bae3ce0 admin admin] The token cache is being invalidate because project f1f2e2eca0374c9ead99f50d0b8080f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80874) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 17:37:01.945354 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-5825f973-a444-4dad-bf7b-a8923bae3ce0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:37:01.946044 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-5825f973-a444-4dad-bf7b-a8923bae3ce0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:37:01.947701 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1396/2791] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 16 17:37:01 2022] DELETE /identity/v3/projects/f1f2e2eca0374c9ead99f50d0b8080f1 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:37:11.476997 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=3,keystone:DELETE=1 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:37:11.941611 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=42,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:37:24.076449 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89dae02-bfee-4726-b448-42b4549e1d8a None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:37:24.078894 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89dae02-bfee-4726-b448-42b4549e1d8a None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:37:24.078894 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89dae02-bfee-4726-b448-42b4549e1d8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:37:24.105593 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-b89dae02-bfee-4726-b448-42b4549e1d8a None None] MFA Rules not processed for user `774d17f638a646d6b42cf50e6506356b`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:37:24.106837 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-b89dae02-bfee-4726-b448-42b4549e1d8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:37:24.177370 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1396/2792] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:37:24 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:37:25.157208 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5825f973-a444-4dad-bf7b-a8923bae3ce0 admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:37:25.158840 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-5825f973-a444-4dad-bf7b-a8923bae3ce0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:37:25.272898 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5825f973-a444-4dad-bf7b-a8923bae3ce0 admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:37:25.278113 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e808017-b55c-4934-bed1-1e38655ba04f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2882f26811094d8e88c03701c94296fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:37:25.278756 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e808017-b55c-4934-bed1-1e38655ba04f service placement] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:37:25.279041 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e808017-b55c-4934-bed1-1e38655ba04f service placement] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:37:25.279321 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e808017-b55c-4934-bed1-1e38655ba04f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:37:25.281121 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-4e808017-b55c-4934-bed1-1e38655ba04f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:37:25.293205 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e808017-b55c-4934-bed1-1e38655ba04f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:37:25.294837 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e808017-b55c-4934-bed1-1e38655ba04f service placement] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:37:25.304690 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1397/2793] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:37:25 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:37:34.175217 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=37 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:37:35.300514 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=50 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:38:21.444898 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89dae02-bfee-4726-b448-42b4549e1d8a None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:38:21.468408 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89dae02-bfee-4726-b448-42b4549e1d8a None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:38:21.473670 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b75274-dd5a-4e40-ad91-1e8b492c1ab5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2882f26811094d8e88c03701c94296fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:38:21.474363 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b75274-dd5a-4e40-ad91-1e8b492c1ab5 service placement] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:38:21.474655 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b75274-dd5a-4e40-ad91-1e8b492c1ab5 service placement] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:38:21.474939 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b75274-dd5a-4e40-ad91-1e8b492c1ab5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:38:21.476802 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-99b75274-dd5a-4e40-ad91-1e8b492c1ab5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:38:21.502549 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b75274-dd5a-4e40-ad91-1e8b492c1ab5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:38:21.504068 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b75274-dd5a-4e40-ad91-1e8b492c1ab5 service placement] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:38:21.515256 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1397/2794] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:38:21 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:38:26.130701 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61833b15-18fb-47c0-8041-0732319493d9 None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:38:26.131306 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61833b15-18fb-47c0-8041-0732319493d9 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:38:26.131306 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61833b15-18fb-47c0-8041-0732319493d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:38:26.148940 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-61833b15-18fb-47c0-8041-0732319493d9 None None] MFA Rules not processed for user `774d17f638a646d6b42cf50e6506356b`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:38:26.150199 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-61833b15-18fb-47c0-8041-0732319493d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:38:26.158085 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1398/2795] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:38:26 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:38:26.473169 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b75274-dd5a-4e40-ad91-1e8b492c1ab5 service placement] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:38:26.474677 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-99b75274-dd5a-4e40-ad91-1e8b492c1ab5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:38:26.551808 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b75274-dd5a-4e40-ad91-1e8b492c1ab5 service placement] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:38:26.555898 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ecb554-f789-4059-818a-0f8f304f5da7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5d25bfa8dc042329d57cd55fa7b7b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:38:26.556552 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ecb554-f789-4059-818a-0f8f304f5da7 service neutron] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:38:26.556837 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ecb554-f789-4059-818a-0f8f304f5da7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:38:26.557266 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ecb554-f789-4059-818a-0f8f304f5da7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:38:26.559945 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-92ecb554-f789-4059-818a-0f8f304f5da7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:38:26.570067 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ecb554-f789-4059-818a-0f8f304f5da7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:38:26.571488 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ecb554-f789-4059-818a-0f8f304f5da7 service neutron] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:38:26.580182 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1398/2796] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:38:26 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:38:36.144180 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=3 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:38:36.576599 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=50 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:39:28.611641 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61833b15-18fb-47c0-8041-0732319493d9 None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:39:28.618382 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-61833b15-18fb-47c0-8041-0732319493d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:39:28.735311 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61833b15-18fb-47c0-8041-0732319493d9 None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:39:28.739967 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b6ed69-8b1c-48de-837e-cfb930409dd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:39:28.741008 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b6ed69-8b1c-48de-837e-cfb930409dd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:28.741150 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b6ed69-8b1c-48de-837e-cfb930409dd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:28.741408 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b6ed69-8b1c-48de-837e-cfb930409dd7 admin admin] PATH_INFO: `/v3/users/774d17f638a646d6b42cf50e6506356b` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:28.742683 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b6ed69-8b1c-48de-837e-cfb930409dd7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=774d17f638a646d6b42cf50e6506356b)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:39:28.744613 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b6ed69-8b1c-48de-837e-cfb930409dd7 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:39:28.942098 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-d2b6ed69-8b1c-48de-837e-cfb930409dd7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '774d17f638a646d6b42cf50e6506356b'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:39:28.949327 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-d2b6ed69-8b1c-48de-837e-cfb930409dd7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '774d17f638a646d6b42cf50e6506356b'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:39:29.031723 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-d2b6ed69-8b1c-48de-837e-cfb930409dd7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '774d17f638a646d6b42cf50e6506356b'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:39:29.032353 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-d2b6ed69-8b1c-48de-837e-cfb930409dd7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '774d17f638a646d6b42cf50e6506356b'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:39:29.046640 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-d2b6ed69-8b1c-48de-837e-cfb930409dd7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '774d17f638a646d6b42cf50e6506356b'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:39:29.053218 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1399/2797] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 16 17:39:28 2022] DELETE /identity/v3/users/774d17f638a646d6b42cf50e6506356b => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:39:29.293313 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ecb554-f789-4059-818a-0f8f304f5da7 service neutron] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:39:29.313396 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ecb554-f789-4059-818a-0f8f304f5da7 service neutron] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:39:29.385207 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e2a5c7-be73-4f9a-9b8e-e336e7e767d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:39:29.386134 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e2a5c7-be73-4f9a-9b8e-e336e7e767d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:29.386432 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e2a5c7-be73-4f9a-9b8e-e336e7e767d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:29.386721 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e2a5c7-be73-4f9a-9b8e-e336e7e767d0 admin admin] PATH_INFO: `/v3/projects/711b1b5ed1f849bb820162c47bf9db40` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:29.387951 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e2a5c7-be73-4f9a-9b8e-e336e7e767d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=711b1b5ed1f849bb820162c47bf9db40)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:39:29.390498 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e2a5c7-be73-4f9a-9b8e-e336e7e767d0 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:39:29.520649 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-47e2a5c7-be73-4f9a-9b8e-e336e7e767d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '711b1b5ed1f849bb820162c47bf9db40', 'request_id': 'req-47e2a5c7-be73-4f9a-9b8e-e336e7e767d0'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:39:29.527052 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-47e2a5c7-be73-4f9a-9b8e-e336e7e767d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '711b1b5ed1f849bb820162c47bf9db40', 'request_id': 'req-47e2a5c7-be73-4f9a-9b8e-e336e7e767d0'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:39:29.532566 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-47e2a5c7-be73-4f9a-9b8e-e336e7e767d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '711b1b5ed1f849bb820162c47bf9db40', 'request_id': 'req-47e2a5c7-be73-4f9a-9b8e-e336e7e767d0'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:39:29.640983 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-47e2a5c7-be73-4f9a-9b8e-e336e7e767d0 admin admin] The token cache is being invalidate because project 711b1b5ed1f849bb820162c47bf9db40 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80873) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 17:39:29.641259 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-47e2a5c7-be73-4f9a-9b8e-e336e7e767d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:39:29.641979 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-47e2a5c7-be73-4f9a-9b8e-e336e7e767d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:39:29.643574 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1399/2798] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 16 17:39:29 2022] DELETE /identity/v3/projects/711b1b5ed1f849bb820162c47bf9db40 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:39:29.648569 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171c8aa1-d50d-4022-ac66-6961b228cb5d None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:29.651480 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171c8aa1-d50d-4022-ac66-6961b228cb5d None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:29.651480 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171c8aa1-d50d-4022-ac66-6961b228cb5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:29.710529 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-171c8aa1-d50d-4022-ac66-6961b228cb5d None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:39:29.711784 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-171c8aa1-d50d-4022-ac66-6961b228cb5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:39:29.725399 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:39:29.773424 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1400/2799] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:39:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:39:29.781230 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434ab321-a77b-4a9d-80e9-254d45f3b445 None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:29.781531 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434ab321-a77b-4a9d-80e9-254d45f3b445 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:29.781854 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434ab321-a77b-4a9d-80e9-254d45f3b445 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:29.803185 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-434ab321-a77b-4a9d-80e9-254d45f3b445 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:39:29.814554 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-434ab321-a77b-4a9d-80e9-254d45f3b445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:39:29.814554 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1400/2800] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:39:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:39:29.817907 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171c8aa1-d50d-4022-ac66-6961b228cb5d None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:39:29.827994 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171c8aa1-d50d-4022-ac66-6961b228cb5d None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:39:29.832766 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5314a5-bdd4-45f5-affd-4c63fcf272ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:39:29.833426 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5314a5-bdd4-45f5-affd-4c63fcf272ba admin admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:29.833741 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5314a5-bdd4-45f5-affd-4c63fcf272ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:29.834051 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5314a5-bdd4-45f5-affd-4c63fcf272ba admin admin] PATH_INFO: `/v3/domains` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:29.834783 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5314a5-bdd4-45f5-affd-4c63fcf272ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80874) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:39:29.835096 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5314a5-bdd4-45f5-affd-4c63fcf272ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:39:29.836797 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5314a5-bdd4-45f5-affd-4c63fcf272ba admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:39:29.850630 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1401/2801] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 16 17:39:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:39:29.855264 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434ab321-a77b-4a9d-80e9-254d45f3b445 None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:39:29.868883 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434ab321-a77b-4a9d-80e9-254d45f3b445 None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:39:29.874273 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c654dd-3e70-40a8-a95b-05858a8282dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:39:29.874943 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c654dd-3e70-40a8-a95b-05858a8282dd admin admin] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:29.875235 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c654dd-3e70-40a8-a95b-05858a8282dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:29.875517 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c654dd-3e70-40a8-a95b-05858a8282dd admin admin] PATH_INFO: `/v3/projects` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:29.876229 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c654dd-3e70-40a8-a95b-05858a8282dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:39:29.878220 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c654dd-3e70-40a8-a95b-05858a8282dd admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:39:29.966321 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1401/2802] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 16 17:39:29 2022] POST /identity/v3/projects => generated 405 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:39:29.970801 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5314a5-bdd4-45f5-affd-4c63fcf272ba admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:39:29.981455 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5314a5-bdd4-45f5-affd-4c63fcf272ba admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:39:30.041333 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b44482c-865d-43a9-8a85-84fc2dc2923b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:39:30.041989 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b44482c-865d-43a9-8a85-84fc2dc2923b admin admin] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:30.042348 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b44482c-865d-43a9-8a85-84fc2dc2923b admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:30.042633 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b44482c-865d-43a9-8a85-84fc2dc2923b admin admin] PATH_INFO: `/v3/users` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:30.043333 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b44482c-865d-43a9-8a85-84fc2dc2923b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:39:30.045921 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b44482c-865d-43a9-8a85-84fc2dc2923b admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:39:30.125745 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1402/2803] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 16 17:39:29 2022] POST /identity/v3/users => generated 303 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:39:30.129846 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c654dd-3e70-40a8-a95b-05858a8282dd admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:39:30.141088 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c654dd-3e70-40a8-a95b-05858a8282dd admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:39:30.145850 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6417464e-3cf0-4f81-a87d-8476c1298be5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:39:30.146523 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6417464e-3cf0-4f81-a87d-8476c1298be5 admin admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:30.146844 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6417464e-3cf0-4f81-a87d-8476c1298be5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:30.147129 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6417464e-3cf0-4f81-a87d-8476c1298be5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:30.147864 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6417464e-3cf0-4f81-a87d-8476c1298be5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:39:30.149457 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6417464e-3cf0-4f81-a87d-8476c1298be5 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:39:30.161335 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1402/2804] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 17:39:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:39:30.165437 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b44482c-865d-43a9-8a85-84fc2dc2923b admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:39:30.176784 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b44482c-865d-43a9-8a85-84fc2dc2923b admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:39:30.181636 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daba51b-f3d4-4e2c-a958-ae171cf4a335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:39:30.182331 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daba51b-f3d4-4e2c-a958-ae171cf4a335 admin admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:30.182625 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daba51b-f3d4-4e2c-a958-ae171cf4a335 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:30.183170 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daba51b-f3d4-4e2c-a958-ae171cf4a335 admin admin] PATH_INFO: `/v3/roles` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:30.183903 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9daba51b-f3d4-4e2c-a958-ae171cf4a335 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:39:30.185508 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9daba51b-f3d4-4e2c-a958-ae171cf4a335 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:39:30.195735 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1403/2805] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 17:39:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:39:30.201369 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6417464e-3cf0-4f81-a87d-8476c1298be5 admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:39:30.212100 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6417464e-3cf0-4f81-a87d-8476c1298be5 admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:39:30.221656 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8898b8ae-461f-4dc5-8c3b-5c3865d63aea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:39:30.223708 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8898b8ae-461f-4dc5-8c3b-5c3865d63aea admin admin] REQUEST_METHOD: `PUT` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:30.224000 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8898b8ae-461f-4dc5-8c3b-5c3865d63aea admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:30.224286 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8898b8ae-461f-4dc5-8c3b-5c3865d63aea admin admin] PATH_INFO: `/v3/projects/e1148dd8d38c4ed39bdde7da64b55b4b/users/8ac676bcc8bd4b5bb49b72cacb91f838/roles/896bff49c5d6464eb612a15f4aa9badc` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:30.241008 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8898b8ae-461f-4dc5-8c3b-5c3865d63aea admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1148dd8d38c4ed39bdde7da64b55b4b, user_id=8ac676bcc8bd4b5bb49b72cacb91f838, role_id=896bff49c5d6464eb612a15f4aa9badc)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:39:30.243757 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8898b8ae-461f-4dc5-8c3b-5c3865d63aea admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:39:30.319993 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1403/2806] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 17:39:30 2022] PUT /identity/v3/projects/e1148dd8d38c4ed39bdde7da64b55b4b/users/8ac676bcc8bd4b5bb49b72cacb91f838/roles/896bff49c5d6464eb612a15f4aa9badc => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:39:30.325163 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d931c5-e21b-40f0-bc13-59da10ea9f55 None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:30.325467 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d931c5-e21b-40f0-bc13-59da10ea9f55 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:30.325782 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d931c5-e21b-40f0-bc13-59da10ea9f55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:30.344620 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-59d931c5-e21b-40f0-bc13-59da10ea9f55 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:39:30.345729 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-59d931c5-e21b-40f0-bc13-59da10ea9f55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:39:30.407734 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1404/2807] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:39:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:39:30.417351 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8898b8ae-461f-4dc5-8c3b-5c3865d63aea admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:39:30.419109 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-8898b8ae-461f-4dc5-8c3b-5c3865d63aea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:39:30.457207 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:39:30.485523 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8898b8ae-461f-4dc5-8c3b-5c3865d63aea admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:39:30.489302 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8095d574-7162-4dfb-bc7d-5a3c0d71640a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5d25bfa8dc042329d57cd55fa7b7b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:39:30.489990 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8095d574-7162-4dfb-bc7d-5a3c0d71640a service neutron] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:30.490284 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8095d574-7162-4dfb-bc7d-5a3c0d71640a service neutron] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:30.490567 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8095d574-7162-4dfb-bc7d-5a3c0d71640a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:30.500334 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8095d574-7162-4dfb-bc7d-5a3c0d71640a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:39:30.501825 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8095d574-7162-4dfb-bc7d-5a3c0d71640a service neutron] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:39:30.511466 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1404/2808] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:39:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:39:31.888689 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f370f0f-6264-4aca-b8e6-5866832484d7 None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:31.891021 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f370f0f-6264-4aca-b8e6-5866832484d7 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:31.891021 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f370f0f-6264-4aca-b8e6-5866832484d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:31.922002 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-6f370f0f-6264-4aca-b8e6-5866832484d7 None None] MFA Rules not processed for user `8ac676bcc8bd4b5bb49b72cacb91f838`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:39:31.924120 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-6f370f0f-6264-4aca-b8e6-5866832484d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:39:31.943707 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:39:32.007167 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1405/2809] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:39:31 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:39:32.011884 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8095d574-7162-4dfb-bc7d-5a3c0d71640a service neutron] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:39:32.022978 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8095d574-7162-4dfb-bc7d-5a3c0d71640a service neutron] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:39:32.028156 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9edf08-713e-4b3b-85ed-f290eedae75a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:39:32.028789 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9edf08-713e-4b3b-85ed-f290eedae75a admin admin] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:32.029084 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9edf08-713e-4b3b-85ed-f290eedae75a admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:32.030148 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9edf08-713e-4b3b-85ed-f290eedae75a admin admin] PATH_INFO: `/v3/projects` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:32.030964 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9edf08-713e-4b3b-85ed-f290eedae75a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:39:32.032922 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9edf08-713e-4b3b-85ed-f290eedae75a admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:39:32.130474 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1405/2810] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 16 17:39:32 2022] POST /identity/v3/projects => generated 403 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:39:32.134758 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f370f0f-6264-4aca-b8e6-5866832484d7 None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:39:32.147232 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f370f0f-6264-4aca-b8e6-5866832484d7 None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:39:32.240655 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3109630-1b1e-41da-bc43-f46612da27d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:39:32.241691 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3109630-1b1e-41da-bc43-f46612da27d2 admin admin] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:32.242192 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3109630-1b1e-41da-bc43-f46612da27d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:32.242662 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3109630-1b1e-41da-bc43-f46612da27d2 admin admin] PATH_INFO: `/v3/users` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:32.243827 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3109630-1b1e-41da-bc43-f46612da27d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:39:32.249478 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3109630-1b1e-41da-bc43-f46612da27d2 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:39:32.325606 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1406/2811] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 16 17:39:32 2022] POST /identity/v3/users => generated 308 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:39:32.330468 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9edf08-713e-4b3b-85ed-f290eedae75a admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:39:32.341152 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9edf08-713e-4b3b-85ed-f290eedae75a admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:39:32.346295 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bbd4d2-a65c-479b-8f4c-32b8218a4152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:39:32.347006 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bbd4d2-a65c-479b-8f4c-32b8218a4152 admin admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:32.347287 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bbd4d2-a65c-479b-8f4c-32b8218a4152 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:32.348045 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bbd4d2-a65c-479b-8f4c-32b8218a4152 admin admin] PATH_INFO: `/v3/roles` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:32.348360 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bbd4d2-a65c-479b-8f4c-32b8218a4152 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:39:32.350017 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bbd4d2-a65c-479b-8f4c-32b8218a4152 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:39:32.361316 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1406/2812] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 17:39:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:39:32.365559 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3109630-1b1e-41da-bc43-f46612da27d2 admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:39:32.377201 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3109630-1b1e-41da-bc43-f46612da27d2 admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:39:32.382124 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7178a5-b8f3-4794-b2f6-978b485f5f3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:39:32.383013 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7178a5-b8f3-4794-b2f6-978b485f5f3a admin admin] REQUEST_METHOD: `PUT` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:32.383299 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7178a5-b8f3-4794-b2f6-978b485f5f3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:32.383572 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7178a5-b8f3-4794-b2f6-978b485f5f3a admin admin] PATH_INFO: `/v3/projects/4e88e56e2eef463087766564936f55f4/users/4e04200f17b6422eaca78e0fa287e09d/roles/dba744f8ab2a4c45b9d3212f8d203aba` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:32.401486 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7178a5-b8f3-4794-b2f6-978b485f5f3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e88e56e2eef463087766564936f55f4, user_id=4e04200f17b6422eaca78e0fa287e09d, role_id=dba744f8ab2a4c45b9d3212f8d203aba)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:39:32.404182 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7178a5-b8f3-4794-b2f6-978b485f5f3a admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:39:32.486281 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1407/2813] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 17:39:32 2022] PUT /identity/v3/projects/4e88e56e2eef463087766564936f55f4/users/4e04200f17b6422eaca78e0fa287e09d/roles/dba744f8ab2a4c45b9d3212f8d203aba => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:39:32.490266 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bbd4d2-a65c-479b-8f4c-32b8218a4152 admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:39:32.500839 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bbd4d2-a65c-479b-8f4c-32b8218a4152 admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:39:32.567085 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3fd3c1-48c9-40f1-bc8a-81a0a70d6c09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:39:32.567766 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3fd3c1-48c9-40f1-bc8a-81a0a70d6c09 admin admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:32.568051 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3fd3c1-48c9-40f1-bc8a-81a0a70d6c09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:32.568329 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3fd3c1-48c9-40f1-bc8a-81a0a70d6c09 admin admin] PATH_INFO: `/v3/roles` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:32.569060 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3fd3c1-48c9-40f1-bc8a-81a0a70d6c09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:39:32.570693 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3fd3c1-48c9-40f1-bc8a-81a0a70d6c09 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:39:32.581568 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1407/2814] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 17:39:32 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:39:32.585789 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7178a5-b8f3-4794-b2f6-978b485f5f3a admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:39:32.597072 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7178a5-b8f3-4794-b2f6-978b485f5f3a admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:39:32.601984 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dab2f6-2b37-48e4-96c1-e291d8b7fc91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:39:32.602939 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dab2f6-2b37-48e4-96c1-e291d8b7fc91 admin admin] REQUEST_METHOD: `PUT` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:32.603224 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dab2f6-2b37-48e4-96c1-e291d8b7fc91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:32.603504 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dab2f6-2b37-48e4-96c1-e291d8b7fc91 admin admin] PATH_INFO: `/v3/projects/4e88e56e2eef463087766564936f55f4/users/4e04200f17b6422eaca78e0fa287e09d/roles/dba744f8ab2a4c45b9d3212f8d203aba` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:32.605602 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dab2f6-2b37-48e4-96c1-e291d8b7fc91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e88e56e2eef463087766564936f55f4, user_id=4e04200f17b6422eaca78e0fa287e09d, role_id=dba744f8ab2a4c45b9d3212f8d203aba)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:39:32.608334 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dab2f6-2b37-48e4-96c1-e291d8b7fc91 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:39:32.619915 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1408/2815] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 17:39:32 2022] PUT /identity/v3/projects/4e88e56e2eef463087766564936f55f4/users/4e04200f17b6422eaca78e0fa287e09d/roles/dba744f8ab2a4c45b9d3212f8d203aba => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:39:33.838620 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6446b077-33c8-44b0-b27a-b87fba3b8c28 None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:33.840800 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6446b077-33c8-44b0-b27a-b87fba3b8c28 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:33.840800 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6446b077-33c8-44b0-b27a-b87fba3b8c28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:33.870641 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-6446b077-33c8-44b0-b27a-b87fba3b8c28 None None] MFA Rules not processed for user `4e04200f17b6422eaca78e0fa287e09d`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:39:33.871885 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-6446b077-33c8-44b0-b27a-b87fba3b8c28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:39:33.952919 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1408/2816] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:39:33 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:39:34.721456 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dab2f6-2b37-48e4-96c1-e291d8b7fc91 admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:39:34.723388 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-69dab2f6-2b37-48e4-96c1-e291d8b7fc91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:39:34.798868 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dab2f6-2b37-48e4-96c1-e291d8b7fc91 admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:39:34.804350 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ae2f97-c7aa-44ea-86e8-89487303ec1c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2882f26811094d8e88c03701c94296fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:39:34.804988 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ae2f97-c7aa-44ea-86e8-89487303ec1c service placement] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:34.805307 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ae2f97-c7aa-44ea-86e8-89487303ec1c service placement] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:34.805593 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ae2f97-c7aa-44ea-86e8-89487303ec1c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:34.807441 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-f2ae2f97-c7aa-44ea-86e8-89487303ec1c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:39:34.820095 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ae2f97-c7aa-44ea-86e8-89487303ec1c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:39:34.821697 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ae2f97-c7aa-44ea-86e8-89487303ec1c service placement] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:39:34.826284 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:39:34.833558 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1409/2817] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:39:34 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:39:35.545170 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6446b077-33c8-44b0-b27a-b87fba3b8c28 None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:39:35.566836 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:39:35.617855 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6446b077-33c8-44b0-b27a-b87fba3b8c28 None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:39:35.622870 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d4e881-b38e-4090-b79a-41fa2b11ebe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:39:35.623869 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d4e881-b38e-4090-b79a-41fa2b11ebe3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:35.624159 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d4e881-b38e-4090-b79a-41fa2b11ebe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:35.624477 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d4e881-b38e-4090-b79a-41fa2b11ebe3 admin admin] PATH_INFO: `/v3/users/8ac676bcc8bd4b5bb49b72cacb91f838` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:35.625872 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d4e881-b38e-4090-b79a-41fa2b11ebe3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ac676bcc8bd4b5bb49b72cacb91f838)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:39:35.631529 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d4e881-b38e-4090-b79a-41fa2b11ebe3 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:39:35.824750 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-e5d4e881-b38e-4090-b79a-41fa2b11ebe3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ac676bcc8bd4b5bb49b72cacb91f838'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:39:35.825555 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-e5d4e881-b38e-4090-b79a-41fa2b11ebe3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ac676bcc8bd4b5bb49b72cacb91f838'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:39:35.826875 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-e5d4e881-b38e-4090-b79a-41fa2b11ebe3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ac676bcc8bd4b5bb49b72cacb91f838'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:39:35.896601 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-e5d4e881-b38e-4090-b79a-41fa2b11ebe3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ac676bcc8bd4b5bb49b72cacb91f838'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:39:35.906391 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-e5d4e881-b38e-4090-b79a-41fa2b11ebe3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ac676bcc8bd4b5bb49b72cacb91f838'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:39:35.924996 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1409/2818] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 16 17:39:35 2022] DELETE /identity/v3/users/8ac676bcc8bd4b5bb49b72cacb91f838 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:39:36.166379 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ae2f97-c7aa-44ea-86e8-89487303ec1c service placement] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:39:36.180235 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ae2f97-c7aa-44ea-86e8-89487303ec1c service placement] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:39:36.241046 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6895aad4-58fe-4afe-b732-2ee0bedefd1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:39:36.242004 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6895aad4-58fe-4afe-b732-2ee0bedefd1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:36.248287 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6895aad4-58fe-4afe-b732-2ee0bedefd1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:36.248287 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6895aad4-58fe-4afe-b732-2ee0bedefd1f admin admin] PATH_INFO: `/v3/projects/e1148dd8d38c4ed39bdde7da64b55b4b` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:36.248287 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6895aad4-58fe-4afe-b732-2ee0bedefd1f admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1148dd8d38c4ed39bdde7da64b55b4b)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:39:36.248287 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6895aad4-58fe-4afe-b732-2ee0bedefd1f admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:39:36.388221 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-6895aad4-58fe-4afe-b732-2ee0bedefd1f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1148dd8d38c4ed39bdde7da64b55b4b', 'request_id': 'req-6895aad4-58fe-4afe-b732-2ee0bedefd1f'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:39:36.394376 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-6895aad4-58fe-4afe-b732-2ee0bedefd1f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1148dd8d38c4ed39bdde7da64b55b4b', 'request_id': 'req-6895aad4-58fe-4afe-b732-2ee0bedefd1f'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:39:36.482241 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-6895aad4-58fe-4afe-b732-2ee0bedefd1f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1148dd8d38c4ed39bdde7da64b55b4b', 'request_id': 'req-6895aad4-58fe-4afe-b732-2ee0bedefd1f'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:39:36.494390 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-6895aad4-58fe-4afe-b732-2ee0bedefd1f admin admin] The token cache is being invalidate because project e1148dd8d38c4ed39bdde7da64b55b4b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80874) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 17:39:36.494680 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-6895aad4-58fe-4afe-b732-2ee0bedefd1f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:39:36.495332 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-6895aad4-58fe-4afe-b732-2ee0bedefd1f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:39:36.496883 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1410/2819] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 16 17:39:36 2022] DELETE /identity/v3/projects/e1148dd8d38c4ed39bdde7da64b55b4b => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:39:36.500987 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d4e881-b38e-4090-b79a-41fa2b11ebe3 admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:39:36.502435 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-e5d4e881-b38e-4090-b79a-41fa2b11ebe3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:39:36.516286 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d4e881-b38e-4090-b79a-41fa2b11ebe3 admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:39:36.577466 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5323cfa-fb3c-437f-98c7-300306a3547d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:39:36.578417 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5323cfa-fb3c-437f-98c7-300306a3547d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:36.578721 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5323cfa-fb3c-437f-98c7-300306a3547d admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:36.578985 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5323cfa-fb3c-437f-98c7-300306a3547d admin admin] PATH_INFO: `/v3/users/4e04200f17b6422eaca78e0fa287e09d` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:36.580258 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5323cfa-fb3c-437f-98c7-300306a3547d admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e04200f17b6422eaca78e0fa287e09d)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:39:36.582267 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5323cfa-fb3c-437f-98c7-300306a3547d admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:39:36.739308 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:39:36.745139 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-b5323cfa-fb3c-437f-98c7-300306a3547d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e04200f17b6422eaca78e0fa287e09d'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:39:36.745831 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-b5323cfa-fb3c-437f-98c7-300306a3547d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e04200f17b6422eaca78e0fa287e09d'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:39:36.746440 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-b5323cfa-fb3c-437f-98c7-300306a3547d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e04200f17b6422eaca78e0fa287e09d'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:39:36.805016 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-b5323cfa-fb3c-437f-98c7-300306a3547d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e04200f17b6422eaca78e0fa287e09d'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:39:36.813619 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-b5323cfa-fb3c-437f-98c7-300306a3547d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e04200f17b6422eaca78e0fa287e09d'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:39:36.831973 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1410/2820] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 16 17:39:36 2022] DELETE /identity/v3/users/4e04200f17b6422eaca78e0fa287e09d => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:39:37.126760 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6895aad4-58fe-4afe-b732-2ee0bedefd1f admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:39:37.128376 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-6895aad4-58fe-4afe-b732-2ee0bedefd1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:39:37.143038 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6895aad4-58fe-4afe-b732-2ee0bedefd1f admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:39:37.206439 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdce5b7-a619-4355-85b7-78c662f39bff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:39:37.207329 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdce5b7-a619-4355-85b7-78c662f39bff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:37.207630 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdce5b7-a619-4355-85b7-78c662f39bff admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:37.207914 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdce5b7-a619-4355-85b7-78c662f39bff admin admin] PATH_INFO: `/v3/projects/4e88e56e2eef463087766564936f55f4` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:37.209162 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdce5b7-a619-4355-85b7-78c662f39bff admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e88e56e2eef463087766564936f55f4)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:39:37.211166 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdce5b7-a619-4355-85b7-78c662f39bff admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:39:37.333572 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:39:37.348356 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-5bdce5b7-a619-4355-85b7-78c662f39bff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e88e56e2eef463087766564936f55f4', 'request_id': 'req-5bdce5b7-a619-4355-85b7-78c662f39bff'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:39:37.354233 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-5bdce5b7-a619-4355-85b7-78c662f39bff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e88e56e2eef463087766564936f55f4', 'request_id': 'req-5bdce5b7-a619-4355-85b7-78c662f39bff'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:39:37.425314 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-5bdce5b7-a619-4355-85b7-78c662f39bff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e88e56e2eef463087766564936f55f4', 'request_id': 'req-5bdce5b7-a619-4355-85b7-78c662f39bff'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:39:37.438881 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-5bdce5b7-a619-4355-85b7-78c662f39bff admin admin] The token cache is being invalidate because project 4e88e56e2eef463087766564936f55f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80874) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 17:39:37.439335 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-5bdce5b7-a619-4355-85b7-78c662f39bff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:39:37.440413 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-5bdce5b7-a619-4355-85b7-78c662f39bff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:39:37.442019 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1411/2821] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 16 17:39:37 2022] DELETE /identity/v3/projects/4e88e56e2eef463087766564936f55f4 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:39:37.447168 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7f86aa-97b6-486b-9bfa-7e5506866786 None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:37.447466 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7f86aa-97b6-486b-9bfa-7e5506866786 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:37.447751 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7f86aa-97b6-486b-9bfa-7e5506866786 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:37.469210 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-5d7f86aa-97b6-486b-9bfa-7e5506866786 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:39:37.470555 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-5d7f86aa-97b6-486b-9bfa-7e5506866786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:39:37.536576 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1411/2822] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:39:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:39:37.544461 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b2769d-cb41-4400-8704-44e03c579859 None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:37.544778 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b2769d-cb41-4400-8704-44e03c579859 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:37.545598 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b2769d-cb41-4400-8704-44e03c579859 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:37.565496 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-c0b2769d-cb41-4400-8704-44e03c579859 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:39:37.566791 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-c0b2769d-cb41-4400-8704-44e03c579859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:39:37.575054 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1412/2823] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:39:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:39:37.579410 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7f86aa-97b6-486b-9bfa-7e5506866786 None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:39:37.589408 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7f86aa-97b6-486b-9bfa-7e5506866786 None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:39:37.595315 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e131ee15-8c48-45d6-a2b2-38ce352e6aa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:39:37.595952 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e131ee15-8c48-45d6-a2b2-38ce352e6aa7 admin admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:37.596238 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e131ee15-8c48-45d6-a2b2-38ce352e6aa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:37.596579 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e131ee15-8c48-45d6-a2b2-38ce352e6aa7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:37.597320 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e131ee15-8c48-45d6-a2b2-38ce352e6aa7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80873) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:39:37.597628 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e131ee15-8c48-45d6-a2b2-38ce352e6aa7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:39:37.599282 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e131ee15-8c48-45d6-a2b2-38ce352e6aa7 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:39:37.612577 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1412/2824] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 16 17:39:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:39:37.617026 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b2769d-cb41-4400-8704-44e03c579859 None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:39:37.626767 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b2769d-cb41-4400-8704-44e03c579859 None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:39:37.631580 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558635e8-fe28-46ee-a403-73432b51c3bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:39:37.632253 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558635e8-fe28-46ee-a403-73432b51c3bb admin admin] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:37.632543 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558635e8-fe28-46ee-a403-73432b51c3bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:37.632825 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558635e8-fe28-46ee-a403-73432b51c3bb admin admin] PATH_INFO: `/v3/projects` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:37.634109 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558635e8-fe28-46ee-a403-73432b51c3bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:39:37.635681 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558635e8-fe28-46ee-a403-73432b51c3bb admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:39:37.773958 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1413/2825] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 16 17:39:37 2022] POST /identity/v3/projects => generated 373 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:39:37.778401 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e131ee15-8c48-45d6-a2b2-38ce352e6aa7 admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:39:37.790057 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e131ee15-8c48-45d6-a2b2-38ce352e6aa7 admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:39:37.851137 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea93cb66-ecab-43c2-83de-b5842782b1e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:39:37.851829 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea93cb66-ecab-43c2-83de-b5842782b1e3 admin admin] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:37.852116 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea93cb66-ecab-43c2-83de-b5842782b1e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:37.852394 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea93cb66-ecab-43c2-83de-b5842782b1e3 admin admin] PATH_INFO: `/v3/users` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:37.853099 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea93cb66-ecab-43c2-83de-b5842782b1e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:39:37.855110 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea93cb66-ecab-43c2-83de-b5842782b1e3 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:39:37.939908 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1413/2826] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 16 17:39:37 2022] POST /identity/v3/users => generated 287 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:39:37.943953 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558635e8-fe28-46ee-a403-73432b51c3bb admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:39:37.955556 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558635e8-fe28-46ee-a403-73432b51c3bb admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:39:37.960276 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ecda7f-1e80-4803-b10c-1712b0f021bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:39:37.963039 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ecda7f-1e80-4803-b10c-1712b0f021bc admin admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:37.963039 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ecda7f-1e80-4803-b10c-1712b0f021bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:37.963039 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ecda7f-1e80-4803-b10c-1712b0f021bc admin admin] PATH_INFO: `/v3/roles` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:37.963039 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ecda7f-1e80-4803-b10c-1712b0f021bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:39:37.963952 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ecda7f-1e80-4803-b10c-1712b0f021bc admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:39:37.975307 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1414/2827] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 17:39:37 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:39:37.979274 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea93cb66-ecab-43c2-83de-b5842782b1e3 admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:39:37.990051 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea93cb66-ecab-43c2-83de-b5842782b1e3 admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:39:37.994717 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5985cd11-3e5e-48d4-8846-43aaa383c7d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:39:37.995383 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5985cd11-3e5e-48d4-8846-43aaa383c7d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:37.995669 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5985cd11-3e5e-48d4-8846-43aaa383c7d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:37.995947 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5985cd11-3e5e-48d4-8846-43aaa383c7d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:37.996666 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5985cd11-3e5e-48d4-8846-43aaa383c7d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:39:37.998357 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5985cd11-3e5e-48d4-8846-43aaa383c7d6 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:39:38.008507 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1414/2828] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 17:39:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:39:38.012586 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ecda7f-1e80-4803-b10c-1712b0f021bc admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:39:38.023495 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ecda7f-1e80-4803-b10c-1712b0f021bc admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:39:38.028267 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889fb602-e733-4000-a0fa-c607648a36e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:39:38.029702 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889fb602-e733-4000-a0fa-c607648a36e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:38.030197 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889fb602-e733-4000-a0fa-c607648a36e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:38.030489 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889fb602-e733-4000-a0fa-c607648a36e2 admin admin] PATH_INFO: `/v3/projects/4a35b135273a46cc8d0b878cafe7d117/users/8ac89902753649f5afd9648085428950/roles/896bff49c5d6464eb612a15f4aa9badc` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:38.045607 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889fb602-e733-4000-a0fa-c607648a36e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a35b135273a46cc8d0b878cafe7d117, user_id=8ac89902753649f5afd9648085428950, role_id=896bff49c5d6464eb612a15f4aa9badc)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:39:38.048339 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889fb602-e733-4000-a0fa-c607648a36e2 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:39:38.125408 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1415/2829] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 17:39:38 2022] PUT /identity/v3/projects/4a35b135273a46cc8d0b878cafe7d117/users/8ac89902753649f5afd9648085428950/roles/896bff49c5d6464eb612a15f4aa9badc => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:39:38.135682 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75308f41-0949-4f31-b9d9-c9ddb59d6f9c None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:38.135981 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75308f41-0949-4f31-b9d9-c9ddb59d6f9c None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:38.136270 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75308f41-0949-4f31-b9d9-c9ddb59d6f9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:38.164538 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-75308f41-0949-4f31-b9d9-c9ddb59d6f9c None None] MFA Rules not processed for user `8ac89902753649f5afd9648085428950`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:39:38.165805 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-75308f41-0949-4f31-b9d9-c9ddb59d6f9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:39:38.175307 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:39:38.232729 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1415/2830] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:39:38 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 17:39:38.237607 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889fb602-e733-4000-a0fa-c607648a36e2 admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:39:38.302753 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889fb602-e733-4000-a0fa-c607648a36e2 admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:39:38.307510 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af59415-d2a7-46c3-9d4d-d3ffc74747da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:39:38.308441 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af59415-d2a7-46c3-9d4d-d3ffc74747da admin admin] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:38.308730 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af59415-d2a7-46c3-9d4d-d3ffc74747da admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:38.309012 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af59415-d2a7-46c3-9d4d-d3ffc74747da admin admin] PATH_INFO: `/v3/projects` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:38.309711 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af59415-d2a7-46c3-9d4d-d3ffc74747da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:39:38.312144 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af59415-d2a7-46c3-9d4d-d3ffc74747da admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:39:38.407306 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1416/2831] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 16 17:39:38 2022] POST /identity/v3/projects => generated 373 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:39:38.411439 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75308f41-0949-4f31-b9d9-c9ddb59d6f9c None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:39:38.423161 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75308f41-0949-4f31-b9d9-c9ddb59d6f9c None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:39:38.481788 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19403562-62da-4045-accf-fc7a9ca7d9c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:39:38.483139 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19403562-62da-4045-accf-fc7a9ca7d9c5 admin admin] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:38.483427 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19403562-62da-4045-accf-fc7a9ca7d9c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:38.483708 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19403562-62da-4045-accf-fc7a9ca7d9c5 admin admin] PATH_INFO: `/v3/users` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:38.484400 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19403562-62da-4045-accf-fc7a9ca7d9c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:39:38.486410 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19403562-62da-4045-accf-fc7a9ca7d9c5 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:39:38.562718 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1416/2832] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 16 17:39:38 2022] POST /identity/v3/users => generated 293 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:39:38.566757 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af59415-d2a7-46c3-9d4d-d3ffc74747da admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:39:38.577630 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af59415-d2a7-46c3-9d4d-d3ffc74747da admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:39:38.582509 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6868d933-70e2-4af8-9ca0-ca7b02d1923f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:39:38.583403 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6868d933-70e2-4af8-9ca0-ca7b02d1923f admin admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:38.583929 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6868d933-70e2-4af8-9ca0-ca7b02d1923f admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:38.584448 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6868d933-70e2-4af8-9ca0-ca7b02d1923f admin admin] PATH_INFO: `/v3/roles` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:38.585339 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6868d933-70e2-4af8-9ca0-ca7b02d1923f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:39:38.587103 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6868d933-70e2-4af8-9ca0-ca7b02d1923f admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:39:38.600135 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1417/2833] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 17:39:38 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:39:38.604469 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19403562-62da-4045-accf-fc7a9ca7d9c5 admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:39:38.617076 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19403562-62da-4045-accf-fc7a9ca7d9c5 admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:39:38.621789 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f21cfeb-cf29-4ad9-8a80-1a74f827d925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:39:38.622683 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f21cfeb-cf29-4ad9-8a80-1a74f827d925 admin admin] REQUEST_METHOD: `PUT` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:38.622974 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f21cfeb-cf29-4ad9-8a80-1a74f827d925 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:38.623258 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f21cfeb-cf29-4ad9-8a80-1a74f827d925 admin admin] PATH_INFO: `/v3/projects/e84c1c92e3854cbd9096ab49918dd977/users/cb04e0577d62492c918c73758c65b0d6/roles/dba744f8ab2a4c45b9d3212f8d203aba` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:38.637861 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f21cfeb-cf29-4ad9-8a80-1a74f827d925 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e84c1c92e3854cbd9096ab49918dd977, user_id=cb04e0577d62492c918c73758c65b0d6, role_id=dba744f8ab2a4c45b9d3212f8d203aba)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:39:38.640751 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f21cfeb-cf29-4ad9-8a80-1a74f827d925 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:39:38.734967 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1417/2834] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 17:39:38 2022] PUT /identity/v3/projects/e84c1c92e3854cbd9096ab49918dd977/users/cb04e0577d62492c918c73758c65b0d6/roles/dba744f8ab2a4c45b9d3212f8d203aba => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:39:38.739623 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6868d933-70e2-4af8-9ca0-ca7b02d1923f admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:39:38.751374 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6868d933-70e2-4af8-9ca0-ca7b02d1923f admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:39:38.778361 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:39:38.813004 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88b36bb-680f-4a32-97da-2e05e765e149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:39:38.813602 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88b36bb-680f-4a32-97da-2e05e765e149 admin admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:38.813934 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88b36bb-680f-4a32-97da-2e05e765e149 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:38.814220 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88b36bb-680f-4a32-97da-2e05e765e149 admin admin] PATH_INFO: `/v3/roles` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:38.815024 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88b36bb-680f-4a32-97da-2e05e765e149 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:39:38.816641 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88b36bb-680f-4a32-97da-2e05e765e149 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:39:38.827659 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1418/2835] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 17:39:38 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:39:38.832003 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f21cfeb-cf29-4ad9-8a80-1a74f827d925 admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:39:38.843033 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f21cfeb-cf29-4ad9-8a80-1a74f827d925 admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:39:38.847857 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7400ec9-0632-4b03-89c4-41e00dd7a585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:39:38.848810 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7400ec9-0632-4b03-89c4-41e00dd7a585 admin admin] REQUEST_METHOD: `PUT` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:38.849105 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7400ec9-0632-4b03-89c4-41e00dd7a585 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:38.849389 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7400ec9-0632-4b03-89c4-41e00dd7a585 admin admin] PATH_INFO: `/v3/projects/e84c1c92e3854cbd9096ab49918dd977/users/cb04e0577d62492c918c73758c65b0d6/roles/dba744f8ab2a4c45b9d3212f8d203aba` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:38.851429 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7400ec9-0632-4b03-89c4-41e00dd7a585 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e84c1c92e3854cbd9096ab49918dd977, user_id=cb04e0577d62492c918c73758c65b0d6, role_id=dba744f8ab2a4c45b9d3212f8d203aba)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:39:38.854110 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7400ec9-0632-4b03-89c4-41e00dd7a585 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:39:38.870117 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1418/2836] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 17:39:38 2022] PUT /identity/v3/projects/e84c1c92e3854cbd9096ab49918dd977/users/cb04e0577d62492c918c73758c65b0d6/roles/dba744f8ab2a4c45b9d3212f8d203aba => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:39:38.933465 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40bada9-f266-4c11-87f3-0802015e2317 None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:38.933985 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40bada9-f266-4c11-87f3-0802015e2317 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:38.934459 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40bada9-f266-4c11-87f3-0802015e2317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:38.968467 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-b40bada9-f266-4c11-87f3-0802015e2317 None None] MFA Rules not processed for user `cb04e0577d62492c918c73758c65b0d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:39:38.969720 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-b40bada9-f266-4c11-87f3-0802015e2317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:39:39.047086 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1419/2837] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:39:38 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:39:39.059326 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7400ec9-0632-4b03-89c4-41e00dd7a585 admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:39:39.061598 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-f7400ec9-0632-4b03-89c4-41e00dd7a585 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:39:39.136193 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:39:39.145075 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7400ec9-0632-4b03-89c4-41e00dd7a585 admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:39:39.154962 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc6cc7e-d02c-4c54-bb5b-e9c8e9bb379b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef37136b89d34edc9cd94c7aa81b2095', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:39:39.154962 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc6cc7e-d02c-4c54-bb5b-e9c8e9bb379b service cinder] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:39.154962 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc6cc7e-d02c-4c54-bb5b-e9c8e9bb379b service cinder] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:39.154962 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc6cc7e-d02c-4c54-bb5b-e9c8e9bb379b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:39.159954 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc6cc7e-d02c-4c54-bb5b-e9c8e9bb379b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:39:39.161401 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc6cc7e-d02c-4c54-bb5b-e9c8e9bb379b service cinder] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:39:39.171532 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1419/2838] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:39:39 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 17:39:39.401727 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40bada9-f266-4c11-87f3-0802015e2317 None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:39:39.412166 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40bada9-f266-4c11-87f3-0802015e2317 None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:39:39.415883 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc0ff6f-958f-4fd1-85df-c8dea8178fb2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef37136b89d34edc9cd94c7aa81b2095', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:39:39.416537 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc0ff6f-958f-4fd1-85df-c8dea8178fb2 service cinder] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:39.416824 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc0ff6f-958f-4fd1-85df-c8dea8178fb2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:39.417109 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc0ff6f-958f-4fd1-85df-c8dea8178fb2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:39.477957 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc0ff6f-958f-4fd1-85df-c8dea8178fb2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:39:39.479423 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc0ff6f-958f-4fd1-85df-c8dea8178fb2 service cinder] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:39:39.492785 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1420/2839] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:39:39 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:39:49.219390 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=6 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:39:49.487719 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=78 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:40:16.426029 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc6cc7e-d02c-4c54-bb5b-e9c8e9bb379b service cinder] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:16.491258 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc6cc7e-d02c-4c54-bb5b-e9c8e9bb379b service cinder] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:16.496086 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca4b4c1-fd04-4d1d-a9ed-c34937922404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:16.496970 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca4b4c1-fd04-4d1d-a9ed-c34937922404 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:16.497242 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca4b4c1-fd04-4d1d-a9ed-c34937922404 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:16.497520 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca4b4c1-fd04-4d1d-a9ed-c34937922404 admin admin] PATH_INFO: `/v3/users/8ac89902753649f5afd9648085428950` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:16.498906 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca4b4c1-fd04-4d1d-a9ed-c34937922404 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ac89902753649f5afd9648085428950)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:16.500824 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca4b4c1-fd04-4d1d-a9ed-c34937922404 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:16.716837 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-1ca4b4c1-fd04-4d1d-a9ed-c34937922404 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ac89902753649f5afd9648085428950'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:16.717448 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-1ca4b4c1-fd04-4d1d-a9ed-c34937922404 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ac89902753649f5afd9648085428950'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:16.718104 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-1ca4b4c1-fd04-4d1d-a9ed-c34937922404 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ac89902753649f5afd9648085428950'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:16.810030 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-1ca4b4c1-fd04-4d1d-a9ed-c34937922404 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ac89902753649f5afd9648085428950'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:16.818091 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-1ca4b4c1-fd04-4d1d-a9ed-c34937922404 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ac89902753649f5afd9648085428950'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:16.840224 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1420/2840] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 16 17:40:16 2022] DELETE /identity/v3/users/8ac89902753649f5afd9648085428950 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:40:16.849190 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaa592b-c7b4-47d9-833f-9317e9dab313 None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:16.849732 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaa592b-c7b4-47d9-833f-9317e9dab313 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:16.849732 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaa592b-c7b4-47d9-833f-9317e9dab313 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:16.929823 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-2eaa592b-c7b4-47d9-833f-9317e9dab313 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:40:16.931092 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-2eaa592b-c7b4-47d9-833f-9317e9dab313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:16.991960 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1421/2841] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:40:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:40:17.002425 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca4b4c1-fd04-4d1d-a9ed-c34937922404 admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:17.003899 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-1ca4b4c1-fd04-4d1d-a9ed-c34937922404 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:17.063783 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca4b4c1-fd04-4d1d-a9ed-c34937922404 admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:17.067519 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e161ea3-4a92-4c60-aaa5-4be9c9cdd34f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5d25bfa8dc042329d57cd55fa7b7b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:17.068164 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e161ea3-4a92-4c60-aaa5-4be9c9cdd34f service neutron] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:17.068452 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e161ea3-4a92-4c60-aaa5-4be9c9cdd34f service neutron] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:17.068732 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e161ea3-4a92-4c60-aaa5-4be9c9cdd34f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:17.083808 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e161ea3-4a92-4c60-aaa5-4be9c9cdd34f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:17.086291 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e161ea3-4a92-4c60-aaa5-4be9c9cdd34f service neutron] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:17.099241 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1421/2842] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:40:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:40:17.580136 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaa592b-c7b4-47d9-833f-9317e9dab313 None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:17.581809 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-2eaa592b-c7b4-47d9-833f-9317e9dab313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:17.594892 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaa592b-c7b4-47d9-833f-9317e9dab313 None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:17.599933 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42459e5-f4b4-427e-882d-9674237b0d05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:17.600815 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42459e5-f4b4-427e-882d-9674237b0d05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:17.601102 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42459e5-f4b4-427e-882d-9674237b0d05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:17.601427 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42459e5-f4b4-427e-882d-9674237b0d05 admin admin] PATH_INFO: `/v3/projects/4a35b135273a46cc8d0b878cafe7d117` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:17.602701 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42459e5-f4b4-427e-882d-9674237b0d05 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a35b135273a46cc8d0b878cafe7d117)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:17.604678 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42459e5-f4b4-427e-882d-9674237b0d05 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:17.750612 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-d42459e5-f4b4-427e-882d-9674237b0d05 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a35b135273a46cc8d0b878cafe7d117', 'request_id': 'req-d42459e5-f4b4-427e-882d-9674237b0d05'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:17.756071 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-d42459e5-f4b4-427e-882d-9674237b0d05 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a35b135273a46cc8d0b878cafe7d117', 'request_id': 'req-d42459e5-f4b4-427e-882d-9674237b0d05'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:17.843912 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-d42459e5-f4b4-427e-882d-9674237b0d05 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a35b135273a46cc8d0b878cafe7d117', 'request_id': 'req-d42459e5-f4b4-427e-882d-9674237b0d05'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:17.856054 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-d42459e5-f4b4-427e-882d-9674237b0d05 admin admin] The token cache is being invalidate because project 4a35b135273a46cc8d0b878cafe7d117 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80874) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 17:40:17.858369 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-d42459e5-f4b4-427e-882d-9674237b0d05 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:17.858369 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-d42459e5-f4b4-427e-882d-9674237b0d05 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:17.858960 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1422/2843] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 16 17:40:17 2022] DELETE /identity/v3/projects/4a35b135273a46cc8d0b878cafe7d117 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 17:40:17.862731 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e161ea3-4a92-4c60-aaa5-4be9c9cdd34f service neutron] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:17.872533 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e161ea3-4a92-4c60-aaa5-4be9c9cdd34f service neutron] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:17.895398 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:40:17.942751 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8642a9b2-4541-49cf-aeda-b01f64d8d28d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:17.943634 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8642a9b2-4541-49cf-aeda-b01f64d8d28d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:17.943920 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8642a9b2-4541-49cf-aeda-b01f64d8d28d admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:17.944199 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8642a9b2-4541-49cf-aeda-b01f64d8d28d admin admin] PATH_INFO: `/v3/users/cb04e0577d62492c918c73758c65b0d6` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:17.945398 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8642a9b2-4541-49cf-aeda-b01f64d8d28d admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb04e0577d62492c918c73758c65b0d6)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:17.947348 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8642a9b2-4541-49cf-aeda-b01f64d8d28d admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:18.197557 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-8642a9b2-4541-49cf-aeda-b01f64d8d28d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb04e0577d62492c918c73758c65b0d6'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:18.198314 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-8642a9b2-4541-49cf-aeda-b01f64d8d28d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb04e0577d62492c918c73758c65b0d6'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:18.198919 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-8642a9b2-4541-49cf-aeda-b01f64d8d28d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb04e0577d62492c918c73758c65b0d6'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:18.270044 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-8642a9b2-4541-49cf-aeda-b01f64d8d28d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb04e0577d62492c918c73758c65b0d6'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:18.280208 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-8642a9b2-4541-49cf-aeda-b01f64d8d28d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb04e0577d62492c918c73758c65b0d6'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:18.305260 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1422/2844] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 16 17:40:17 2022] DELETE /identity/v3/users/cb04e0577d62492c918c73758c65b0d6 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:40:18.751376 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42459e5-f4b4-427e-882d-9674237b0d05 admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:18.752823 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-d42459e5-f4b4-427e-882d-9674237b0d05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:18.776743 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42459e5-f4b4-427e-882d-9674237b0d05 admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:18.850278 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483297e1-f3a1-4ddf-b3d6-6b80f60090ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:18.851160 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483297e1-f3a1-4ddf-b3d6-6b80f60090ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:18.851438 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483297e1-f3a1-4ddf-b3d6-6b80f60090ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:18.851715 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483297e1-f3a1-4ddf-b3d6-6b80f60090ba admin admin] PATH_INFO: `/v3/projects/e84c1c92e3854cbd9096ab49918dd977` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:18.852977 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483297e1-f3a1-4ddf-b3d6-6b80f60090ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=e84c1c92e3854cbd9096ab49918dd977)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:18.855005 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483297e1-f3a1-4ddf-b3d6-6b80f60090ba admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:18.994396 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:40:19.011615 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-483297e1-f3a1-4ddf-b3d6-6b80f60090ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e84c1c92e3854cbd9096ab49918dd977', 'request_id': 'req-483297e1-f3a1-4ddf-b3d6-6b80f60090ba'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:19.017683 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-483297e1-f3a1-4ddf-b3d6-6b80f60090ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e84c1c92e3854cbd9096ab49918dd977', 'request_id': 'req-483297e1-f3a1-4ddf-b3d6-6b80f60090ba'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:19.089845 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-483297e1-f3a1-4ddf-b3d6-6b80f60090ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e84c1c92e3854cbd9096ab49918dd977', 'request_id': 'req-483297e1-f3a1-4ddf-b3d6-6b80f60090ba'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:19.103622 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-483297e1-f3a1-4ddf-b3d6-6b80f60090ba admin admin] The token cache is being invalidate because project e84c1c92e3854cbd9096ab49918dd977 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80874) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 17:40:19.103907 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-483297e1-f3a1-4ddf-b3d6-6b80f60090ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:19.104576 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-483297e1-f3a1-4ddf-b3d6-6b80f60090ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:19.106396 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1423/2845] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 16 17:40:18 2022] DELETE /identity/v3/projects/e84c1c92e3854cbd9096ab49918dd977 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:40:19.111666 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b10e20-253d-4099-939c-f07bf07a181c None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:19.112335 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b10e20-253d-4099-939c-f07bf07a181c None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:19.112335 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b10e20-253d-4099-939c-f07bf07a181c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:19.131086 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-83b10e20-253d-4099-939c-f07bf07a181c None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:40:19.132336 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-83b10e20-253d-4099-939c-f07bf07a181c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:19.199024 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1423/2846] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:40:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:40:19.207199 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905100a1-7ed5-44f0-ac63-0b8320409364 None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:19.207499 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905100a1-7ed5-44f0-ac63-0b8320409364 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:19.207789 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905100a1-7ed5-44f0-ac63-0b8320409364 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:19.229279 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-905100a1-7ed5-44f0-ac63-0b8320409364 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:40:19.231076 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-905100a1-7ed5-44f0-ac63-0b8320409364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:19.239939 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1424/2847] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:40:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:40:19.244604 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b10e20-253d-4099-939c-f07bf07a181c None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:19.255993 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b10e20-253d-4099-939c-f07bf07a181c None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:19.260935 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ebf95c-5eac-4465-9059-2002c139b620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:19.261689 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ebf95c-5eac-4465-9059-2002c139b620 admin admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:19.262014 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ebf95c-5eac-4465-9059-2002c139b620 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:19.262302 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ebf95c-5eac-4465-9059-2002c139b620 admin admin] PATH_INFO: `/v3/domains` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:19.263042 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ebf95c-5eac-4465-9059-2002c139b620 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80873) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:40:19.263353 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ebf95c-5eac-4465-9059-2002c139b620 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:19.264958 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ebf95c-5eac-4465-9059-2002c139b620 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:19.276885 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1424/2848] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 16 17:40:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:40:19.281335 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905100a1-7ed5-44f0-ac63-0b8320409364 None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:19.291349 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905100a1-7ed5-44f0-ac63-0b8320409364 None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:19.298023 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6247d24-71aa-41d0-b11d-f4a9c7a04ba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:19.298860 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6247d24-71aa-41d0-b11d-f4a9c7a04ba5 admin admin] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:19.299257 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6247d24-71aa-41d0-b11d-f4a9c7a04ba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:19.299649 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6247d24-71aa-41d0-b11d-f4a9c7a04ba5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:19.300488 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6247d24-71aa-41d0-b11d-f4a9c7a04ba5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:19.302975 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6247d24-71aa-41d0-b11d-f4a9c7a04ba5 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:19.391433 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1425/2849] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 16 17:40:19 2022] POST /identity/v3/projects => generated 379 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:40:19.395628 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ebf95c-5eac-4465-9059-2002c139b620 admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:19.405799 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ebf95c-5eac-4465-9059-2002c139b620 admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:19.434322 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:40:19.470094 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e0c23f-e89d-47ae-a6d9-cfe4d5d11ecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:19.470811 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e0c23f-e89d-47ae-a6d9-cfe4d5d11ecf admin admin] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:19.471168 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e0c23f-e89d-47ae-a6d9-cfe4d5d11ecf admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:19.471453 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e0c23f-e89d-47ae-a6d9-cfe4d5d11ecf admin admin] PATH_INFO: `/v3/users` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:19.472171 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e0c23f-e89d-47ae-a6d9-cfe4d5d11ecf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:19.474458 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e0c23f-e89d-47ae-a6d9-cfe4d5d11ecf admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:19.581848 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1425/2850] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 16 17:40:19 2022] POST /identity/v3/users => generated 290 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:40:19.587230 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6247d24-71aa-41d0-b11d-f4a9c7a04ba5 admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:19.599522 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6247d24-71aa-41d0-b11d-f4a9c7a04ba5 admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:19.606388 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2eb254e-a0f1-4d1b-94d4-68357320877e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:19.607077 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eb254e-a0f1-4d1b-94d4-68357320877e admin admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:19.607365 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eb254e-a0f1-4d1b-94d4-68357320877e admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:19.607654 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eb254e-a0f1-4d1b-94d4-68357320877e admin admin] PATH_INFO: `/v3/roles` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:19.608402 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2eb254e-a0f1-4d1b-94d4-68357320877e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:19.610085 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2eb254e-a0f1-4d1b-94d4-68357320877e admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:19.621114 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1426/2851] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 17:40:19 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 17:40:19.625564 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e0c23f-e89d-47ae-a6d9-cfe4d5d11ecf admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:19.635724 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e0c23f-e89d-47ae-a6d9-cfe4d5d11ecf admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:19.640466 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a5905c-6f46-4825-b979-0da0e5664565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:19.641118 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a5905c-6f46-4825-b979-0da0e5664565 admin admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:19.641405 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a5905c-6f46-4825-b979-0da0e5664565 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:19.641680 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a5905c-6f46-4825-b979-0da0e5664565 admin admin] PATH_INFO: `/v3/roles` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:19.642438 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a5905c-6f46-4825-b979-0da0e5664565 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:19.644342 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a5905c-6f46-4825-b979-0da0e5664565 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:19.662919 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1426/2852] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 17:40:19 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:40:19.670109 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2eb254e-a0f1-4d1b-94d4-68357320877e admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:19.680982 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2eb254e-a0f1-4d1b-94d4-68357320877e admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:19.686185 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933e59b7-6176-4f24-a604-20a7c84a83cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:19.687081 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933e59b7-6176-4f24-a604-20a7c84a83cf admin admin] REQUEST_METHOD: `PUT` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:19.687364 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933e59b7-6176-4f24-a604-20a7c84a83cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:19.687642 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933e59b7-6176-4f24-a604-20a7c84a83cf admin admin] PATH_INFO: `/v3/projects/cc61cde30fda486d819f58204cb3dd4e/users/0de842b999bc4382a108d18a70b7d792/roles/896bff49c5d6464eb612a15f4aa9badc` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:19.703583 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933e59b7-6176-4f24-a604-20a7c84a83cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc61cde30fda486d819f58204cb3dd4e, user_id=0de842b999bc4382a108d18a70b7d792, role_id=896bff49c5d6464eb612a15f4aa9badc)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:19.706306 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933e59b7-6176-4f24-a604-20a7c84a83cf admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:19.790913 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1427/2853] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 17:40:19 2022] PUT /identity/v3/projects/cc61cde30fda486d819f58204cb3dd4e/users/0de842b999bc4382a108d18a70b7d792/roles/896bff49c5d6464eb612a15f4aa9badc => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:40:19.802970 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30b263f-4742-4e41-b6e0-6e7aca35217e None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:19.803267 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30b263f-4742-4e41-b6e0-6e7aca35217e None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:19.803552 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30b263f-4742-4e41-b6e0-6e7aca35217e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:19.834047 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-a30b263f-4742-4e41-b6e0-6e7aca35217e None None] MFA Rules not processed for user `0de842b999bc4382a108d18a70b7d792`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:40:19.835169 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-a30b263f-4742-4e41-b6e0-6e7aca35217e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:19.910785 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1427/2854] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:40:19 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:40:19.915596 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933e59b7-6176-4f24-a604-20a7c84a83cf admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:19.988475 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933e59b7-6176-4f24-a604-20a7c84a83cf admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:19.993464 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d33592-2c04-4f86-9057-920bcc2e12cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:19.994165 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d33592-2c04-4f86-9057-920bcc2e12cf admin admin] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:19.994559 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d33592-2c04-4f86-9057-920bcc2e12cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:19.995141 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d33592-2c04-4f86-9057-920bcc2e12cf admin admin] PATH_INFO: `/v3/projects` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:19.995450 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d33592-2c04-4f86-9057-920bcc2e12cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:19.997437 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d33592-2c04-4f86-9057-920bcc2e12cf admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:20.105647 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1428/2855] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 16 17:40:19 2022] POST /identity/v3/projects => generated 381 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 17:40:20.109683 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30b263f-4742-4e41-b6e0-6e7aca35217e None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:20.121088 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30b263f-4742-4e41-b6e0-6e7aca35217e None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:20.181000 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712e8482-3217-4c2c-a419-58405b592231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:20.182256 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712e8482-3217-4c2c-a419-58405b592231 admin admin] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:20.182548 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712e8482-3217-4c2c-a419-58405b592231 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:20.182833 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712e8482-3217-4c2c-a419-58405b592231 admin admin] PATH_INFO: `/v3/users` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:20.183566 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712e8482-3217-4c2c-a419-58405b592231 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:20.185492 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712e8482-3217-4c2c-a419-58405b592231 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:20.282026 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1428/2856] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 16 17:40:20 2022] POST /identity/v3/users => generated 297 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:40:20.286224 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d33592-2c04-4f86-9057-920bcc2e12cf admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:20.296695 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d33592-2c04-4f86-9057-920bcc2e12cf admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:20.301531 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e649a7-f231-4791-a33d-5c42de158057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:20.302228 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e649a7-f231-4791-a33d-5c42de158057 admin admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:20.302515 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e649a7-f231-4791-a33d-5c42de158057 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:20.302796 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e649a7-f231-4791-a33d-5c42de158057 admin admin] PATH_INFO: `/v3/roles` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:20.303522 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e649a7-f231-4791-a33d-5c42de158057 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:20.305180 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e649a7-f231-4791-a33d-5c42de158057 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:20.316964 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1429/2857] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 17:40:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:40:20.321994 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712e8482-3217-4c2c-a419-58405b592231 admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:20.333708 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712e8482-3217-4c2c-a419-58405b592231 admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:20.338796 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c3a39d-3a73-4003-b05c-0bf9d9f569fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:20.339839 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c3a39d-3a73-4003-b05c-0bf9d9f569fd admin admin] REQUEST_METHOD: `PUT` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:20.340120 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c3a39d-3a73-4003-b05c-0bf9d9f569fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:20.340404 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c3a39d-3a73-4003-b05c-0bf9d9f569fd admin admin] PATH_INFO: `/v3/projects/a55394db66a1482b8658a406893c5d43/users/1f91d8d86117462aabed045cfde33845/roles/dba744f8ab2a4c45b9d3212f8d203aba` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:20.360670 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c3a39d-3a73-4003-b05c-0bf9d9f569fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=a55394db66a1482b8658a406893c5d43, user_id=1f91d8d86117462aabed045cfde33845, role_id=dba744f8ab2a4c45b9d3212f8d203aba)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:20.363417 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c3a39d-3a73-4003-b05c-0bf9d9f569fd admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:20.439279 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1429/2858] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 17:40:20 2022] PUT /identity/v3/projects/a55394db66a1482b8658a406893c5d43/users/1f91d8d86117462aabed045cfde33845/roles/dba744f8ab2a4c45b9d3212f8d203aba => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:40:20.443336 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e649a7-f231-4791-a33d-5c42de158057 admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:20.455949 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e649a7-f231-4791-a33d-5c42de158057 admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:20.480622 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:40:20.523338 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ec1a5c-75f3-460d-8632-859e225d8435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:20.524061 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ec1a5c-75f3-460d-8632-859e225d8435 admin admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:20.524349 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ec1a5c-75f3-460d-8632-859e225d8435 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:20.524632 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ec1a5c-75f3-460d-8632-859e225d8435 admin admin] PATH_INFO: `/v3/roles` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:20.525380 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ec1a5c-75f3-460d-8632-859e225d8435 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:20.527049 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ec1a5c-75f3-460d-8632-859e225d8435 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:20.538312 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1430/2859] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 17:40:20 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:40:20.542971 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c3a39d-3a73-4003-b05c-0bf9d9f569fd admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:20.548544 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:40:20.555065 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c3a39d-3a73-4003-b05c-0bf9d9f569fd admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:20.561752 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf3f9b4-1a69-40b9-b1c3-852826027a7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:20.562714 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf3f9b4-1a69-40b9-b1c3-852826027a7f admin admin] REQUEST_METHOD: `PUT` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:20.564269 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf3f9b4-1a69-40b9-b1c3-852826027a7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:20.564269 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf3f9b4-1a69-40b9-b1c3-852826027a7f admin admin] PATH_INFO: `/v3/projects/a55394db66a1482b8658a406893c5d43/users/1f91d8d86117462aabed045cfde33845/roles/dba744f8ab2a4c45b9d3212f8d203aba` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:20.565399 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf3f9b4-1a69-40b9-b1c3-852826027a7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a55394db66a1482b8658a406893c5d43, user_id=1f91d8d86117462aabed045cfde33845, role_id=dba744f8ab2a4c45b9d3212f8d203aba)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:20.568131 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf3f9b4-1a69-40b9-b1c3-852826027a7f admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:20.580988 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1430/2860] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 17:40:20 2022] PUT /identity/v3/projects/a55394db66a1482b8658a406893c5d43/users/1f91d8d86117462aabed045cfde33845/roles/dba744f8ab2a4c45b9d3212f8d203aba => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 17:40:20.591807 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcc1d0c-a63b-4623-aaa5-908071e22f03 None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:20.592097 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcc1d0c-a63b-4623-aaa5-908071e22f03 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:20.592383 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcc1d0c-a63b-4623-aaa5-908071e22f03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:20.622321 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-abcc1d0c-a63b-4623-aaa5-908071e22f03 None None] MFA Rules not processed for user `1f91d8d86117462aabed045cfde33845`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:40:20.624953 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-abcc1d0c-a63b-4623-aaa5-908071e22f03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:20.709317 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1431/2861] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:40:20 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 17:40:20.721638 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf3f9b4-1a69-40b9-b1c3-852826027a7f admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:20.723518 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-ecf3f9b4-1a69-40b9-b1c3-852826027a7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:20.782406 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf3f9b4-1a69-40b9-b1c3-852826027a7f admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:20.786107 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4348b720-8acf-4355-bc3c-f954cb668dd1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef37136b89d34edc9cd94c7aa81b2095', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:20.786754 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4348b720-8acf-4355-bc3c-f954cb668dd1 service cinder] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:20.787043 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4348b720-8acf-4355-bc3c-f954cb668dd1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:20.787324 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4348b720-8acf-4355-bc3c-f954cb668dd1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:20.807341 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4348b720-8acf-4355-bc3c-f954cb668dd1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:20.809471 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4348b720-8acf-4355-bc3c-f954cb668dd1 service cinder] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:20.820405 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1431/2862] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:40:20 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:40:21.128380 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcc1d0c-a63b-4623-aaa5-908071e22f03 None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:21.138742 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcc1d0c-a63b-4623-aaa5-908071e22f03 None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:21.142445 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82057edb-c780-46a1-91d3-173000d7c44e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef37136b89d34edc9cd94c7aa81b2095', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:21.143102 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82057edb-c780-46a1-91d3-173000d7c44e service cinder] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:21.143391 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82057edb-c780-46a1-91d3-173000d7c44e service cinder] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:21.143672 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82057edb-c780-46a1-91d3-173000d7c44e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:21.203925 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82057edb-c780-46a1-91d3-173000d7c44e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:21.205869 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82057edb-c780-46a1-91d3-173000d7c44e service cinder] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:21.219193 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1432/2863] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:40:21 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:40:30.057175 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4348b720-8acf-4355-bc3c-f954cb668dd1 service cinder] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:30.127934 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4348b720-8acf-4355-bc3c-f954cb668dd1 service cinder] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:30.132831 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c16f3a5-79bc-44e7-808c-bec201ae8c34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:30.134197 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c16f3a5-79bc-44e7-808c-bec201ae8c34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:30.134197 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c16f3a5-79bc-44e7-808c-bec201ae8c34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:30.134499 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c16f3a5-79bc-44e7-808c-bec201ae8c34 admin admin] PATH_INFO: `/v3/users/0de842b999bc4382a108d18a70b7d792` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:30.135765 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c16f3a5-79bc-44e7-808c-bec201ae8c34 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0de842b999bc4382a108d18a70b7d792)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:30.137967 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c16f3a5-79bc-44e7-808c-bec201ae8c34 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:30.313568 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-3c16f3a5-79bc-44e7-808c-bec201ae8c34 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0de842b999bc4382a108d18a70b7d792'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:30.314548 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-3c16f3a5-79bc-44e7-808c-bec201ae8c34 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0de842b999bc4382a108d18a70b7d792'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:30.315441 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-3c16f3a5-79bc-44e7-808c-bec201ae8c34 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0de842b999bc4382a108d18a70b7d792'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:30.380806 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-3c16f3a5-79bc-44e7-808c-bec201ae8c34 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0de842b999bc4382a108d18a70b7d792'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:30.389463 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-3c16f3a5-79bc-44e7-808c-bec201ae8c34 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0de842b999bc4382a108d18a70b7d792'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:30.410467 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1432/2864] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 16 17:40:30 2022] DELETE /identity/v3/users/0de842b999bc4382a108d18a70b7d792 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 17:40:30.416415 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a467b79b-7bf3-4aa1-ba72-a0b89a5e72ff None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:30.417190 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a467b79b-7bf3-4aa1-ba72-a0b89a5e72ff None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:30.417190 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a467b79b-7bf3-4aa1-ba72-a0b89a5e72ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:30.437549 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-a467b79b-7bf3-4aa1-ba72-a0b89a5e72ff None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:40:30.439057 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-a467b79b-7bf3-4aa1-ba72-a0b89a5e72ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:30.492193 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=100 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:40:30.520447 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1433/2865] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:40:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:40:30.534864 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c16f3a5-79bc-44e7-808c-bec201ae8c34 admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:30.537001 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-3c16f3a5-79bc-44e7-808c-bec201ae8c34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:30.562513 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:40:30.632451 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c16f3a5-79bc-44e7-808c-bec201ae8c34 admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:30.642909 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a0e12d-e37e-4bac-b748-d4e57087bc65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5d25bfa8dc042329d57cd55fa7b7b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:30.643597 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a0e12d-e37e-4bac-b748-d4e57087bc65 service neutron] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:30.643890 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a0e12d-e37e-4bac-b748-d4e57087bc65 service neutron] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:30.644173 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a0e12d-e37e-4bac-b748-d4e57087bc65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:30.656407 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a0e12d-e37e-4bac-b748-d4e57087bc65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:30.658007 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a0e12d-e37e-4bac-b748-d4e57087bc65 service neutron] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:30.669534 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1433/2866] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:40:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:40:31.209803 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a467b79b-7bf3-4aa1-ba72-a0b89a5e72ff None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:31.215389 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-a467b79b-7bf3-4aa1-ba72-a0b89a5e72ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:31.236439 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a467b79b-7bf3-4aa1-ba72-a0b89a5e72ff None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:31.247064 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890e1ac6-0136-4be9-a748-7e1fb709b943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:31.247064 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890e1ac6-0136-4be9-a748-7e1fb709b943 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:31.247064 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890e1ac6-0136-4be9-a748-7e1fb709b943 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:31.247064 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890e1ac6-0136-4be9-a748-7e1fb709b943 admin admin] PATH_INFO: `/v3/projects/cc61cde30fda486d819f58204cb3dd4e` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:31.248460 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890e1ac6-0136-4be9-a748-7e1fb709b943 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc61cde30fda486d819f58204cb3dd4e)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:31.250960 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890e1ac6-0136-4be9-a748-7e1fb709b943 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:31.367318 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-890e1ac6-0136-4be9-a748-7e1fb709b943 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc61cde30fda486d819f58204cb3dd4e', 'request_id': 'req-890e1ac6-0136-4be9-a748-7e1fb709b943'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:31.377090 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-890e1ac6-0136-4be9-a748-7e1fb709b943 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc61cde30fda486d819f58204cb3dd4e', 'request_id': 'req-890e1ac6-0136-4be9-a748-7e1fb709b943'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:31.523921 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-890e1ac6-0136-4be9-a748-7e1fb709b943 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc61cde30fda486d819f58204cb3dd4e', 'request_id': 'req-890e1ac6-0136-4be9-a748-7e1fb709b943'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:31.538211 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-890e1ac6-0136-4be9-a748-7e1fb709b943 admin admin] The token cache is being invalidate because project cc61cde30fda486d819f58204cb3dd4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80874) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 17:40:31.538535 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-890e1ac6-0136-4be9-a748-7e1fb709b943 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:31.539233 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-890e1ac6-0136-4be9-a748-7e1fb709b943 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:31.540945 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1434/2867] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 16 17:40:31 2022] DELETE /identity/v3/projects/cc61cde30fda486d819f58204cb3dd4e => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:40:31.546254 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a0e12d-e37e-4bac-b748-d4e57087bc65 service neutron] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:31.559545 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a0e12d-e37e-4bac-b748-d4e57087bc65 service neutron] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:31.650819 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56e0f3c-4147-4153-86fa-c26a1b79e7b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:31.652873 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56e0f3c-4147-4153-86fa-c26a1b79e7b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:31.653353 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56e0f3c-4147-4153-86fa-c26a1b79e7b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:31.653946 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56e0f3c-4147-4153-86fa-c26a1b79e7b4 admin admin] PATH_INFO: `/v3/users/1f91d8d86117462aabed045cfde33845` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:31.655892 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56e0f3c-4147-4153-86fa-c26a1b79e7b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f91d8d86117462aabed045cfde33845)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:31.659536 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56e0f3c-4147-4153-86fa-c26a1b79e7b4 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:31.881592 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-b56e0f3c-4147-4153-86fa-c26a1b79e7b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f91d8d86117462aabed045cfde33845'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:31.882725 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-b56e0f3c-4147-4153-86fa-c26a1b79e7b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f91d8d86117462aabed045cfde33845'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:31.883803 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-b56e0f3c-4147-4153-86fa-c26a1b79e7b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f91d8d86117462aabed045cfde33845'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:31.958121 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-b56e0f3c-4147-4153-86fa-c26a1b79e7b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f91d8d86117462aabed045cfde33845'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:31.978167 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-b56e0f3c-4147-4153-86fa-c26a1b79e7b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f91d8d86117462aabed045cfde33845'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:32.030286 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1434/2868] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 16 17:40:31 2022] DELETE /identity/v3/users/1f91d8d86117462aabed045cfde33845 => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:40:32.636035 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890e1ac6-0136-4be9-a748-7e1fb709b943 admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:32.638654 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-890e1ac6-0136-4be9-a748-7e1fb709b943 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:32.655870 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890e1ac6-0136-4be9-a748-7e1fb709b943 admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:32.746687 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3714c58-c5fc-42d7-aa16-04aa4960504f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:32.747564 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3714c58-c5fc-42d7-aa16-04aa4960504f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:32.747847 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3714c58-c5fc-42d7-aa16-04aa4960504f admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:32.748128 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3714c58-c5fc-42d7-aa16-04aa4960504f admin admin] PATH_INFO: `/v3/projects/a55394db66a1482b8658a406893c5d43` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:32.749365 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3714c58-c5fc-42d7-aa16-04aa4960504f admin admin] RBAC: Authorizing `identity:delete_project(project_id=a55394db66a1482b8658a406893c5d43)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:32.751438 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3714c58-c5fc-42d7-aa16-04aa4960504f admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:32.873105 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-a3714c58-c5fc-42d7-aa16-04aa4960504f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a55394db66a1482b8658a406893c5d43', 'request_id': 'req-a3714c58-c5fc-42d7-aa16-04aa4960504f'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:32.881815 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-a3714c58-c5fc-42d7-aa16-04aa4960504f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a55394db66a1482b8658a406893c5d43', 'request_id': 'req-a3714c58-c5fc-42d7-aa16-04aa4960504f'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:32.956248 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-a3714c58-c5fc-42d7-aa16-04aa4960504f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a55394db66a1482b8658a406893c5d43', 'request_id': 'req-a3714c58-c5fc-42d7-aa16-04aa4960504f'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:32.970207 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:40:32.978395 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-a3714c58-c5fc-42d7-aa16-04aa4960504f admin admin] The token cache is being invalidate because project a55394db66a1482b8658a406893c5d43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80874) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 17:40:32.978929 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-a3714c58-c5fc-42d7-aa16-04aa4960504f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:32.986603 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-a3714c58-c5fc-42d7-aa16-04aa4960504f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:32.986603 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1435/2869] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 16 17:40:32 2022] DELETE /identity/v3/projects/a55394db66a1482b8658a406893c5d43 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:40:32.992917 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fb28f8-6971-45a5-9ee0-15954c5821e1 None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:32.994982 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fb28f8-6971-45a5-9ee0-15954c5821e1 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:32.994982 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fb28f8-6971-45a5-9ee0-15954c5821e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:33.022874 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-06fb28f8-6971-45a5-9ee0-15954c5821e1 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:40:33.024981 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-06fb28f8-6971-45a5-9ee0-15954c5821e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:33.065001 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:40:33.113466 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1435/2870] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:40:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:40:33.126795 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac1cd75-528e-42b6-ae58-3e7bfbe9c967 None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:33.127282 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac1cd75-528e-42b6-ae58-3e7bfbe9c967 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:33.127811 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac1cd75-528e-42b6-ae58-3e7bfbe9c967 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:33.156447 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-fac1cd75-528e-42b6-ae58-3e7bfbe9c967 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:40:33.158527 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-fac1cd75-528e-42b6-ae58-3e7bfbe9c967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:33.172744 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1436/2871] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:40:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:40:33.179456 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fb28f8-6971-45a5-9ee0-15954c5821e1 None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:33.197910 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fb28f8-6971-45a5-9ee0-15954c5821e1 None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:33.206627 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b290e8bc-babd-451b-bc9f-3ba0c5218734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:33.207493 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b290e8bc-babd-451b-bc9f-3ba0c5218734 admin admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:33.208203 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b290e8bc-babd-451b-bc9f-3ba0c5218734 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:33.208492 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b290e8bc-babd-451b-bc9f-3ba0c5218734 admin admin] PATH_INFO: `/v3/domains` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:33.209571 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b290e8bc-babd-451b-bc9f-3ba0c5218734 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80873) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:40:33.209977 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b290e8bc-babd-451b-bc9f-3ba0c5218734 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:33.211648 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b290e8bc-babd-451b-bc9f-3ba0c5218734 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:33.231781 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1436/2872] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 16 17:40:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:40:33.238309 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac1cd75-528e-42b6-ae58-3e7bfbe9c967 None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:33.254936 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac1cd75-528e-42b6-ae58-3e7bfbe9c967 None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:33.263343 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ec59da-76ab-419b-9ee3-a68bd43e2efb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:33.264352 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ec59da-76ab-419b-9ee3-a68bd43e2efb admin admin] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:33.264820 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ec59da-76ab-419b-9ee3-a68bd43e2efb admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:33.265224 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ec59da-76ab-419b-9ee3-a68bd43e2efb admin admin] PATH_INFO: `/v3/projects` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:33.266468 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ec59da-76ab-419b-9ee3-a68bd43e2efb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:33.268539 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ec59da-76ab-419b-9ee3-a68bd43e2efb admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:33.367241 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1437/2873] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 16 17:40:33 2022] POST /identity/v3/projects => generated 399 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:40:33.373362 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b290e8bc-babd-451b-bc9f-3ba0c5218734 admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:33.391870 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b290e8bc-babd-451b-bc9f-3ba0c5218734 admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:33.463520 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e57f053-7c1e-4dd9-b942-dfe79d91bed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:33.464225 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e57f053-7c1e-4dd9-b942-dfe79d91bed5 admin admin] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:33.464602 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e57f053-7c1e-4dd9-b942-dfe79d91bed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:33.465010 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e57f053-7c1e-4dd9-b942-dfe79d91bed5 admin admin] PATH_INFO: `/v3/users` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:33.465775 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e57f053-7c1e-4dd9-b942-dfe79d91bed5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:33.467863 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e57f053-7c1e-4dd9-b942-dfe79d91bed5 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:33.562126 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1437/2874] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 16 17:40:33 2022] POST /identity/v3/users => generated 300 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:40:33.568654 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ec59da-76ab-419b-9ee3-a68bd43e2efb admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:33.583266 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ec59da-76ab-419b-9ee3-a68bd43e2efb admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:33.595693 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76bff74-b874-4e60-b7ec-339fbabfc0ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:33.595693 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76bff74-b874-4e60-b7ec-339fbabfc0ef admin admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:33.595693 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76bff74-b874-4e60-b7ec-339fbabfc0ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:33.595693 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76bff74-b874-4e60-b7ec-339fbabfc0ef admin admin] PATH_INFO: `/v3/roles` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:33.596378 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76bff74-b874-4e60-b7ec-339fbabfc0ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:33.596378 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76bff74-b874-4e60-b7ec-339fbabfc0ef admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:33.604031 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1438/2875] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 17:40:33 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:40:33.610703 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e57f053-7c1e-4dd9-b942-dfe79d91bed5 admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:33.622270 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e57f053-7c1e-4dd9-b942-dfe79d91bed5 admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:33.627680 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9178f5-937c-4ae0-ac31-cf2996a9f4c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:33.628473 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9178f5-937c-4ae0-ac31-cf2996a9f4c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:33.628872 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9178f5-937c-4ae0-ac31-cf2996a9f4c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:33.629367 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9178f5-937c-4ae0-ac31-cf2996a9f4c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:33.630361 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9178f5-937c-4ae0-ac31-cf2996a9f4c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:33.632111 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9178f5-937c-4ae0-ac31-cf2996a9f4c4 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:33.649597 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1438/2876] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 17:40:33 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:40:33.654707 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76bff74-b874-4e60-b7ec-339fbabfc0ef admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:33.665664 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76bff74-b874-4e60-b7ec-339fbabfc0ef admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:33.671365 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae28a7c3-6b5f-48e7-b582-aa1dd1f312e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:33.672336 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae28a7c3-6b5f-48e7-b582-aa1dd1f312e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:33.672674 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae28a7c3-6b5f-48e7-b582-aa1dd1f312e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:33.673072 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae28a7c3-6b5f-48e7-b582-aa1dd1f312e3 admin admin] PATH_INFO: `/v3/projects/272be28f57a54a48822871ced872d2f6/users/a911b2d03a02432fb4e2996dc84e0c4d/roles/896bff49c5d6464eb612a15f4aa9badc` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:33.691466 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae28a7c3-6b5f-48e7-b582-aa1dd1f312e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=272be28f57a54a48822871ced872d2f6, user_id=a911b2d03a02432fb4e2996dc84e0c4d, role_id=896bff49c5d6464eb612a15f4aa9badc)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:33.694374 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae28a7c3-6b5f-48e7-b582-aa1dd1f312e3 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:33.772534 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1439/2877] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 17:40:33 2022] PUT /identity/v3/projects/272be28f57a54a48822871ced872d2f6/users/a911b2d03a02432fb4e2996dc84e0c4d/roles/896bff49c5d6464eb612a15f4aa9badc => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:40:33.793687 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f858def-9546-4c7c-b6fd-0e300cf48925 None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:33.794211 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f858def-9546-4c7c-b6fd-0e300cf48925 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:33.794709 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f858def-9546-4c7c-b6fd-0e300cf48925 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:33.836543 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-7f858def-9546-4c7c-b6fd-0e300cf48925 None None] MFA Rules not processed for user `a911b2d03a02432fb4e2996dc84e0c4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:40:33.837887 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-7f858def-9546-4c7c-b6fd-0e300cf48925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:33.925205 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1439/2878] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:40:33 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:40:33.930052 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae28a7c3-6b5f-48e7-b582-aa1dd1f312e3 admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:34.001682 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae28a7c3-6b5f-48e7-b582-aa1dd1f312e3 admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:34.007066 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a683d3-6900-4165-9238-a886a1447516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:34.007789 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a683d3-6900-4165-9238-a886a1447516 admin admin] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:34.008118 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a683d3-6900-4165-9238-a886a1447516 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:34.008449 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a683d3-6900-4165-9238-a886a1447516 admin admin] PATH_INFO: `/v3/projects` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:34.009376 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a683d3-6900-4165-9238-a886a1447516 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:34.011573 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a683d3-6900-4165-9238-a886a1447516 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:34.117521 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1440/2879] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 16 17:40:33 2022] POST /identity/v3/projects => generated 401 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:40:34.121309 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f858def-9546-4c7c-b6fd-0e300cf48925 None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:34.137083 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f858def-9546-4c7c-b6fd-0e300cf48925 None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:34.167780 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:40:34.213155 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a3c7eb-6121-4ce9-ab83-44140847c9dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:34.214487 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a3c7eb-6121-4ce9-ab83-44140847c9dd admin admin] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:34.214832 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a3c7eb-6121-4ce9-ab83-44140847c9dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:34.215165 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a3c7eb-6121-4ce9-ab83-44140847c9dd admin admin] PATH_INFO: `/v3/users` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:34.215933 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a3c7eb-6121-4ce9-ab83-44140847c9dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:34.217973 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a3c7eb-6121-4ce9-ab83-44140847c9dd admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:34.313077 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1440/2880] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 16 17:40:34 2022] POST /identity/v3/users => generated 307 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:40:34.319030 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a683d3-6900-4165-9238-a886a1447516 admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:34.337648 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a683d3-6900-4165-9238-a886a1447516 admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:34.346017 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719c2e3e-fa99-4750-9a4f-1e3ee64d87fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:34.347157 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719c2e3e-fa99-4750-9a4f-1e3ee64d87fb admin admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:34.347693 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719c2e3e-fa99-4750-9a4f-1e3ee64d87fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:34.348215 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719c2e3e-fa99-4750-9a4f-1e3ee64d87fb admin admin] PATH_INFO: `/v3/roles` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:34.350406 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719c2e3e-fa99-4750-9a4f-1e3ee64d87fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:34.352350 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719c2e3e-fa99-4750-9a4f-1e3ee64d87fb admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:34.364948 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1441/2881] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 17:40:34 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 17:40:34.369472 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a3c7eb-6121-4ce9-ab83-44140847c9dd admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:34.380541 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a3c7eb-6121-4ce9-ab83-44140847c9dd admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:34.386522 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ba0b4a-a70e-4627-8f63-fcc53a25944b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:34.387479 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ba0b4a-a70e-4627-8f63-fcc53a25944b admin admin] REQUEST_METHOD: `PUT` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:34.387967 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ba0b4a-a70e-4627-8f63-fcc53a25944b admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:34.388442 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ba0b4a-a70e-4627-8f63-fcc53a25944b admin admin] PATH_INFO: `/v3/projects/f2c14467fb724afea5344effad184d5f/users/2659c43d6a7c4d878cf27eb8452e363e/roles/dba744f8ab2a4c45b9d3212f8d203aba` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:34.407407 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ba0b4a-a70e-4627-8f63-fcc53a25944b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2c14467fb724afea5344effad184d5f, user_id=2659c43d6a7c4d878cf27eb8452e363e, role_id=dba744f8ab2a4c45b9d3212f8d203aba)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:34.412199 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ba0b4a-a70e-4627-8f63-fcc53a25944b admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:34.514490 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1441/2882] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 17:40:34 2022] PUT /identity/v3/projects/f2c14467fb724afea5344effad184d5f/users/2659c43d6a7c4d878cf27eb8452e363e/roles/dba744f8ab2a4c45b9d3212f8d203aba => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 17:40:34.519164 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719c2e3e-fa99-4750-9a4f-1e3ee64d87fb admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:34.533911 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719c2e3e-fa99-4750-9a4f-1e3ee64d87fb admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:34.628974 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784b80e6-da6d-40de-a96b-bfabe62926db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:34.630056 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784b80e6-da6d-40de-a96b-bfabe62926db admin admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:34.630554 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784b80e6-da6d-40de-a96b-bfabe62926db admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:34.631047 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784b80e6-da6d-40de-a96b-bfabe62926db admin admin] PATH_INFO: `/v3/roles` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:34.632456 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784b80e6-da6d-40de-a96b-bfabe62926db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:34.635517 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784b80e6-da6d-40de-a96b-bfabe62926db admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:34.655321 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1442/2883] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 17:40:34 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:40:34.661270 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ba0b4a-a70e-4627-8f63-fcc53a25944b admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:34.675961 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ba0b4a-a70e-4627-8f63-fcc53a25944b admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:34.684624 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3e3edf-fbc6-4779-ab72-578acb90e6d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:34.686172 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3e3edf-fbc6-4779-ab72-578acb90e6d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:34.686671 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3e3edf-fbc6-4779-ab72-578acb90e6d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:34.687171 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3e3edf-fbc6-4779-ab72-578acb90e6d7 admin admin] PATH_INFO: `/v3/projects/f2c14467fb724afea5344effad184d5f/users/2659c43d6a7c4d878cf27eb8452e363e/roles/dba744f8ab2a4c45b9d3212f8d203aba` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:34.690807 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3e3edf-fbc6-4779-ab72-578acb90e6d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2c14467fb724afea5344effad184d5f, user_id=2659c43d6a7c4d878cf27eb8452e363e, role_id=dba744f8ab2a4c45b9d3212f8d203aba)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:34.696012 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3e3edf-fbc6-4779-ab72-578acb90e6d7 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:34.715223 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1442/2884] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 17:40:34 2022] PUT /identity/v3/projects/f2c14467fb724afea5344effad184d5f/users/2659c43d6a7c4d878cf27eb8452e363e/roles/dba744f8ab2a4c45b9d3212f8d203aba => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 17:40:34.730915 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6f6c93-6f59-4b0c-aab8-76eb5878b6f9 None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:34.731209 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6f6c93-6f59-4b0c-aab8-76eb5878b6f9 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:34.731548 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6f6c93-6f59-4b0c-aab8-76eb5878b6f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:34.740306 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:40:34.773890 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-8d6f6c93-6f59-4b0c-aab8-76eb5878b6f9 None None] MFA Rules not processed for user `2659c43d6a7c4d878cf27eb8452e363e`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:40:34.775276 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-8d6f6c93-6f59-4b0c-aab8-76eb5878b6f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:34.896921 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1443/2885] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:40:34 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 17:40:34.911555 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3e3edf-fbc6-4779-ab72-578acb90e6d7 admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:34.913665 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-3a3e3edf-fbc6-4779-ab72-578acb90e6d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:35.010870 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3e3edf-fbc6-4779-ab72-578acb90e6d7 admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:35.017285 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850cbc9a-23a3-45fd-a111-71679aff5e38 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef37136b89d34edc9cd94c7aa81b2095', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:35.018418 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850cbc9a-23a3-45fd-a111-71679aff5e38 service cinder] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:35.018934 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850cbc9a-23a3-45fd-a111-71679aff5e38 service cinder] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:35.019453 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850cbc9a-23a3-45fd-a111-71679aff5e38 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:35.036302 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850cbc9a-23a3-45fd-a111-71679aff5e38 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:35.039031 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850cbc9a-23a3-45fd-a111-71679aff5e38 service cinder] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:35.057409 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1443/2886] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:40:34 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 17:40:35.289724 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6f6c93-6f59-4b0c-aab8-76eb5878b6f9 None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:35.306500 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6f6c93-6f59-4b0c-aab8-76eb5878b6f9 None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:35.312896 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e919432d-c111-42ef-9fc8-3ab647fdd8e5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef37136b89d34edc9cd94c7aa81b2095', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:35.314052 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e919432d-c111-42ef-9fc8-3ab647fdd8e5 service cinder] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:35.314563 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e919432d-c111-42ef-9fc8-3ab647fdd8e5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:35.315069 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e919432d-c111-42ef-9fc8-3ab647fdd8e5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:35.402482 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e919432d-c111-42ef-9fc8-3ab647fdd8e5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:35.405189 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e919432d-c111-42ef-9fc8-3ab647fdd8e5 service cinder] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:35.422400 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1444/2887] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:40:35 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:40:40.967244 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850cbc9a-23a3-45fd-a111-71679aff5e38 service cinder] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:41.050906 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850cbc9a-23a3-45fd-a111-71679aff5e38 service cinder] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:41.056391 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c640840b-0412-413b-8083-e3a03cc5c7b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:41.058405 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c640840b-0412-413b-8083-e3a03cc5c7b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:41.058898 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c640840b-0412-413b-8083-e3a03cc5c7b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:41.059367 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c640840b-0412-413b-8083-e3a03cc5c7b3 admin admin] PATH_INFO: `/v3/users/a911b2d03a02432fb4e2996dc84e0c4d` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:41.061206 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c640840b-0412-413b-8083-e3a03cc5c7b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a911b2d03a02432fb4e2996dc84e0c4d)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:41.064774 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c640840b-0412-413b-8083-e3a03cc5c7b3 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:41.197231 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=91,keystone:INSERT=5,keystone:DELETE=4 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:40:41.312251 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-c640840b-0412-413b-8083-e3a03cc5c7b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a911b2d03a02432fb4e2996dc84e0c4d'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:41.313345 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-c640840b-0412-413b-8083-e3a03cc5c7b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a911b2d03a02432fb4e2996dc84e0c4d'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:41.314302 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-c640840b-0412-413b-8083-e3a03cc5c7b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a911b2d03a02432fb4e2996dc84e0c4d'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:41.394884 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-c640840b-0412-413b-8083-e3a03cc5c7b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a911b2d03a02432fb4e2996dc84e0c4d'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:41.405293 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-c640840b-0412-413b-8083-e3a03cc5c7b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a911b2d03a02432fb4e2996dc84e0c4d'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:41.437623 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1444/2888] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 16 17:40:40 2022] DELETE /identity/v3/users/a911b2d03a02432fb4e2996dc84e0c4d => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 17:40:41.443721 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33346786-023d-4435-96c9-3e04bf4082f8 None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:41.444613 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33346786-023d-4435-96c9-3e04bf4082f8 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:41.444613 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33346786-023d-4435-96c9-3e04bf4082f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:41.473953 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-33346786-023d-4435-96c9-3e04bf4082f8 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:40:41.474982 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-33346786-023d-4435-96c9-3e04bf4082f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:41.553580 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1445/2889] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:40:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:40:41.564479 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c640840b-0412-413b-8083-e3a03cc5c7b3 admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:41.566072 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-c640840b-0412-413b-8083-e3a03cc5c7b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:41.648997 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c640840b-0412-413b-8083-e3a03cc5c7b3 admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:41.653810 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841273d5-7a71-4097-a54c-7abdc7708ce5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5d25bfa8dc042329d57cd55fa7b7b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:41.654701 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841273d5-7a71-4097-a54c-7abdc7708ce5 service neutron] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:41.655034 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841273d5-7a71-4097-a54c-7abdc7708ce5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:41.655362 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841273d5-7a71-4097-a54c-7abdc7708ce5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:41.666548 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841273d5-7a71-4097-a54c-7abdc7708ce5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:41.668710 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841273d5-7a71-4097-a54c-7abdc7708ce5 service neutron] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:41.678669 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1445/2890] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:40:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 17:40:42.270005 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33346786-023d-4435-96c9-3e04bf4082f8 None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:42.271550 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-33346786-023d-4435-96c9-3e04bf4082f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:42.287587 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33346786-023d-4435-96c9-3e04bf4082f8 None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:42.294457 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af36d141-8d06-4186-b676-6e39a4a5598f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:42.295625 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af36d141-8d06-4186-b676-6e39a4a5598f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:42.296220 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af36d141-8d06-4186-b676-6e39a4a5598f admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:42.296721 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af36d141-8d06-4186-b676-6e39a4a5598f admin admin] PATH_INFO: `/v3/projects/272be28f57a54a48822871ced872d2f6` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:42.299229 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af36d141-8d06-4186-b676-6e39a4a5598f admin admin] RBAC: Authorizing `identity:delete_project(project_id=272be28f57a54a48822871ced872d2f6)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:42.306551 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af36d141-8d06-4186-b676-6e39a4a5598f admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:42.335735 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:40:42.426203 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-af36d141-8d06-4186-b676-6e39a4a5598f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '272be28f57a54a48822871ced872d2f6', 'request_id': 'req-af36d141-8d06-4186-b676-6e39a4a5598f'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:42.437080 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-af36d141-8d06-4186-b676-6e39a4a5598f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '272be28f57a54a48822871ced872d2f6', 'request_id': 'req-af36d141-8d06-4186-b676-6e39a4a5598f'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:42.509387 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-af36d141-8d06-4186-b676-6e39a4a5598f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '272be28f57a54a48822871ced872d2f6', 'request_id': 'req-af36d141-8d06-4186-b676-6e39a4a5598f'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:42.527073 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-af36d141-8d06-4186-b676-6e39a4a5598f admin admin] The token cache is being invalidate because project 272be28f57a54a48822871ced872d2f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80874) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 17:40:42.527577 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-af36d141-8d06-4186-b676-6e39a4a5598f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:42.528594 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-af36d141-8d06-4186-b676-6e39a4a5598f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:42.531356 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1446/2891] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 16 17:40:42 2022] DELETE /identity/v3/projects/272be28f57a54a48822871ced872d2f6 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 17:40:42.537134 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841273d5-7a71-4097-a54c-7abdc7708ce5 service neutron] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:42.551900 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841273d5-7a71-4097-a54c-7abdc7708ce5 service neutron] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:42.628454 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0837798-ae3c-4384-9ea5-f69483a715cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:42.629349 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0837798-ae3c-4384-9ea5-f69483a715cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:42.629658 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0837798-ae3c-4384-9ea5-f69483a715cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:42.629973 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0837798-ae3c-4384-9ea5-f69483a715cc admin admin] PATH_INFO: `/v3/users/2659c43d6a7c4d878cf27eb8452e363e` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:42.631295 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0837798-ae3c-4384-9ea5-f69483a715cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=2659c43d6a7c4d878cf27eb8452e363e)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:42.633286 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0837798-ae3c-4384-9ea5-f69483a715cc admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:42.887597 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-c0837798-ae3c-4384-9ea5-f69483a715cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2659c43d6a7c4d878cf27eb8452e363e'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:42.888347 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-c0837798-ae3c-4384-9ea5-f69483a715cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2659c43d6a7c4d878cf27eb8452e363e'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:42.888998 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-c0837798-ae3c-4384-9ea5-f69483a715cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2659c43d6a7c4d878cf27eb8452e363e'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:42.891591 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:40:42.960687 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-c0837798-ae3c-4384-9ea5-f69483a715cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2659c43d6a7c4d878cf27eb8452e363e'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:42.969901 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-c0837798-ae3c-4384-9ea5-f69483a715cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2659c43d6a7c4d878cf27eb8452e363e'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:42.991624 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1446/2892] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 16 17:40:42 2022] DELETE /identity/v3/users/2659c43d6a7c4d878cf27eb8452e363e => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:40:43.534591 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af36d141-8d06-4186-b676-6e39a4a5598f admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:43.542347 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-af36d141-8d06-4186-b676-6e39a4a5598f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:43.556123 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af36d141-8d06-4186-b676-6e39a4a5598f admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:43.656908 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5eb5ad-561b-4d19-ae04-5cee336f11a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:43.658523 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5eb5ad-561b-4d19-ae04-5cee336f11a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:43.659224 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5eb5ad-561b-4d19-ae04-5cee336f11a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:43.659757 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5eb5ad-561b-4d19-ae04-5cee336f11a6 admin admin] PATH_INFO: `/v3/projects/f2c14467fb724afea5344effad184d5f` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:43.661989 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5eb5ad-561b-4d19-ae04-5cee336f11a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2c14467fb724afea5344effad184d5f)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:43.665821 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5eb5ad-561b-4d19-ae04-5cee336f11a6 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:43.789588 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-5a5eb5ad-561b-4d19-ae04-5cee336f11a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2c14467fb724afea5344effad184d5f', 'request_id': 'req-5a5eb5ad-561b-4d19-ae04-5cee336f11a6'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:43.799945 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-5a5eb5ad-561b-4d19-ae04-5cee336f11a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2c14467fb724afea5344effad184d5f', 'request_id': 'req-5a5eb5ad-561b-4d19-ae04-5cee336f11a6'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:43.890112 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-5a5eb5ad-561b-4d19-ae04-5cee336f11a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2c14467fb724afea5344effad184d5f', 'request_id': 'req-5a5eb5ad-561b-4d19-ae04-5cee336f11a6'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:43.905209 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-5a5eb5ad-561b-4d19-ae04-5cee336f11a6 admin admin] The token cache is being invalidate because project f2c14467fb724afea5344effad184d5f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80874) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 17:40:43.905506 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-5a5eb5ad-561b-4d19-ae04-5cee336f11a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:43.906390 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-5a5eb5ad-561b-4d19-ae04-5cee336f11a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:43.908011 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1447/2893] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 16 17:40:43 2022] DELETE /identity/v3/projects/f2c14467fb724afea5344effad184d5f => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:40:43.913217 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfc84ca-12d6-4dd4-96c0-fe9be9094a7f None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:43.913838 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfc84ca-12d6-4dd4-96c0-fe9be9094a7f None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:43.913838 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfc84ca-12d6-4dd4-96c0-fe9be9094a7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:43.937108 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-6bfc84ca-12d6-4dd4-96c0-fe9be9094a7f None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:40:43.939199 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-6bfc84ca-12d6-4dd4-96c0-fe9be9094a7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:44.026951 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1447/2894] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:40:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 17:40:44.041996 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bac4308-9a56-4d38-83a0-9bd32fdbdaed None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:44.042393 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bac4308-9a56-4d38-83a0-9bd32fdbdaed None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:44.042974 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bac4308-9a56-4d38-83a0-9bd32fdbdaed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:44.074693 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-9bac4308-9a56-4d38-83a0-9bd32fdbdaed None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:40:44.076788 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-9bac4308-9a56-4d38-83a0-9bd32fdbdaed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:44.089576 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1448/2895] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:40:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:40:44.099415 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfc84ca-12d6-4dd4-96c0-fe9be9094a7f None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:44.111188 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfc84ca-12d6-4dd4-96c0-fe9be9094a7f None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:44.118250 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649ccc80-26d9-4670-a4a6-64bc1deaffc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:44.119244 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649ccc80-26d9-4670-a4a6-64bc1deaffc4 admin admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:44.119783 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649ccc80-26d9-4670-a4a6-64bc1deaffc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:44.120277 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649ccc80-26d9-4670-a4a6-64bc1deaffc4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:44.121910 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649ccc80-26d9-4670-a4a6-64bc1deaffc4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80873) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:40:44.122490 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649ccc80-26d9-4670-a4a6-64bc1deaffc4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:44.125839 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649ccc80-26d9-4670-a4a6-64bc1deaffc4 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:44.149088 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1448/2896] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 16 17:40:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:40:44.153791 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bac4308-9a56-4d38-83a0-9bd32fdbdaed None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:44.163910 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bac4308-9a56-4d38-83a0-9bd32fdbdaed None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:44.168891 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84f5601-dfd1-44e5-8296-1ba439f08ca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:44.169561 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84f5601-dfd1-44e5-8296-1ba439f08ca6 admin admin] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:44.169893 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84f5601-dfd1-44e5-8296-1ba439f08ca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:44.170175 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84f5601-dfd1-44e5-8296-1ba439f08ca6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:44.170886 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84f5601-dfd1-44e5-8296-1ba439f08ca6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:44.172809 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84f5601-dfd1-44e5-8296-1ba439f08ca6 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:44.256694 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1449/2897] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 16 17:40:44 2022] POST /identity/v3/projects => generated 373 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 17:40:44.262972 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649ccc80-26d9-4670-a4a6-64bc1deaffc4 admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:44.281617 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649ccc80-26d9-4670-a4a6-64bc1deaffc4 admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:44.368295 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74759457-c0ae-4500-a2dc-fcde3c79d18a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:44.369227 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74759457-c0ae-4500-a2dc-fcde3c79d18a admin admin] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:44.370212 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74759457-c0ae-4500-a2dc-fcde3c79d18a admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:44.370591 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74759457-c0ae-4500-a2dc-fcde3c79d18a admin admin] PATH_INFO: `/v3/users` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:44.371642 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74759457-c0ae-4500-a2dc-fcde3c79d18a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:44.375295 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74759457-c0ae-4500-a2dc-fcde3c79d18a admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:44.490709 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1449/2898] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 16 17:40:44 2022] POST /identity/v3/users => generated 287 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:40:44.495734 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84f5601-dfd1-44e5-8296-1ba439f08ca6 admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:44.513677 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84f5601-dfd1-44e5-8296-1ba439f08ca6 admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:44.521312 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db105d4-53fb-46a2-aeda-1f8b92b4fcbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:44.522498 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db105d4-53fb-46a2-aeda-1f8b92b4fcbb admin admin] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:44.523007 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db105d4-53fb-46a2-aeda-1f8b92b4fcbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:44.523571 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db105d4-53fb-46a2-aeda-1f8b92b4fcbb admin admin] PATH_INFO: `/v3/roles` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:44.524945 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db105d4-53fb-46a2-aeda-1f8b92b4fcbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:44.528034 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db105d4-53fb-46a2-aeda-1f8b92b4fcbb admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:44.544282 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1450/2899] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 17:40:44 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 17:40:44.549982 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74759457-c0ae-4500-a2dc-fcde3c79d18a admin admin] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:44.566074 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74759457-c0ae-4500-a2dc-fcde3c79d18a admin admin] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:44.575542 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3948b1-774c-4b0c-80cf-82192d307b9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:44.579638 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3948b1-774c-4b0c-80cf-82192d307b9a admin admin] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:44.579638 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3948b1-774c-4b0c-80cf-82192d307b9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:44.579638 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3948b1-774c-4b0c-80cf-82192d307b9a admin admin] PATH_INFO: `/v3/roles` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:44.579638 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3948b1-774c-4b0c-80cf-82192d307b9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:44.579638 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3948b1-774c-4b0c-80cf-82192d307b9a admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:44.595863 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1450/2900] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 17:40:44 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 17:40:44.600822 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db105d4-53fb-46a2-aeda-1f8b92b4fcbb admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:44.609789 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:INSERT=3 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:40:44.625536 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db105d4-53fb-46a2-aeda-1f8b92b4fcbb admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:44.626497 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d9f4a6-339b-4555-b2e0-877014fbec67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:44.627424 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d9f4a6-339b-4555-b2e0-877014fbec67 admin admin] REQUEST_METHOD: `PUT` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:44.627713 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d9f4a6-339b-4555-b2e0-877014fbec67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:44.627999 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d9f4a6-339b-4555-b2e0-877014fbec67 admin admin] PATH_INFO: `/v3/projects/a9363cf32b2743249f011d0915ff6229/users/efee4b8997cf480da650901e6ca91cc3/roles/896bff49c5d6464eb612a15f4aa9badc` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:44.652411 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d9f4a6-339b-4555-b2e0-877014fbec67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9363cf32b2743249f011d0915ff6229, user_id=efee4b8997cf480da650901e6ca91cc3, role_id=896bff49c5d6464eb612a15f4aa9badc)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:44.656276 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d9f4a6-339b-4555-b2e0-877014fbec67 admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:44.729790 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1451/2901] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 17:40:44 2022] PUT /identity/v3/projects/a9363cf32b2743249f011d0915ff6229/users/efee4b8997cf480da650901e6ca91cc3/roles/896bff49c5d6464eb612a15f4aa9badc => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:40:44.748433 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f48329-1c50-4f25-9fa4-f7d235fe5626 None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:44.748956 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f48329-1c50-4f25-9fa4-f7d235fe5626 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:44.749418 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f48329-1c50-4f25-9fa4-f7d235fe5626 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:44.798575 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-e0f48329-1c50-4f25-9fa4-f7d235fe5626 None None] MFA Rules not processed for user `efee4b8997cf480da650901e6ca91cc3`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:40:44.799829 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-e0f48329-1c50-4f25-9fa4-f7d235fe5626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:44.821146 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:INSERT=4,keystone:DELETE=3,keystone:SELECT=93 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:40:44.892114 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1451/2902] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:40:44 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:40:44.906828 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d9f4a6-339b-4555-b2e0-877014fbec67 admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:44.908814 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-d6d9f4a6-339b-4555-b2e0-877014fbec67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:44.985961 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d9f4a6-339b-4555-b2e0-877014fbec67 admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:44.991603 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4cd51b-2582-4788-9d64-a92b6a0dd094 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef37136b89d34edc9cd94c7aa81b2095', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:44.992494 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4cd51b-2582-4788-9d64-a92b6a0dd094 service cinder] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:44.992798 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4cd51b-2582-4788-9d64-a92b6a0dd094 service cinder] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:44.993087 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4cd51b-2582-4788-9d64-a92b6a0dd094 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:45.007843 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4cd51b-2582-4788-9d64-a92b6a0dd094 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:45.010144 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4cd51b-2582-4788-9d64-a92b6a0dd094 service cinder] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:45.027529 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1452/2903] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:40:44 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:40:46.918413 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4a1755-8582-4b76-9d1d-64b799d838d3 None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:46.919296 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4a1755-8582-4b76-9d1d-64b799d838d3 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:46.919467 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4a1755-8582-4b76-9d1d-64b799d838d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:46.945869 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-ac4a1755-8582-4b76-9d1d-64b799d838d3 None None] MFA Rules not processed for user `efee4b8997cf480da650901e6ca91cc3`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:40:46.947323 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-ac4a1755-8582-4b76-9d1d-64b799d838d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:46.956441 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1452/2904] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:40:46 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 17:40:47.018007 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4cd51b-2582-4788-9d64-a92b6a0dd094 service cinder] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:47.019563 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-0b4cd51b-2582-4788-9d64-a92b6a0dd094 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:47.114960 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4cd51b-2582-4788-9d64-a92b6a0dd094 service cinder] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:47.121439 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e960b86a-84f4-4992-a748-14340ef01271 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3985eae1ec3240129eec8d1f4d8d21e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:47.122373 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e960b86a-84f4-4992-a748-14340ef01271 service glance] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:47.122863 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e960b86a-84f4-4992-a748-14340ef01271 service glance] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:47.123344 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e960b86a-84f4-4992-a748-14340ef01271 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:47.126222 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-e960b86a-84f4-4992-a748-14340ef01271 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:47.215388 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:40:47.241499 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e960b86a-84f4-4992-a748-14340ef01271 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:47.243003 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e960b86a-84f4-4992-a748-14340ef01271 service glance] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:47.269115 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1453/2905] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:40:47 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:40:47.978191 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4a1755-8582-4b76-9d1d-64b799d838d3 None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:47.981731 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-ac4a1755-8582-4b76-9d1d-64b799d838d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:48.069661 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4a1755-8582-4b76-9d1d-64b799d838d3 None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:48.076250 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e397f19b-6d00-4776-805a-14556d8c315a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5d25bfa8dc042329d57cd55fa7b7b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:48.077150 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e397f19b-6d00-4776-805a-14556d8c315a service neutron] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:48.077670 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e397f19b-6d00-4776-805a-14556d8c315a service neutron] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:48.078200 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e397f19b-6d00-4776-805a-14556d8c315a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:48.081456 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-e397f19b-6d00-4776-805a-14556d8c315a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:48.104980 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e397f19b-6d00-4776-805a-14556d8c315a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:48.107701 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e397f19b-6d00-4776-805a-14556d8c315a service neutron] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:48.126974 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1453/2906] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:40:47 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 17:40:57.331664 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=11 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:40:58.119474 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=47 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:41:05.710557 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792e3151-15c9-4d06-b605-a819b15fdfc2 None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:41:05.713813 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792e3151-15c9-4d06-b605-a819b15fdfc2 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:41:05.713813 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792e3151-15c9-4d06-b605-a819b15fdfc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:41:05.793732 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-792e3151-15c9-4d06-b605-a819b15fdfc2 None None] MFA Rules not processed for user `f7f35c1c15a84a92863d4f3f96d76830`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:41:05.795138 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-792e3151-15c9-4d06-b605-a819b15fdfc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:41:05.870079 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1454/2907] 10.222.0.39 () {58 vars in 1009 bytes} [Thu Jun 16 17:41:05 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:41:06.044250 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e397f19b-6d00-4776-805a-14556d8c315a service neutron] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:41:06.046389 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-e397f19b-6d00-4776-805a-14556d8c315a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:41:06.149168 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e397f19b-6d00-4776-805a-14556d8c315a service neutron] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:41:06.157142 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005c487c-3bb3-4c09-b3c1-43a2062046e4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbec2dfe63764ed88a23e172ead0afa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:41:06.157840 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005c487c-3bb3-4c09-b3c1-43a2062046e4 service swift] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:41:06.158157 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005c487c-3bb3-4c09-b3c1-43a2062046e4 service swift] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:41:06.158445 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005c487c-3bb3-4c09-b3c1-43a2062046e4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:41:06.168335 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005c487c-3bb3-4c09-b3c1-43a2062046e4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:41:06.169987 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005c487c-3bb3-4c09-b3c1-43a2062046e4 service swift] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:41:06.178727 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1454/2908] 10.222.0.39 () {60 vars in 1384 bytes} [Thu Jun 16 17:41:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 17:41:07.179027 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f6b52e-3325-4916-816f-0fea494ba8c7 None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:41:07.179637 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f6b52e-3325-4916-816f-0fea494ba8c7 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:41:07.179637 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f6b52e-3325-4916-816f-0fea494ba8c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:41:07.199617 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-39f6b52e-3325-4916-816f-0fea494ba8c7 None None] MFA Rules not processed for user `f7f35c1c15a84a92863d4f3f96d76830`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:41:07.200846 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-39f6b52e-3325-4916-816f-0fea494ba8c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:41:07.208934 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1455/2909] 10.222.0.39 () {58 vars in 967 bytes} [Thu Jun 16 17:41:07 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:41:07.221582 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005c487c-3bb3-4c09-b3c1-43a2062046e4 service swift] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:41:07.234839 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005c487c-3bb3-4c09-b3c1-43a2062046e4 service swift] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:41:07.240033 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117395c1-f1fe-4953-91ac-0844c7ba01b1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbec2dfe63764ed88a23e172ead0afa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:41:07.240601 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117395c1-f1fe-4953-91ac-0844c7ba01b1 service swift] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:41:07.240938 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117395c1-f1fe-4953-91ac-0844c7ba01b1 service swift] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:41:07.241247 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117395c1-f1fe-4953-91ac-0844c7ba01b1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:41:07.256275 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117395c1-f1fe-4953-91ac-0844c7ba01b1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:41:07.259868 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117395c1-f1fe-4953-91ac-0844c7ba01b1 service swift] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:41:07.274627 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1455/2910] 10.222.0.39 () {60 vars in 1384 bytes} [Thu Jun 16 17:41:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 17:41:08.001362 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1c9bbb-6e0f-44d4-b0f4-2c666fe51c76 None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:41:08.002075 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1c9bbb-6e0f-44d4-b0f4-2c666fe51c76 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:41:08.002075 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1c9bbb-6e0f-44d4-b0f4-2c666fe51c76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:41:08.021999 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-ce1c9bbb-6e0f-44d4-b0f4-2c666fe51c76 None None] MFA Rules not processed for user `f7f35c1c15a84a92863d4f3f96d76830`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:41:08.023291 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-ce1c9bbb-6e0f-44d4-b0f4-2c666fe51c76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:41:08.032331 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1456/2911] 10.222.0.39 () {58 vars in 1009 bytes} [Thu Jun 16 17:41:07 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:41:08.049520 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117395c1-f1fe-4953-91ac-0844c7ba01b1 service swift] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:41:08.061637 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117395c1-f1fe-4953-91ac-0844c7ba01b1 service swift] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:41:08.069610 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2216b710-1f05-4fdd-8a4f-f41165931695 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbec2dfe63764ed88a23e172ead0afa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:41:08.070677 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2216b710-1f05-4fdd-8a4f-f41165931695 service swift] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:41:08.071152 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2216b710-1f05-4fdd-8a4f-f41165931695 service swift] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:41:08.072129 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2216b710-1f05-4fdd-8a4f-f41165931695 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:41:08.083568 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2216b710-1f05-4fdd-8a4f-f41165931695 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:41:08.085205 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2216b710-1f05-4fdd-8a4f-f41165931695 service swift] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:41:08.095580 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1456/2912] 10.222.0.39 () {60 vars in 1384 bytes} [Thu Jun 16 17:41:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 17:41:08.773384 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f7f1d3-f522-4035-ab2d-9d2b0dd916e8 None None] REQUEST_METHOD: `POST` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:41:08.773900 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f7f1d3-f522-4035-ab2d-9d2b0dd916e8 None None] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:41:08.774135 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f7f1d3-f522-4035-ab2d-9d2b0dd916e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:41:08.793627 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.auth.core [None req-03f7f1d3-f522-4035-ab2d-9d2b0dd916e8 None None] MFA Rules not processed for user `f7f35c1c15a84a92863d4f3f96d76830`. Rule list: `[]` (Enabled: `True`). {{(pid=80874) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:41:08.795053 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-03f7f1d3-f522-4035-ab2d-9d2b0dd916e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:41:08.802841 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1457/2913] 10.222.0.39 () {58 vars in 967 bytes} [Thu Jun 16 17:41:08 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:41:08.816173 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2216b710-1f05-4fdd-8a4f-f41165931695 service swift] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:41:08.828008 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2216b710-1f05-4fdd-8a4f-f41165931695 service swift] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:41:08.840353 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e46515-85f2-4b96-9f6a-75ac2672d0f1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbec2dfe63764ed88a23e172ead0afa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:41:08.841409 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e46515-85f2-4b96-9f6a-75ac2672d0f1 service swift] REQUEST_METHOD: `GET` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:41:08.841409 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e46515-85f2-4b96-9f6a-75ac2672d0f1 service swift] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:41:08.841409 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e46515-85f2-4b96-9f6a-75ac2672d0f1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:41:08.851225 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e46515-85f2-4b96-9f6a-75ac2672d0f1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:41:08.853546 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e46515-85f2-4b96-9f6a-75ac2672d0f1 service swift] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:41:08.863582 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1457/2914] 10.222.0.39 () {60 vars in 1384 bytes} [Thu Jun 16 17:41:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 17:41:11.725834 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f7f1d3-f522-4035-ab2d-9d2b0dd916e8 None None] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:41:11.807381 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f7f1d3-f522-4035-ab2d-9d2b0dd916e8 None None] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:41:11.812529 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2090ce01-5acd-4f9c-8207-0b95637b179d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:41:11.813459 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2090ce01-5acd-4f9c-8207-0b95637b179d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:41:11.813703 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2090ce01-5acd-4f9c-8207-0b95637b179d admin admin] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:41:11.814015 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2090ce01-5acd-4f9c-8207-0b95637b179d admin admin] PATH_INFO: `/v3/users/efee4b8997cf480da650901e6ca91cc3` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:41:11.815379 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2090ce01-5acd-4f9c-8207-0b95637b179d admin admin] RBAC: Authorizing `identity:delete_user(user_id=efee4b8997cf480da650901e6ca91cc3)` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:41:11.817353 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2090ce01-5acd-4f9c-8207-0b95637b179d admin admin] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:41:12.069095 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:41:12.070822 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-2090ce01-5acd-4f9c-8207-0b95637b179d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'efee4b8997cf480da650901e6ca91cc3'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:41:12.080992 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-2090ce01-5acd-4f9c-8207-0b95637b179d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'efee4b8997cf480da650901e6ca91cc3'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:41:12.191052 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-2090ce01-5acd-4f9c-8207-0b95637b179d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'efee4b8997cf480da650901e6ca91cc3'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:41:12.191707 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-2090ce01-5acd-4f9c-8207-0b95637b179d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'efee4b8997cf480da650901e6ca91cc3'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:41:12.211035 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.notifications [None req-2090ce01-5acd-4f9c-8207-0b95637b179d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'efee4b8997cf480da650901e6ca91cc3'} {{(pid=80874) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:41:12.218344 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1458/2915] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 16 17:41:11 2022] DELETE /identity/v3/users/efee4b8997cf480da650901e6ca91cc3 => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 17:41:12.218932 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a4ffea-569e-472b-8f4a-a1cb67242555 None None] REQUEST_METHOD: `POST` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:41:12.219494 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a4ffea-569e-472b-8f4a-a1cb67242555 None None] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:41:12.219494 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a4ffea-569e-472b-8f4a-a1cb67242555 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:41:12.238042 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.auth.core [None req-30a4ffea-569e-472b-8f4a-a1cb67242555 None None] MFA Rules not processed for user `338529aa60c34c3887b1c9ec26ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80873) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:41:12.239307 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-30a4ffea-569e-472b-8f4a-a1cb67242555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:41:12.310192 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1458/2916] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 17:41:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 17:41:12.321280 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2090ce01-5acd-4f9c-8207-0b95637b179d admin admin] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:41:12.323328 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-2090ce01-5acd-4f9c-8207-0b95637b179d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:41:12.385540 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2090ce01-5acd-4f9c-8207-0b95637b179d admin admin] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:41:12.389560 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e9be19-b40d-4928-adf8-17b68d6eca04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5d25bfa8dc042329d57cd55fa7b7b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:41:12.390265 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e9be19-b40d-4928-adf8-17b68d6eca04 service neutron] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:41:12.390549 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e9be19-b40d-4928-adf8-17b68d6eca04 service neutron] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:41:12.390826 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e9be19-b40d-4928-adf8-17b68d6eca04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:41:12.400923 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e9be19-b40d-4928-adf8-17b68d6eca04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:41:12.402451 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e9be19-b40d-4928-adf8-17b68d6eca04 service neutron] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:41:12.412490 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1459/2917] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:41:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:41:12.761398 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a4ffea-569e-472b-8f4a-a1cb67242555 None None] Authenticating user token {{(pid=80873) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:41:12.763274 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.fernet_utils [None req-30a4ffea-569e-472b-8f4a-a1cb67242555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80873) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:41:12.778785 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a4ffea-569e-472b-8f4a-a1cb67242555 None None] Validating token access rules against request {{(pid=80873) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:41:12.784172 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e976fc-1615-4172-a1d1-87c8496754e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338529aa60c34c3887b1c9ec26ad60d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63375056d675488ab27a6e1a845c0237', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80873) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:41:12.785073 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e976fc-1615-4172-a1d1-87c8496754e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:41:12.785358 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e976fc-1615-4172-a1d1-87c8496754e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:41:12.785642 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e976fc-1615-4172-a1d1-87c8496754e2 admin admin] PATH_INFO: `/v3/projects/a9363cf32b2743249f011d0915ff6229` {{(pid=80873) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:41:12.787119 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e976fc-1615-4172-a1d1-87c8496754e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9363cf32b2743249f011d0915ff6229)` {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:41:12.789067 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e976fc-1615-4172-a1d1-87c8496754e2 admin admin] RBAC: Authorization granted {{(pid=80873) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:41:12.891790 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:41:12.916175 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-30e976fc-1615-4172-a1d1-87c8496754e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9363cf32b2743249f011d0915ff6229', 'request_id': 'req-30e976fc-1615-4172-a1d1-87c8496754e2'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:41:12.923527 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-30e976fc-1615-4172-a1d1-87c8496754e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9363cf32b2743249f011d0915ff6229', 'request_id': 'req-30e976fc-1615-4172-a1d1-87c8496754e2'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:41:12.930277 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-30e976fc-1615-4172-a1d1-87c8496754e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9363cf32b2743249f011d0915ff6229', 'request_id': 'req-30e976fc-1615-4172-a1d1-87c8496754e2'} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:41:13.031664 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-30e976fc-1615-4172-a1d1-87c8496754e2 admin admin] The token cache is being invalidate because project a9363cf32b2743249f011d0915ff6229 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80873) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 17:41:13.031893 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-30e976fc-1615-4172-a1d1-87c8496754e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:41:13.032686 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG keystone.notifications [None req-30e976fc-1615-4172-a1d1-87c8496754e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80873) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:41:13.035550 dv-cinder-837356-2-smb devstack@keystone.service[80873]: [pid: 80873|app: 0|req: 1459/2918] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 16 17:41:12 2022] DELETE /identity/v3/projects/a9363cf32b2743249f011d0915ff6229 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:41:22.588902 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=39,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:41:23.034095 dv-cinder-837356-2-smb devstack@keystone.service[80873]: DEBUG dbcounter [-] [80873] Writing DB stats keystone:DELETE=6,keystone:SELECT=14,keystone:INSERT=1 {{(pid=80873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:43:27.585181 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e9be19-b40d-4928-adf8-17b68d6eca04 service neutron] Authenticating user token {{(pid=80874) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:43:27.587136 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-16e9be19-b40d-4928-adf8-17b68d6eca04 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:43:27.676192 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e9be19-b40d-4928-adf8-17b68d6eca04 service neutron] Validating token access rules against request {{(pid=80874) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:43:27.748168 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d45ff0-2974-48c5-83c6-2b242605fb47 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2882f26811094d8e88c03701c94296fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73015da4de1f48c29f57fff1040d2c10', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80874) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:43:27.748832 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d45ff0-2974-48c5-83c6-2b242605fb47 service placement] REQUEST_METHOD: `GET` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:43:27.749124 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d45ff0-2974-48c5-83c6-2b242605fb47 service placement] SCRIPT_NAME: `/identity` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:43:27.749409 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d45ff0-2974-48c5-83c6-2b242605fb47 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80874) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:43:27.751312 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.fernet_utils [None req-84d45ff0-2974-48c5-83c6-2b242605fb47 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80874) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:43:27.769591 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d45ff0-2974-48c5-83c6-2b242605fb47 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:43:27.772917 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d45ff0-2974-48c5-83c6-2b242605fb47 service placement] RBAC: Authorization granted {{(pid=80874) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:43:27.791832 dv-cinder-837356-2-smb devstack@keystone.service[80874]: [pid: 80874|app: 0|req: 1460/2919] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 17:43:27 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:43:37.783938 dv-cinder-837356-2-smb devstack@keystone.service[80874]: DEBUG dbcounter [-] [80874] Writing DB stats keystone:SELECT=58 {{(pid=80874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}